Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-09-28T20:02:08Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:02:08Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260928 20:02:08.280712 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.254:42899
--webserver_interface=127.25.129.254
--webserver_port=0
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260928 20:02:08.590315 26128 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:08.590931 26128 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:08.591390 26128 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 20:02:08.623883 26128 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:02:08.624256 26128 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:08.624531 26128 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:02:08.624806 26128 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:02:08.661938 26128 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.254:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.129.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:08.663352 26128 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:08.665007 26128 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 20:02:08.676015 26134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:10.079973 26133 debug-util.cc:398] Leaking SignalData structure 0x7b0800028e80 after lost signal to thread 26128
W20260928 20:02:10.183369 26133 kernel_stack_watchdog.cc:198] Thread 26128 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260928 20:02:08.676023 26135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:10.189927 26128 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.514s user 0.005s sys 0.002s
W20260928 20:02:10.190312 26136 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1507 milliseconds
W20260928 20:02:10.190438 26128 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.515s user 0.005s sys 0.002s
W20260928 20:02:10.191591 26137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:10.191638 26128 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:10.192878 26128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:10.195339 26128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:10.196714 26128 hybrid_clock.cc:648] HybridClock initialized: now 1790625730196679 us; error 34 us; skew 500 ppm
I20260928 20:02:10.197499 26128 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:10.203246 26128 webserver.cc:533] Webserver started at http://127.25.129.254:35581/ using document root <none> and password file <none>
I20260928 20:02:10.204213 26128 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:10.204447 26128 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:10.204928 26128 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:02:10.211828 26128 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data/instance:
uuid: "fd517ada41af42d8b8d85ba1e657e003"
format_stamp: "Formatted at 2026-09-28 20:02:10 on dist-test-slave-zq0l"
I20260928 20:02:10.213202 26128 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal/instance:
uuid: "fd517ada41af42d8b8d85ba1e657e003"
format_stamp: "Formatted at 2026-09-28 20:02:10 on dist-test-slave-zq0l"
I20260928 20:02:10.220577 26128 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260928 20:02:10.226676 26144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:10.227835 26128 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260928 20:02:10.228147 26128 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal
uuid: "fd517ada41af42d8b8d85ba1e657e003"
format_stamp: "Formatted at 2026-09-28 20:02:10 on dist-test-slave-zq0l"
I20260928 20:02:10.228458 26128 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:10.297611 26128 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:10.299130 26128 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:10.299585 26128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:10.370088 26128 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.254:42899
I20260928 20:02:10.370231 26195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.254:42899 every 8 connection(s)
I20260928 20:02:10.372855 26128 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/data/info.pb
I20260928 20:02:10.378847 26196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:10.379837 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 26128
I20260928 20:02:10.380266 26119 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-0/wal/instance
I20260928 20:02:10.384068 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.253:32923
--webserver_interface=127.25.129.253
--webserver_port=0
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 20:02:10.389720 26196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:02:10.418063 26196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } has no permanent_uuid. Determining permanent_uuid...
W20260928 20:02:10.420816 26148 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
W20260928 20:02:10.425449 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
I20260928 20:02:10.474961 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 1
W20260928 20:02:10.479736 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
I20260928 20:02:10.548213 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 2
W20260928 20:02:10.552727 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
I20260928 20:02:10.644136 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 3
W20260928 20:02:10.648478 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
W20260928 20:02:10.703233 26198 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:10.703876 26198 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:10.704331 26198 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 20:02:10.738837 26198 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:02:10.739213 26198 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:10.739485 26198 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:02:10.739745 26198 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:02:10.777884 26198 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.253:32923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.129.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:10.779471 26198 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:10.781261 26198 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260928 20:02:10.791867 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 4
W20260928 20:02:10.792348 26207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:10.797837 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
I20260928 20:02:11.097437 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 5
W20260928 20:02:11.104275 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
I20260928 20:02:11.651894 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 6
W20260928 20:02:11.671875 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.253:32923: Network error: Client connection negotiation failed: client connection to 127.25.129.253:32923: connect: Connection refused (error 111)
W20260928 20:02:10.793967 26208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:11.997848 26210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:12.000533 26209 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1203 milliseconds
I20260928 20:02:12.000623 26198 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:12.001904 26198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:12.004997 26198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:12.006465 26198 hybrid_clock.cc:648] HybridClock initialized: now 1790625732006422 us; error 51 us; skew 500 ppm
I20260928 20:02:12.007310 26198 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:12.014707 26198 webserver.cc:533] Webserver started at http://127.25.129.253:39295/ using document root <none> and password file <none>
I20260928 20:02:12.015689 26198 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:12.015887 26198 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:12.016301 26198 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:02:12.020875 26198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data/instance:
uuid: "5308dad1e3384995a990de7c4866f1b1"
format_stamp: "Formatted at 2026-09-28 20:02:12 on dist-test-slave-zq0l"
I20260928 20:02:12.021996 26198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal/instance:
uuid: "5308dad1e3384995a990de7c4866f1b1"
format_stamp: "Formatted at 2026-09-28 20:02:12 on dist-test-slave-zq0l"
I20260928 20:02:12.029438 26198 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260928 20:02:12.035058 26219 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:12.036123 26198 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260928 20:02:12.036394 26198 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal
uuid: "5308dad1e3384995a990de7c4866f1b1"
format_stamp: "Formatted at 2026-09-28 20:02:12 on dist-test-slave-zq0l"
I20260928 20:02:12.036695 26198 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:12.093742 26198 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:12.095221 26198 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:12.095618 26198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:12.170269 26198 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.253:32923
I20260928 20:02:12.170337 26270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.253:32923 every 8 connection(s)
I20260928 20:02:12.173177 26198 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/data/info.pb
I20260928 20:02:12.179235 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:12.181694 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 26198
I20260928 20:02:12.182210 26119 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-1/wal/instance
I20260928 20:02:12.185386 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.252:44461
--webserver_interface=127.25.129.252
--webserver_port=0
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 20:02:12.193707 26271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:02:12.217077 26271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:02:12.232124 26271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } has no permanent_uuid. Determining permanent_uuid...
W20260928 20:02:12.234963 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
W20260928 20:02:12.239490 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.289153 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 1
W20260928 20:02:12.293582 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.362080 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 2
W20260928 20:02:12.366849 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.458374 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 3
W20260928 20:02:12.462517 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
W20260928 20:02:12.505226 26273 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:12.505875 26273 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:12.506373 26273 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 20:02:12.539803 26273 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:02:12.540153 26273 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:12.540421 26273 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:02:12.540684 26273 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:02:12.578574 26273 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.252:44461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.129.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:12.579960 26273 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:12.581585 26273 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 20:02:12.592514 26283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:12.605904 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 4
W20260928 20:02:12.610322 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.732494 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } attempt: 7
I20260928 20:02:12.762041 26196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } has no permanent_uuid. Determining permanent_uuid...
W20260928 20:02:12.771148 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.829738 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 1
W20260928 20:02:12.836931 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.909788 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 5
W20260928 20:02:12.917174 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:12.918574 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 2
W20260928 20:02:12.925364 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:13.010934 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 3
W20260928 20:02:13.017933 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:13.158547 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 4
W20260928 20:02:13.165508 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:13.449115 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 5
W20260928 20:02:13.457353 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:13.464776 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 6
W20260928 20:02:13.484632 26271 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
W20260928 20:02:12.596271 26286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:12.592944 26284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:13.892906 26285 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1295 milliseconds
I20260928 20:02:13.893036 26273 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:13.894462 26273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:13.897120 26273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:13.898628 26273 hybrid_clock.cc:648] HybridClock initialized: now 1790625733898579 us; error 55 us; skew 500 ppm
I20260928 20:02:13.899438 26273 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:13.905635 26273 webserver.cc:533] Webserver started at http://127.25.129.252:43621/ using document root <none> and password file <none>
I20260928 20:02:13.906755 26273 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:13.906970 26273 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:13.907418 26273 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:02:13.912384 26273 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/instance:
uuid: "0b347187d9be4ad08708acffdf4dda63"
format_stamp: "Formatted at 2026-09-28 20:02:13 on dist-test-slave-zq0l"
I20260928 20:02:13.913599 26273 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal/instance:
uuid: "0b347187d9be4ad08708acffdf4dda63"
format_stamp: "Formatted at 2026-09-28 20:02:13 on dist-test-slave-zq0l"
I20260928 20:02:13.921322 26273 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260928 20:02:13.927248 26298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:13.928496 26273 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260928 20:02:13.928846 26273 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
uuid: "0b347187d9be4ad08708acffdf4dda63"
format_stamp: "Formatted at 2026-09-28 20:02:13 on dist-test-slave-zq0l"
I20260928 20:02:13.929206 26273 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:13.980281 26273 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:13.981824 26273 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:13.982317 26273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:14.009914 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 6
W20260928 20:02:14.018036 26196 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.129.252:44461: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:14.057152 26273 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.252:44461
I20260928 20:02:14.057237 26351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.252:44461 every 8 connection(s)
I20260928 20:02:14.059911 26273 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/info.pb
I20260928 20:02:14.061803 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 26273
I20260928 20:02:14.062341 26119 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal/instance
I20260928 20:02:14.067587 26352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:14.089725 26352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:02:14.113619 26352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:02:14.124738 26352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:02:14.141274 26352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Bootstrap starting.
I20260928 20:02:14.148156 26352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:14.150827 26352 log.cc:826] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:14.155339 26352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: No bootstrap required, opened a new log
I20260928 20:02:14.177001 26352 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:14.177623 26352 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:14.177947 26352 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b347187d9be4ad08708acffdf4dda63, State: Initialized, Role: FOLLOWER
I20260928 20:02:14.178812 26352 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:14.181754 26361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:14.182700 26361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:14.183665 26352 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: configured and running, proceeding with master startup.
W20260928 20:02:14.212266 26372 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:02:14.212615 26372 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260928 20:02:14.237442 26304 tablet.cc:2433] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:02:14.206369 26273 master_runner.cc:187] Error getting master registration for 127.25.129.254:42899: OK, instance_id { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" instance_seqno: 1790625730350850 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:02:14.239789 26273 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:02:14.286312 26361 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:14.286909 26361 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:14.289613 26361 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:02:14.545217 26271 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 7
I20260928 20:02:14.569849 26271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Bootstrap starting.
I20260928 20:02:14.577502 26271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:14.579870 26271 log.cc:826] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:14.585105 26271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: No bootstrap required, opened a new log
I20260928 20:02:14.613910 26271 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:14.614655 26271 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:14.614938 26271 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5308dad1e3384995a990de7c4866f1b1, State: Initialized, Role: FOLLOWER
I20260928 20:02:14.615723 26271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:14.618368 26376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:14.619222 26376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:14.620097 26271 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:02:14.620365 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:14.621335 26246 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b347187d9be4ad08708acffdf4dda63 in term 0.
I20260928 20:02:14.623067 26302 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1; no voters:
I20260928 20:02:14.624059 26361 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:14.624395 26361 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:14.624701 26361 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:14.631469 26361 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:14.634778 26361 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 1 election: Requested vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:02:14.634999 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1"
I20260928 20:02:14.635649 26246 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:14.646618 26246 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b347187d9be4ad08708acffdf4dda63 in term 1.
I20260928 20:02:14.647909 26302 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1; no voters:
I20260928 20:02:14.648717 26361 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:14.650532 26361 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 1 LEADER]: Becoming Leader. State: Replica: 0b347187d9be4ad08708acffdf4dda63, State: Running, Role: LEADER
I20260928 20:02:14.651481 26361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:02:14.693176 26388 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:02:14.693629 26388 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:02:14.698851 26387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b347187d9be4ad08708acffdf4dda63. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:14.699399 26387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:14.701812 26391 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 20:02:14.709203 26391 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 20:02:14.657847 26198 master_runner.cc:187] Error getting master registration for 127.25.129.254:42899: OK, instance_id { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" instance_seqno: 1790625730350850 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:02:14.716871 26198 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:02:14.726639 26246 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Refusing update from remote peer 0b347187d9be4ad08708acffdf4dda63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:02:14.728756 26387 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:14.755290 26376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b347187d9be4ad08708acffdf4dda63. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:14.756063 26376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:14.773844 26361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:14.774642 26361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:14.778234 26376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:14.778965 26376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:14.781514 26391 catalog_manager.cc:1396] Generated new cluster ID: b136c9e8aca3413fbbd2c68f6588888b
I20260928 20:02:14.781821 26391 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 20:02:14.845674 26391 catalog_manager.cc:1419] Generated new certificate authority record
I20260928 20:02:14.847904 26391 catalog_manager.cc:1553] Loading token signing keys...
I20260928 20:02:14.872334 26391 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Generated new TSK 0
I20260928 20:02:14.873499 26391 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 20:02:14.902168 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.129.193:0
--local_ip_for_outbound_sockets=127.25.129.193
--webserver_interface=127.25.129.193
--webserver_port=0
--tserver_master_addrs=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260928 20:02:14.976922 26299 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.686s (SENT)
I20260928 20:02:15.051520 26196 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } attempt: 7
I20260928 20:02:15.115226 26196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Bootstrap starting.
I20260928 20:02:15.130592 26196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:15.132926 26196 log.cc:826] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:15.162647 26196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: No bootstrap required, opened a new log
I20260928 20:02:15.242072 26196 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:15.258276 26196 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:15.258761 26196 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd517ada41af42d8b8d85ba1e657e003, State: Initialized, Role: FOLLOWER
I20260928 20:02:15.259892 26196 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:15.280679 26196 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:02:15.280853 26168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:15.281687 26168 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b347187d9be4ad08708acffdf4dda63 in term 0.
I20260928 20:02:15.282742 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003"
I20260928 20:02:15.283365 26170 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:15.287731 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:02:15.288643 26171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47116 (request call id 2) took 998 ms (client timeout 686 ms). Trace:
W20260928 20:02:15.288967 26171 rpcz_store.cc:269] 0928 20:02:14.289960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:14.290122 (+ 162us) service_pool.cc:224] Handling call
0928 20:02:15.288571 (+998449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:15.295111 26170 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b347187d9be4ad08708acffdf4dda63 in term 1.
I20260928 20:02:15.296391 26169 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Refusing update from remote peer 0b347187d9be4ad08708acffdf4dda63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:02:15.303066 26387 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:15.277136 26401 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:15.306674 26401 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:02:15.310194 26150 tablet.cc:2433] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:02:15.312875 26170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47116 (request call id 3) took 679 ms (client timeout 722 ms). Trace:
W20260928 20:02:15.313306 26170 rpcz_store.cc:269] 0928 20:02:14.633752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:14.634148 (+ 396us) service_pool.cc:224] Handling call
0928 20:02:15.312815 (+678667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:15.362660 26401 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b347187d9be4ad08708acffdf4dda63. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:15.363509 26401 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:15.363266 26410 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:15.365003 26410 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:15.401724 26417 catalog_manager.cc:1308] Loaded cluster ID: b136c9e8aca3413fbbd2c68f6588888b
I20260928 20:02:15.410226 26417 catalog_manager.cc:1601] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: loading cluster ID for follower catalog manager: success
I20260928 20:02:15.417723 26417 catalog_manager.cc:1623] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: acquiring CA information for follower catalog manager: success
I20260928 20:02:15.439735 26417 catalog_manager.cc:1651] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260928 20:02:15.470136 26397 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:15.470803 26397 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:15.471727 26397 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 20:02:15.534067 26397 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:15.535640 26397 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.129.193
I20260928 20:02:15.603459 26397 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.129.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.129.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.129.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:15.605203 26397 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:15.607347 26397 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 20:02:15.642954 26424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:15.701857 26388 catalog_manager.cc:1308] Loaded cluster ID: b136c9e8aca3413fbbd2c68f6588888b
I20260928 20:02:15.702313 26388 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: loading cluster ID for follower catalog manager: success
I20260928 20:02:15.710006 26388 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: acquiring CA information for follower catalog manager: success
I20260928 20:02:15.728564 26388 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:02:15.809022 26410 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:15.809727 26410 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:15.815335 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:15.817166 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:15.821794 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:15.822973 26401 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:15.823992 26410 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:15.895025 26387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0b347187d9be4ad08708acffdf4dda63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:15.896116 26387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:16.395499 26433 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:16.396220 26433 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:16.400295 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:16.407618 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:16.409834 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:16.415081 26433 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:16.416255 26433 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:16.731413 26435 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:16.732364 26435 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:16.738767 26435 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:16.741966 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:16.744308 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:16.747767 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:16.748792 26435 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:16.984709 26436 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:16.992864 26436 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:16.996791 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:17.002353 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:17.005026 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:17.010079 26436 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:17.010957 26437 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:17.781738 26438 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:17.784062 26438 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:17.795624 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:17.799270 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:17.806015 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:17.808239 26438 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:17.809370 26438 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:18.327862 26441 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:18.330574 26441 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:18.335297 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:18.337517 26441 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:18.338655 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:18.340272 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:18.341516 26441 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:02:17.030181 26423 debug-util.cc:398] Leaking SignalData structure 0x7b08000373a0 after lost signal to thread 26397
W20260928 20:02:18.597745 26423 kernel_stack_watchdog.cc:198] Thread 26397 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 384ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260928 20:02:15.646836 26425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:18.600291 26427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:18.600838 26397 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.956s user 0.500s sys 0.795s
W20260928 20:02:18.601227 26397 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.957s user 0.500s sys 0.795s
W20260928 20:02:18.603050 26426 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2956 milliseconds
I20260928 20:02:18.603099 26397 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:18.604875 26397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:18.608009 26397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:18.610266 26397 hybrid_clock.cc:648] HybridClock initialized: now 1790625738610174 us; error 91 us; skew 500 ppm
I20260928 20:02:18.611470 26397 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:18.620322 26397 webserver.cc:533] Webserver started at http://127.25.129.193:35543/ using document root <none> and password file <none>
I20260928 20:02:18.621584 26397 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:18.621862 26397 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:18.622475 26397 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:02:18.629122 26397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data/instance:
uuid: "9b44798af33f4733ba9cde0a1b541f54"
format_stamp: "Formatted at 2026-09-28 20:02:18 on dist-test-slave-zq0l"
I20260928 20:02:18.630715 26397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/instance:
uuid: "9b44798af33f4733ba9cde0a1b541f54"
format_stamp: "Formatted at 2026-09-28 20:02:18 on dist-test-slave-zq0l"
I20260928 20:02:18.641127 26397 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s
I20260928 20:02:18.649045 26447 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:18.650686 26397 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.005s sys 0.002s
I20260928 20:02:18.651121 26397 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal
uuid: "9b44798af33f4733ba9cde0a1b541f54"
format_stamp: "Formatted at 2026-09-28 20:02:18 on dist-test-slave-zq0l"
I20260928 20:02:18.651556 26397 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:18.739768 26397 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:18.741891 26397 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:18.742496 26397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:18.746145 26397 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 20:02:18.752266 26397 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:02:18.752570 26397 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:18.752878 26397 ts_tablet_manager.cc:662] Registered 0 tablets
I20260928 20:02:18.753089 26397 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:18.783421 26459 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:18.783941 26459 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:18.785993 26459 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:18.787418 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:18.787636 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:18.790452 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:18.791512 26459 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:18.938669 26397 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.193:33323
I20260928 20:02:18.938740 26560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.193:33323 every 8 connection(s)
I20260928 20:02:18.942373 26397 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/data/info.pb
I20260928 20:02:18.945297 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 26397
I20260928 20:02:18.946025 26119 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/instance
I20260928 20:02:18.978871 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.129.194:0
--local_ip_for_outbound_sockets=127.25.129.194
--webserver_interface=127.25.129.194
--webserver_port=0
--tserver_master_addrs=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 20:02:18.998884 26561 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:18.999571 26561 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:19.001367 26561 heartbeater.cc:507] Master 127.25.129.252:44461 requested a full tablet report, sending...
I20260928 20:02:19.005234 26315 ts_manager.cc:194] Registered new tserver with Master: 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:19.008128 26315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.25.129.193:39125
I20260928 20:02:19.015990 26562 heartbeater.cc:344] Connected to a master server at 127.25.129.253:32923
I20260928 20:02:19.016909 26562 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:19.017647 26562 heartbeater.cc:507] Master 127.25.129.253:32923 requested a full tablet report, sending...
I20260928 20:02:19.021879 26236 ts_manager.cc:194] Registered new tserver with Master: 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:19.027062 26566 heartbeater.cc:344] Connected to a master server at 127.25.129.254:42899
I20260928 20:02:19.027431 26566 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:19.028019 26566 heartbeater.cc:507] Master 127.25.129.254:42899 requested a full tablet report, sending...
I20260928 20:02:19.030880 26161 ts_manager.cc:194] Registered new tserver with Master: 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:19.351393 26565 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:19.352003 26565 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:19.352615 26565 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260928 20:02:19.361032 26575 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:19.361481 26575 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:19.363893 26575 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:19.364189 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:19.364617 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:19.366204 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:19.367063 26575 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:02:19.389875 26565 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:19.390868 26565 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.129.194
I20260928 20:02:19.429634 26565 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.129.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.129.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.129.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:19.431075 26565 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:19.432706 26565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 20:02:19.445571 26577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:19.513706 26561 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:19.797739 26583 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:19.798640 26583 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:19.803092 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:19.803551 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:19.805552 26583 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:19.805899 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:19.807107 26583 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:19.975139 26584 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:19.975893 26584 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:19.978816 26584 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:19.980394 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:19.980584 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:19.983052 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:19.984596 26584 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:20.488510 26585 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:20.489210 26585 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:20.492511 26585 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:20.493412 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:20.494238 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:20.496398 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:20.497835 26585 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:02:19.447423 26578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:20.745759 26580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:20.747512 26579 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1296 milliseconds
I20260928 20:02:20.747596 26565 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:20.748835 26565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:20.751068 26565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:20.752421 26565 hybrid_clock.cc:648] HybridClock initialized: now 1790625740752383 us; error 49 us; skew 500 ppm
I20260928 20:02:20.753262 26565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:20.759446 26565 webserver.cc:533] Webserver started at http://127.25.129.194:41399/ using document root <none> and password file <none>
I20260928 20:02:20.760406 26565 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:20.760598 26565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:20.761113 26565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:02:20.765961 26565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data/instance:
uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
format_stamp: "Formatted at 2026-09-28 20:02:20 on dist-test-slave-zq0l"
I20260928 20:02:20.767320 26565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/instance:
uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
format_stamp: "Formatted at 2026-09-28 20:02:20 on dist-test-slave-zq0l"
I20260928 20:02:20.775311 26565 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260928 20:02:20.781097 26591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:20.782266 26565 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260928 20:02:20.782737 26565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal
uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
format_stamp: "Formatted at 2026-09-28 20:02:20 on dist-test-slave-zq0l"
I20260928 20:02:20.783131 26565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:20.832814 26565 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:20.834548 26565 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:20.835038 26565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:20.837652 26565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 20:02:20.841827 26565 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:02:20.842023 26565 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:20.842247 26565 ts_tablet_manager.cc:662] Registered 0 tablets
I20260928 20:02:20.842377 26565 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:20.988390 26565 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.194:45277
I20260928 20:02:20.988550 26703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.194:45277 every 8 connection(s)
I20260928 20:02:20.991194 26565 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/data/info.pb
I20260928 20:02:20.999401 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 26565
I20260928 20:02:21.000034 26119 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/instance
I20260928 20:02:21.034361 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.129.195:0
--local_ip_for_outbound_sockets=127.25.129.195
--webserver_interface=127.25.129.195
--webserver_port=0
--tserver_master_addrs=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260928 20:02:21.059222 26704 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:21.059877 26704 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:21.063139 26704 heartbeater.cc:507] Master 127.25.129.252:44461 requested a full tablet report, sending...
I20260928 20:02:21.065869 26706 heartbeater.cc:344] Connected to a master server at 127.25.129.254:42899
I20260928 20:02:21.067093 26706 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:21.067449 26705 heartbeater.cc:344] Connected to a master server at 127.25.129.253:32923
I20260928 20:02:21.067870 26705 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:21.068066 26315 ts_manager.cc:194] Registered new tserver with Master: 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:21.068759 26706 heartbeater.cc:507] Master 127.25.129.254:42899 requested a full tablet report, sending...
I20260928 20:02:21.069352 26705 heartbeater.cc:507] Master 127.25.129.253:32923 requested a full tablet report, sending...
I20260928 20:02:21.071841 26161 ts_manager.cc:194] Registered new tserver with Master: 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:21.072805 26235 ts_manager.cc:194] Registered new tserver with Master: 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:21.069953 26315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.25.129.194:49499
I20260928 20:02:21.333840 26715 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:21.334308 26715 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:21.335906 26715 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:21.336930 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:21.337057 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:21.338871 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:21.339478 26715 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:02:21.391944 26714 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:21.392494 26714 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:21.393075 26714 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260928 20:02:21.428644 26714 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:21.429569 26714 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.129.195
I20260928 20:02:21.468544 26714 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.129.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.129.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.129.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:21.469996 26714 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:21.471798 26714 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 20:02:21.485687 26721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:21.577620 26704 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:21.586621 26727 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:21.587366 26727 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:21.591488 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:21.592293 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:21.590179 26727 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:21.595019 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:21.596226 26727 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:21.929219 26728 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:21.929929 26728 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:21.934317 26728 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:21.934515 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:21.935622 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:21.939195 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:21.942096 26728 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:22.124851 26729 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:22.125380 26729 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:22.128090 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:22.128283 26729 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:22.129647 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:22.131280 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:22.132310 26729 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:22.481925 26731 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:22.482873 26731 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:22.487082 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:22.489394 26731 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:22.501577 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:22.504428 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:22.505559 26731 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:02:21.487762 26722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:22.746879 26724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:22.749629 26723 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1258 milliseconds
I20260928 20:02:22.749768 26714 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:22.750988 26714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:22.753738 26714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:22.755203 26714 hybrid_clock.cc:648] HybridClock initialized: now 1790625742755163 us; error 47 us; skew 500 ppm
I20260928 20:02:22.755947 26714 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:22.762641 26714 webserver.cc:533] Webserver started at http://127.25.129.195:32857/ using document root <none> and password file <none>
I20260928 20:02:22.763588 26714 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:22.763850 26714 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:22.764271 26714 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:02:22.768985 26714 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data/instance:
uuid: "b2d286f4404146278f5e0785ed9fcee4"
format_stamp: "Formatted at 2026-09-28 20:02:22 on dist-test-slave-zq0l"
I20260928 20:02:22.770061 26714 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/instance:
uuid: "b2d286f4404146278f5e0785ed9fcee4"
format_stamp: "Formatted at 2026-09-28 20:02:22 on dist-test-slave-zq0l"
I20260928 20:02:22.777804 26714 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260928 20:02:22.783843 26736 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:22.785100 26714 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.003s
I20260928 20:02:22.785529 26714 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal
uuid: "b2d286f4404146278f5e0785ed9fcee4"
format_stamp: "Formatted at 2026-09-28 20:02:22 on dist-test-slave-zq0l"
I20260928 20:02:22.785887 26714 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:22.847683 26714 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:22.849184 26714 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:22.849635 26714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:22.852258 26714 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260928 20:02:22.856516 26714 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:02:22.856714 26714 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:22.857021 26714 ts_tablet_manager.cc:662] Registered 0 tablets
I20260928 20:02:22.857193 26714 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:23.008765 26714 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.195:45553
I20260928 20:02:23.008862 26848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.195:45553 every 8 connection(s)
I20260928 20:02:23.011425 26714 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/data/info.pb
I20260928 20:02:23.019591 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 26714
I20260928 20:02:23.020190 26119 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/instance
I20260928 20:02:23.035514 26854 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:23.036132 26854 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:23.038208 26854 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:23.040338 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:23.041451 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:23.043604 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:23.060506 26854 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:23.061324 26860 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:23.061908 26860 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:23.065164 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:23.065765 26171 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5308dad1e3384995a990de7c4866f1b1 in term 1.
I20260928 20:02:23.066727 26860 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:23.069473 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:02:23.077124 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003; no voters:
I20260928 20:02:23.078022 26860 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:02:23.078423 26860 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b347187d9be4ad08708acffdf4dda63)
I20260928 20:02:23.076339 26851 heartbeater.cc:344] Connected to a master server at 127.25.129.254:42899
I20260928 20:02:23.076943 26849 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:23.078857 26860 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:23.079075 26851 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:23.079308 26849 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:23.080453 26851 heartbeater.cc:507] Master 127.25.129.254:42899 requested a full tablet report, sending...
I20260928 20:02:23.080982 26849 heartbeater.cc:507] Master 127.25.129.252:44461 requested a full tablet report, sending...
I20260928 20:02:23.083488 26315 ts_manager.cc:194] Registered new tserver with Master: b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:23.083854 26160 ts_manager.cc:194] Registered new tserver with Master: b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:23.085820 26315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.25.129.195:51923
I20260928 20:02:23.086923 26850 heartbeater.cc:344] Connected to a master server at 127.25.129.253:32923
I20260928 20:02:23.087304 26850 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:23.088254 26850 heartbeater.cc:507] Master 127.25.129.253:32923 requested a full tablet report, sending...
I20260928 20:02:23.093832 26860 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:23.099943 26235 ts_manager.cc:194] Registered new tserver with Master: b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:23.102770 26860 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 election: Requested vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:23.103442 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003"
I20260928 20:02:23.103895 26171 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:23.104444 26327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63"
I20260928 20:02:23.109588 26171 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5308dad1e3384995a990de7c4866f1b1 in term 2.
I20260928 20:02:23.110526 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63
I20260928 20:02:23.111179 26860 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:02:23.112388 26860 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 LEADER]: Becoming Leader. State: Replica: 5308dad1e3384995a990de7c4866f1b1, State: Running, Role: LEADER
I20260928 20:02:23.114069 26119 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260928 20:02:23.113849 26860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:23.118445 26861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.119343 26861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:23.121308 26863 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 20:02:23.127285 26863 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 20:02:23.130820 26863 catalog_manager.cc:1308] Loaded cluster ID: b136c9e8aca3413fbbd2c68f6588888b
I20260928 20:02:23.131283 26863 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 20:02:23.136421 26863 catalog_manager.cc:1553] Loading token signing keys...
I20260928 20:02:23.136498 26171 raft_consensus.cc:1240] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Rejecting Update request from peer 0b347187d9be4ad08708acffdf4dda63 for earlier term 1. Current term is 2. Ops: []
I20260928 20:02:23.137956 26867 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260928 20:02:23.141217 26863 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Loaded TSK: 0
I20260928 20:02:23.145182 26863 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 20:02:23.158342 26246 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 LEADER]: Rejecting Update request from peer 0b347187d9be4ad08708acffdf4dda63 for earlier term 1. Current term is 2. Ops: []
I20260928 20:02:23.158789 26869 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:02:23.159231 26869 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b347187d9be4ad08708acffdf4dda63, State: Running, Role: LEADER
I20260928 20:02:23.160115 26869 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:02:23.162182 26867 consensus_queue.cc:1175] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5308dad1e3384995a990de7c4866f1b1" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b347187d9be4ad08708acffdf4dda63 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260928 20:02:23.168139 26869 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:23.195408 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_306c36f502be4824885bd83f835b6673"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:23.193660 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e31fddf0617e49bf9d511714049e172f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:23.194720 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a83975f7c86b41f4969aaf76de187c43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:23.198982 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d7c4963dbdf84d69833a9b18e0931a19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.202029 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e31fddf0617e49bf9d511714049e172f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:23.203830 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_306c36f502be4824885bd83f835b6673 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:23.203156 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7c4963dbdf84d69833a9b18e0931a19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:23.207341 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a83975f7c86b41f4969aaf76de187c43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.226846 26372 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:02:23.236395 26327 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Refusing update from remote peer 5308dad1e3384995a990de7c4866f1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260928 20:02:23.239377 26860 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260928 20:02:23.237851 26171 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Refusing update from remote peer 5308dad1e3384995a990de7c4866f1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260928 20:02:23.241856 26860 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260928 20:02:23.264945 26869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.265663 26869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:23.267495 26854 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.268293 26854 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:23.297012 26854 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.297703 26854 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:23.297842 26861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.298791 26861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:23.300175 26891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.301107 26891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:23.301942 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e31fddf0617e49bf9d511714049e172f" } new_table_name: "default.Table_6923039c2fc143bfb9c8f15e8ef7cddb" modify_external_catalogs: true
I20260928 20:02:23.302446 26869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.303089 26869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:23.329290 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a83975f7c86b41f4969aaf76de187c43" } new_table_name: "default.Table_d7b24fe1d04541f9b2a8d92143a3af9d" modify_external_catalogs: true
I20260928 20:02:23.335841 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d7c4963dbdf84d69833a9b18e0931a19" } modify_external_catalogs: true
I20260928 20:02:23.336637 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d7c4963dbdf84d69833a9b18e0931a19" } modify_external_catalogs: true
I20260928 20:02:23.335991 26882 mvcc.cc:204] Tried to move back new op lower bound from 7334403044528820224 to 7334403043802484736. Current Snapshot: MvccSnapshot[applied={T|T < 7334403044528820224 or (T in {7334403044528820224})}]
I20260928 20:02:23.352834 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_306c36f502be4824885bd83f835b6673" } modify_external_catalogs: true
I20260928 20:02:23.353571 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_306c36f502be4824885bd83f835b6673" } modify_external_catalogs: true
I20260928 20:02:23.355120 26119 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu with pid 26273
W20260928 20:02:23.390501 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d1000b5632141c6a9419179bf16dcad consensus state has no leader
I20260928 20:02:23.394254 26234 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 289490e4c67a472096fa6111e9f9db39
W20260928 20:02:23.402606 26221 connection.cc:573] client connection to 127.25.129.252:44461 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 20:02:23.403185 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 6 similar messages]
W20260928 20:02:23.419061 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4ef49ea9d544363a3045fc6fb00a003 has no consensus state
W20260928 20:02:23.430433 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2d1000b5632141c6a9419179bf16dcad (table default.Table_6923039c2fc143bfb9c8f15e8ef7cddb [id=a0195e3cdd334211b881ca7d224262a1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2d1000b5632141c6a9419179bf16dcad consensus state has no leader
I20260928 20:02:23.432134 26233 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 56eed2205f0f466b85ee9320028bb14c
W20260928 20:02:23.452086 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:23.469599 26495 tablet_service.cc:1511] Processing CreateTablet for tablet e4ef49ea9d544363a3045fc6fb00a003 (DEFAULT_TABLE table=default.Table_d7b24fe1d04541f9b2a8d92143a3af9d [id=182ad975306c41cfa6c08ce13fab93dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.471302 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1000b5632141c6a9419179bf16dcad (DEFAULT_TABLE table=default.Table_e31fddf0617e49bf9d511714049e172f [id=a0195e3cdd334211b881ca7d224262a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.471747 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ef49ea9d544363a3045fc6fb00a003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.473795 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1000b5632141c6a9419179bf16dcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.473480 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1000b5632141c6a9419179bf16dcad (DEFAULT_TABLE table=default.Table_e31fddf0617e49bf9d511714049e172f [id=a0195e3cdd334211b881ca7d224262a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.475319 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1000b5632141c6a9419179bf16dcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.476748 26638 tablet_service.cc:1511] Processing CreateTablet for tablet e4ef49ea9d544363a3045fc6fb00a003 (DEFAULT_TABLE table=default.Table_d7b24fe1d04541f9b2a8d92143a3af9d [id=182ad975306c41cfa6c08ce13fab93dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.477849 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ef49ea9d544363a3045fc6fb00a003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.484630 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1000b5632141c6a9419179bf16dcad (DEFAULT_TABLE table=default.Table_e31fddf0617e49bf9d511714049e172f [id=a0195e3cdd334211b881ca7d224262a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.486929 26783 tablet_service.cc:1511] Processing CreateTablet for tablet e4ef49ea9d544363a3045fc6fb00a003 (DEFAULT_TABLE table=default.Table_d7b24fe1d04541f9b2a8d92143a3af9d [id=182ad975306c41cfa6c08ce13fab93dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.488570 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ef49ea9d544363a3045fc6fb00a003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.495139 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1000b5632141c6a9419179bf16dcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.503089 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ba8f5c1c63f948c49e46ab622554c64b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.505117 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba8f5c1c63f948c49e46ab622554c64b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.516229 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b3aad43282a94963a01332b5e95216ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.518054 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3aad43282a94963a01332b5e95216ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.543537 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ba31af33e9514ef696344480ae539c2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:23.543457 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_dcd373b71f9541fd9f92aabe8ff4f393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.545359 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba31af33e9514ef696344480ae539c2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:23.546036 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcd373b71f9541fd9f92aabe8ff4f393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:23.565986 26561 heartbeater.cc:646] Failed to heartbeat to 127.25.129.252:44461 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:23.566087 26913 tablet_bootstrap.cc:492] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:23.575834 26912 tablet_bootstrap.cc:492] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:23.578455 26913 tablet_bootstrap.cc:654] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.580812 26913 log.cc:826] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:23.584950 26782 tablet_service.cc:1511] Processing CreateTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 (DEFAULT_TABLE table=default.Table_ba8f5c1c63f948c49e46ab622554c64b [id=9cb4c836dd9443588ae6ae3fee3f0be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.588618 26916 tablet_bootstrap.cc:492] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:23.592157 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:23.590682 26496 tablet_service.cc:1511] Processing CreateTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 (DEFAULT_TABLE table=default.Table_ba8f5c1c63f948c49e46ab622554c64b [id=9cb4c836dd9443588ae6ae3fee3f0be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.598068 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f744fa4f9f144c4f93579cc48ba758f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.626801 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f744fa4f9f144c4f93579cc48ba758f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:23.628607 26704 heartbeater.cc:646] Failed to heartbeat to 127.25.129.252:44461 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
W20260928 20:02:23.627875 26849 heartbeater.cc:646] Failed to heartbeat to 127.25.129.252:44461 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:23.633380 26916 tablet_bootstrap.cc:654] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.634733 26912 tablet_bootstrap.cc:654] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.635996 26916 log.cc:826] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:23.637200 26912 log.cc:826] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:23.641109 26913 tablet_bootstrap.cc:492] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:23.650283 26916 tablet_bootstrap.cc:492] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:23.650345 26913 ts_tablet_manager.cc:1449] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.088s user 0.026s sys 0.033s
I20260928 20:02:23.650817 26916 ts_tablet_manager.cc:1449] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.017s
I20260928 20:02:23.642359 26639 tablet_service.cc:1511] Processing CreateTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 (DEFAULT_TABLE table=default.Table_ba8f5c1c63f948c49e46ab622554c64b [id=9cb4c836dd9443588ae6ae3fee3f0be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.657704 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f744fa4f9f144c4f93579cc48ba758f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.667524 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d7b24fe1d04541f9b2a8d92143a3af9d" } new_table_name: "default.Table_df1885b9c04e4bdcae277b75c5ee7411" modify_external_catalogs: true
I20260928 20:02:23.669937 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6923039c2fc143bfb9c8f15e8ef7cddb" } modify_external_catalogs: true
I20260928 20:02:23.670490 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6923039c2fc143bfb9c8f15e8ef7cddb" } modify_external_catalogs: true
I20260928 20:02:23.670845 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_dcd373b71f9541fd9f92aabe8ff4f393" } modify_external_catalogs: true
I20260928 20:02:23.671355 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_dcd373b71f9541fd9f92aabe8ff4f393" } modify_external_catalogs: true
I20260928 20:02:23.670498 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b3aad43282a94963a01332b5e95216ff" } new_table_name: "default.Table_c187bbd5ed2041d4b2fca02e78383df5" modify_external_catalogs: true
I20260928 20:02:23.685868 26496 tablet_service.cc:1511] Processing CreateTablet for tablet f9b18984d23e43f39fb68864b42a4edf (DEFAULT_TABLE table=default.Table_ba31af33e9514ef696344480ae539c2b [id=75885afaa1e345bbbd03e28c895c79d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.687165 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b18984d23e43f39fb68864b42a4edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.690582 26638 tablet_service.cc:1511] Processing CreateTablet for tablet f9b18984d23e43f39fb68864b42a4edf (DEFAULT_TABLE table=default.Table_ba31af33e9514ef696344480ae539c2b [id=75885afaa1e345bbbd03e28c895c79d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.691771 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b18984d23e43f39fb68864b42a4edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.703047 26912 tablet_bootstrap.cc:492] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
W20260928 20:02:23.707641 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02b3676d95d04b15bd3b1292e8d1a247 consensus state has no leader
I20260928 20:02:23.707465 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 (DEFAULT_TABLE table=default.Table_b3aad43282a94963a01332b5e95216ff [id=dff446c9839d4195853336e5da0fb453]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.709236 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b3676d95d04b15bd3b1292e8d1a247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.713865 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 (DEFAULT_TABLE table=default.Table_b3aad43282a94963a01332b5e95216ff [id=dff446c9839d4195853336e5da0fb453]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.715262 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b3676d95d04b15bd3b1292e8d1a247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.703277 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 (DEFAULT_TABLE table=default.Table_b3aad43282a94963a01332b5e95216ff [id=dff446c9839d4195853336e5da0fb453]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.720331 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b3676d95d04b15bd3b1292e8d1a247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.720247 26912 ts_tablet_manager.cc:1449] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.145s user 0.027s sys 0.004s
I20260928 20:02:23.713871 26916 raft_consensus.cc:359] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.710179 26782 tablet_service.cc:1511] Processing CreateTablet for tablet f9b18984d23e43f39fb68864b42a4edf (DEFAULT_TABLE table=default.Table_ba31af33e9514ef696344480ae539c2b [id=75885afaa1e345bbbd03e28c895c79d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.734905 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b18984d23e43f39fb68864b42a4edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.736263 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_937988c051664a258e8a2d6651648984"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.738773 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_937988c051664a258e8a2d6651648984 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.746918 26234 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 1277bba84d1c4cdab8b2bdaeded23001
I20260928 20:02:23.747368 26916 raft_consensus.cc:385] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:23.747781 26916 raft_consensus.cc:740] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:23.747859 26913 raft_consensus.cc:359] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.748582 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 2d1000b5632141c6a9419179bf16dcad
I20260928 20:02:23.748782 26913 raft_consensus.cc:385] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:23.749091 26913 raft_consensus.cc:740] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:23.751843 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:23.753222 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:23.754674 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4ef49ea9d544363a3045fc6fb00a003 consensus state has no leader
I20260928 20:02:23.756479 26913 consensus_queue.cc:260] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.749495 26916 consensus_queue.cc:260] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.760430 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:23.772687 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 2d1000b5632141c6a9419179bf16dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1000b5632141c6a9419179bf16dcad already in progress: creating tablet
I20260928 20:02:23.774047 26913 ts_tablet_manager.cc:1480] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.123s user 0.027s sys 0.013s
I20260928 20:02:23.777781 26705 heartbeater.cc:499] Master 127.25.129.253:32923 was elected leader, sending a full tablet report...
I20260928 20:02:23.778335 26916 ts_tablet_manager.cc:1480] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.127s user 0.035s sys 0.006s
W20260928 20:02:23.781221 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 2d1000b5632141c6a9419179bf16dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1000b5632141c6a9419179bf16dcad already in progress: creating tablet
I20260928 20:02:23.783789 26913 tablet_bootstrap.cc:492] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:23.786079 26916 tablet_bootstrap.cc:492] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:23.788861 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 2d1000b5632141c6a9419179bf16dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1000b5632141c6a9419179bf16dcad already in progress: creating tablet
I20260928 20:02:23.780238 26562 heartbeater.cc:499] Master 127.25.129.253:32923 was elected leader, sending a full tablet report...
I20260928 20:02:23.790023 26913 tablet_bootstrap.cc:654] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:23.803844 26711 tablet.cc:2433] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:02:23.806831 26916 tablet_bootstrap.cc:654] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.814473 26913 tablet_bootstrap.cc:492] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:23.814975 26913 ts_tablet_manager.cc:1449] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.000s
I20260928 20:02:23.817782 26913 raft_consensus.cc:359] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:23.818518 26913 raft_consensus.cc:385] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:23.818828 26913 raft_consensus.cc:740] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:23.818852 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_abfade30587a49dcab87b8e5dc46e421"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:23.819878 26913 consensus_queue.cc:260] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:23.820644 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abfade30587a49dcab87b8e5dc46e421 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.818028 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_df1885b9c04e4bdcae277b75c5ee7411 [id=182ad975306c41cfa6c08ce13fab93dc]). Expected version 2 got 0
I20260928 20:02:23.830416 26913 ts_tablet_manager.cc:1480] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260928 20:02:23.836936 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b4b6843f6dd7441c989aef1d604782d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.839696 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4b6843f6dd7441c989aef1d604782d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.845352 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:23.846307 26927 tablet_replica.cc:333] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:23.847178 26927 raft_consensus.cc:2243] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:23.847743 26927 raft_consensus.cc:2272] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:23.851251 26927 ts_tablet_manager.cc:1962] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:23.856362 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_df1885b9c04e4bdcae277b75c5ee7411 [id=182ad975306c41cfa6c08ce13fab93dc]). Expected version 2 got 0
I20260928 20:02:23.859200 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e10c75a291f54d29a3aab953bbb55a97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:23.860962 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e10c75a291f54d29a3aab953bbb55a97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:23.865214 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:23.867151 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 2d1000b5632141c6a9419179bf16dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1000b5632141c6a9419179bf16dcad already in progress: creating tablet
I20260928 20:02:23.867442 26913 tablet_bootstrap.cc:492] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:23.873700 26913 tablet_bootstrap.cc:654] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.873509 26912 raft_consensus.cc:359] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.876176 26912 raft_consensus.cc:385] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:23.876500 26912 raft_consensus.cc:740] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:23.876996 26927 ts_tablet_manager.cc:1975] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:23.877411 26927 log.cc:1199] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/2d1000b5632141c6a9419179bf16dcad
I20260928 20:02:23.878286 26927 ts_tablet_manager.cc:1996] T 2d1000b5632141c6a9419179bf16dcad P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:23.877753 26912 consensus_queue.cc:260] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.880527 26891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:23.881361 26891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:02:23.881273 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 2d1000b5632141c6a9419179bf16dcad (table default.Table_6923039c2fc143bfb9c8f15e8ef7cddb [id=a0195e3cdd334211b881ca7d224262a1]) successfully deleted
I20260928 20:02:23.892850 26913 tablet_bootstrap.cc:492] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:23.893285 26913 ts_tablet_manager.cc:1449] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.000s
I20260928 20:02:23.895846 26913 raft_consensus.cc:359] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.896508 26913 raft_consensus.cc:385] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:23.896771 26913 raft_consensus.cc:740] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:23.897547 26913 consensus_queue.cc:260] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.900800 26916 tablet_bootstrap.cc:492] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:23.901288 26916 ts_tablet_manager.cc:1449] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.115s user 0.037s sys 0.051s
I20260928 20:02:23.904269 26916 raft_consensus.cc:359] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:23.905033 26916 raft_consensus.cc:385] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:23.905380 26916 raft_consensus.cc:740] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:23.906342 26916 consensus_queue.cc:260] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:23.907658 26913 ts_tablet_manager.cc:1480] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260928 20:02:23.913138 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_df1885b9c04e4bdcae277b75c5ee7411" } new_table_name: "default.Table_b787fdc4cb8045858e69185417f866bf" modify_external_catalogs: true
I20260928 20:02:23.915458 26916 ts_tablet_manager.cc:1480] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.003s sys 0.003s
I20260928 20:02:23.917220 26913 tablet_bootstrap.cc:492] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:23.919034 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:23.919167 26916 tablet_bootstrap.cc:492] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:23.919950 26922 tablet_replica.cc:333] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:23.920866 26922 raft_consensus.cc:2243] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:23.921481 26922 raft_consensus.cc:2272] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:23.927932 26916 tablet_bootstrap.cc:654] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.929606 26913 tablet_bootstrap.cc:654] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:23.935982 26922 ts_tablet_manager.cc:1962] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:23.950426 26232 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba8f5c1c63f948c49e46ab622554c64b" } modify_external_catalogs: true
I20260928 20:02:23.950984 26232 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba8f5c1c63f948c49e46ab622554c64b" } modify_external_catalogs: true
I20260928 20:02:23.958051 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c187bbd5ed2041d4b2fca02e78383df5" } modify_external_catalogs: true
I20260928 20:02:23.958841 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c187bbd5ed2041d4b2fca02e78383df5" } modify_external_catalogs: true
I20260928 20:02:23.963471 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba31af33e9514ef696344480ae539c2b" } new_table_name: "default.Table_ba68d3b03ca844658c1a1de74314f453" modify_external_catalogs: true
I20260928 20:02:23.974844 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_df1885b9c04e4bdcae277b75c5ee7411 [id=182ad975306c41cfa6c08ce13fab93dc]). Expected version 2 got 0
W20260928 20:02:23.978410 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4ef49ea9d544363a3045fc6fb00a003 consensus state has no leader
I20260928 20:02:23.989149 26913 tablet_bootstrap.cc:492] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:23.989733 26913 ts_tablet_manager.cc:1449] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.073s user 0.011s sys 0.021s
I20260928 20:02:23.990643 26922 ts_tablet_manager.cc:1975] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:23.991080 26922 log.cc:1199] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/2d1000b5632141c6a9419179bf16dcad
I20260928 20:02:23.992012 26922 ts_tablet_manager.cc:1996] T 2d1000b5632141c6a9419179bf16dcad P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:23.993012 26913 raft_consensus.cc:359] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:23.995221 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 2d1000b5632141c6a9419179bf16dcad (table default.Table_6923039c2fc143bfb9c8f15e8ef7cddb [id=a0195e3cdd334211b881ca7d224262a1]) successfully deleted
I20260928 20:02:23.995316 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 2eec17e7fb1949289d428d6dc0721de3 (DEFAULT_TABLE table=default.Table_937988c051664a258e8a2d6651648984 [id=b86a97587c68400cb957c4e012acb7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:23.996418 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eec17e7fb1949289d428d6dc0721de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.999462 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 2eec17e7fb1949289d428d6dc0721de3 (DEFAULT_TABLE table=default.Table_937988c051664a258e8a2d6651648984 [id=b86a97587c68400cb957c4e012acb7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.001012 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eec17e7fb1949289d428d6dc0721de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:23.993973 26913 raft_consensus.cc:385] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.002331 26913 raft_consensus.cc:740] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.003079 26913 consensus_queue.cc:260] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.004988 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 2eec17e7fb1949289d428d6dc0721de3 (DEFAULT_TABLE table=default.Table_937988c051664a258e8a2d6651648984 [id=b86a97587c68400cb957c4e012acb7e3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:24.009933 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9b18984d23e43f39fb68864b42a4edf consensus state has no leader
I20260928 20:02:24.006093 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eec17e7fb1949289d428d6dc0721de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.012053 26916 tablet_bootstrap.cc:492] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:24.012565 26916 ts_tablet_manager.cc:1449] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.094s user 0.037s sys 0.024s
I20260928 20:02:24.013512 26913 ts_tablet_manager.cc:1480] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260928 20:02:24.021404 26916 raft_consensus.cc:359] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.022223 26916 raft_consensus.cc:385] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.022552 26916 raft_consensus.cc:740] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.022720 26913 tablet_bootstrap.cc:492] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:24.022915 26570 tablet.cc:2433] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:02:24.023484 26916 consensus_queue.cc:260] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.036726 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:24.040632 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.040920 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:24.042555 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 02b3676d95d04b15bd3b1292e8d1a247 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02b3676d95d04b15bd3b1292e8d1a247 already in progress: creating tablet
W20260928 20:02:24.044467 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 02b3676d95d04b15bd3b1292e8d1a247 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02b3676d95d04b15bd3b1292e8d1a247 already in progress: creating tablet
I20260928 20:02:24.046077 26916 ts_tablet_manager.cc:1480] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.033s user 0.004s sys 0.002s
I20260928 20:02:24.050068 26913 tablet_bootstrap.cc:654] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.051275 26916 tablet_bootstrap.cc:492] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:24.051321 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:24.052625 26927 tablet_replica.cc:333] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:24.053364 26927 raft_consensus.cc:2243] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:24.053850 26927 raft_consensus.cc:2272] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.058254 26916 tablet_bootstrap.cc:654] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.065761 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet f744fa4f9f144c4f93579cc48ba758f4
I20260928 20:02:24.068779 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:24.069242 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.069999 26922 tablet_replica.cc:333] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:24.071184 26922 raft_consensus.cc:2243] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:24.071424 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet f744fa4f9f144c4f93579cc48ba758f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f744fa4f9f144c4f93579cc48ba758f4 already in progress: creating tablet
I20260928 20:02:24.071856 26922 raft_consensus.cc:2272] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.081255 26922 ts_tablet_manager.cc:1962] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.086896 26927 ts_tablet_manager.cc:1962] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.092438 26912 ts_tablet_manager.cc:1480] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.366s user 0.042s sys 0.005s
I20260928 20:02:24.093858 26850 heartbeater.cc:499] Master 127.25.129.253:32923 was elected leader, sending a full tablet report...
I20260928 20:02:24.096860 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c63f34886f194863b4ef99dc2d8e18f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:24.098348 26922 ts_tablet_manager.cc:1975] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.098627 26916 tablet_bootstrap.cc:492] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:02:24.098634 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c63f34886f194863b4ef99dc2d8e18f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.098769 26922 log.cc:1199] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/f744fa4f9f144c4f93579cc48ba758f4
I20260928 20:02:24.099038 26916 ts_tablet_manager.cc:1449] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.048s user 0.015s sys 0.003s
I20260928 20:02:24.099649 26922 ts_tablet_manager.cc:1996] T f744fa4f9f144c4f93579cc48ba758f4 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:24.099834 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:24.104238 26912 tablet_bootstrap.cc:492] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:24.104378 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet f744fa4f9f144c4f93579cc48ba758f4 (table default.Table_ba8f5c1c63f948c49e46ab622554c64b [id=9cb4c836dd9443588ae6ae3fee3f0be4]) successfully deleted
I20260928 20:02:24.101745 26916 raft_consensus.cc:359] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.106141 26916 raft_consensus.cc:385] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.106706 26916 raft_consensus.cc:740] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.107543 26916 consensus_queue.cc:260] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.114756 26927 ts_tablet_manager.cc:1975] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.115290 26927 log.cc:1199] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:24.116205 26927 ts_tablet_manager.cc:1996] T 02b3676d95d04b15bd3b1292e8d1a247 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:24.123833 26916 ts_tablet_manager.cc:1480] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260928 20:02:24.129446 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d8b186e73bdf426eaada49702481236b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:24.131372 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8b186e73bdf426eaada49702481236b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.135000 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d5ac97f88b1b45d0b963c86490ab99d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:24.135943 26916 tablet_bootstrap.cc:492] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:24.136788 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5ac97f88b1b45d0b963c86490ab99d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.145222 26916 tablet_bootstrap.cc:654] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.148248 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 02b3676d95d04b15bd3b1292e8d1a247 (table default.Table_c187bbd5ed2041d4b2fca02e78383df5 [id=dff446c9839d4195853336e5da0fb453]) successfully deleted
I20260928 20:02:24.148743 26912 tablet_bootstrap.cc:654] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.149791 26927 tablet_replica.cc:333] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:24.150977 26927 raft_consensus.cc:2243] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:24.151677 26927 raft_consensus.cc:2272] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.154892 26927 ts_tablet_manager.cc:1962] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.168485 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f1d14889209b44d09285f01ec61a6d3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:24.170353 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d14889209b44d09285f01ec61a6d3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.178762 26931 raft_consensus.cc:493] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:24.179371 26931 raft_consensus.cc:515] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.182636 26913 tablet_bootstrap.cc:492] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:24.183202 26913 ts_tablet_manager.cc:1449] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.161s user 0.012s sys 0.007s
I20260928 20:02:24.185979 26913 raft_consensus.cc:359] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.186731 26913 raft_consensus.cc:385] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.187004 26913 raft_consensus.cc:740] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.188427 26931 leader_election.cc:290] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:24.189620 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b4b6843f6dd7441c989aef1d604782d7" } new_table_name: "default.Table_61f6326a3df6454fbaf5d908063a48bf" modify_external_catalogs: true
I20260928 20:02:24.195195 26912 tablet_bootstrap.cc:492] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:24.195631 26912 ts_tablet_manager.cc:1449] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.092s user 0.006s sys 0.005s
I20260928 20:02:24.217355 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_937988c051664a258e8a2d6651648984" } new_table_name: "default.Table_5a8a538adf994e70a530cb4130225ce0" modify_external_catalogs: true
I20260928 20:02:24.187798 26913 consensus_queue.cc:260] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.223623 26924 raft_consensus.cc:493] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:24.224195 26924 raft_consensus.cc:515] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.226864 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_b787fdc4cb8045858e69185417f866bf [id=182ad975306c41cfa6c08ce13fab93dc]). Expected version 3 got 0
I20260928 20:02:24.227684 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:24.228966 26927 ts_tablet_manager.cc:1975] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.229358 26927 log.cc:1199] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/f744fa4f9f144c4f93579cc48ba758f4
I20260928 20:02:24.232266 26927 ts_tablet_manager.cc:1996] T f744fa4f9f144c4f93579cc48ba758f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:24.232129 26784 tablet_service.cc:1511] Processing CreateTablet for tablet aec06a31e9034182a3e23dce21ac8b3e (DEFAULT_TABLE table=default.Table_b4b6843f6dd7441c989aef1d604782d7 [id=459c7e835c364f1cb8b3a572190234d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.233224 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec06a31e9034182a3e23dce21ac8b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.234726 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:24.235626 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet f744fa4f9f144c4f93579cc48ba758f4 (table default.Table_ba8f5c1c63f948c49e46ab622554c64b [id=9cb4c836dd9443588ae6ae3fee3f0be4]) successfully deleted
I20260928 20:02:24.237619 26638 tablet_service.cc:1511] Processing CreateTablet for tablet aec06a31e9034182a3e23dce21ac8b3e (DEFAULT_TABLE table=default.Table_b4b6843f6dd7441c989aef1d604782d7 [id=459c7e835c364f1cb8b3a572190234d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.238703 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec06a31e9034182a3e23dce21ac8b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.239226 26782 tablet_service.cc:1511] Processing CreateTablet for tablet e7158add996a4281941e77ab8f9f8ad2 (DEFAULT_TABLE table=default.Table_abfade30587a49dcab87b8e5dc46e421 [id=5b5d8145e3d84cf48c9a97d748c5c3d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.240437 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7158add996a4281941e77ab8f9f8ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.247016 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d8b186e73bdf426eaada49702481236b" } modify_external_catalogs: true
I20260928 20:02:24.247618 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d8b186e73bdf426eaada49702481236b" } modify_external_catalogs: true
I20260928 20:02:24.257735 26924 leader_election.cc:290] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:24.259483 26913 ts_tablet_manager.cc:1480] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.076s user 0.005s sys 0.001s
I20260928 20:02:24.266368 26913 tablet_bootstrap.cc:492] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:24.271149 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:24.272863 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b787fdc4cb8045858e69185417f866bf" } modify_external_catalogs: true
I20260928 20:02:24.273564 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b787fdc4cb8045858e69185417f866bf" } modify_external_catalogs: true
W20260928 20:02:24.288944 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 02b3676d95d04b15bd3b1292e8d1a247 because the tablet was not found. No further retry: Not found: Tablet not found: 02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:24.290675 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:24.295236 26926 raft_consensus.cc:493] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:24.295840 26926 raft_consensus.cc:515] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.297173 26912 raft_consensus.cc:359] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:24.297875 26912 raft_consensus.cc:385] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.304805 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 3be58e4a14614d5e87ffad4c0864d418 (DEFAULT_TABLE table=default.Table_e10c75a291f54d29a3aab953bbb55a97 [id=9d6bd1be950040e692bc9b982360c642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.306512 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be58e4a14614d5e87ffad4c0864d418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.308903 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:24.312559 26494 tablet_service.cc:1511] Processing CreateTablet for tablet e7158add996a4281941e77ab8f9f8ad2 (DEFAULT_TABLE table=default.Table_abfade30587a49dcab87b8e5dc46e421 [id=5b5d8145e3d84cf48c9a97d748c5c3d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.314446 26496 tablet_service.cc:1511] Processing CreateTablet for tablet aec06a31e9034182a3e23dce21ac8b3e (DEFAULT_TABLE table=default.Table_b4b6843f6dd7441c989aef1d604782d7 [id=459c7e835c364f1cb8b3a572190234d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:24.314919 26853 tablet.cc:2433] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:02:24.315399 26916 tablet_bootstrap.cc:492] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:24.315812 26916 ts_tablet_manager.cc:1449] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.191s user 0.021s sys 0.018s
I20260928 20:02:24.305135 26912 raft_consensus.cc:740] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.318040 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:24.323452 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec06a31e9034182a3e23dce21ac8b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.323357 26926 leader_election.cc:290] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:24.324364 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7158add996a4281941e77ab8f9f8ad2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:24.326650 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aec06a31e9034182a3e23dce21ac8b3e consensus state has no leader
I20260928 20:02:24.327777 26912 consensus_queue.cc:260] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:24.335882 26638 tablet_service.cc:1511] Processing CreateTablet for tablet e7158add996a4281941e77ab8f9f8ad2 (DEFAULT_TABLE table=default.Table_abfade30587a49dcab87b8e5dc46e421 [id=5b5d8145e3d84cf48c9a97d748c5c3d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.338052 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7158add996a4281941e77ab8f9f8ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:24.341118 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 3be58e4a14614d5e87ffad4c0864d418 (DEFAULT_TABLE table=default.Table_e10c75a291f54d29a3aab953bbb55a97 [id=9d6bd1be950040e692bc9b982360c642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.342146 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be58e4a14614d5e87ffad4c0864d418. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:24.346503 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet f744fa4f9f144c4f93579cc48ba758f4 because the tablet was not found. No further retry: Not found: Tablet not found: f744fa4f9f144c4f93579cc48ba758f4
I20260928 20:02:24.349820 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d38019b8225f48d7ae6cded1a37dd923"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:24.351999 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d38019b8225f48d7ae6cded1a37dd923 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.345892 26916 raft_consensus.cc:359] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.353159 26916 raft_consensus.cc:385] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.353446 26916 raft_consensus.cc:740] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.353920 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 3be58e4a14614d5e87ffad4c0864d418 (DEFAULT_TABLE table=default.Table_e10c75a291f54d29a3aab953bbb55a97 [id=9d6bd1be950040e692bc9b982360c642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:24.354175 26916 consensus_queue.cc:260] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.355031 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be58e4a14614d5e87ffad4c0864d418. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:24.360878 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2eec17e7fb1949289d428d6dc0721de3 consensus state has no leader
I20260928 20:02:24.368343 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.368461 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.371104 26916 ts_tablet_manager.cc:1480] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.055s user 0.010s sys 0.001s
I20260928 20:02:24.372114 26916 tablet_bootstrap.cc:492] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:24.381841 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 2d1000b5632141c6a9419179bf16dcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1000b5632141c6a9419179bf16dcad already in progress: creating tablet
W20260928 20:02:24.382656 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet f744fa4f9f144c4f93579cc48ba758f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f744fa4f9f144c4f93579cc48ba758f4 already in progress: creating tablet
I20260928 20:02:24.384423 26912 ts_tablet_manager.cc:1480] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.188s user 0.005s sys 0.004s
I20260928 20:02:24.390501 26931 raft_consensus.cc:493] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:24.391120 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.390938 26931 raft_consensus.cc:515] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:24.394742 26931 leader_election.cc:290] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:24.399070 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1000b5632141c6a9419179bf16dcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.400645 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e3096cc9a70b4fffb636bb16c6751a8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:24.401379 26923 tablet_replica.cc:333] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:24.402233 26923 raft_consensus.cc:2243] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:24.402400 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3096cc9a70b4fffb636bb16c6751a8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.402765 26923 raft_consensus.cc:2272] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.405117 26912 tablet_bootstrap.cc:492] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:24.408336 26923 ts_tablet_manager.cc:1962] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.413107 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:24.416882 26922 tablet_replica.cc:333] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:24.422072 26922 raft_consensus.cc:2243] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:24.422297 26916 tablet_bootstrap.cc:654] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.422585 26922 raft_consensus.cc:2272] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.430661 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:24.433179 26922 ts_tablet_manager.cc:1962] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:24.450683 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:24.453325 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_61f6326a3df6454fbaf5d908063a48bf [id=459c7e835c364f1cb8b3a572190234d7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet aec06a31e9034182a3e23dce21ac8b3e consensus state has no leader
I20260928 20:02:24.454032 26912 tablet_bootstrap.cc:654] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.463416 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b18984d23e43f39fb68864b42a4edf" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:24.466003 26516 raft_consensus.cc:2468] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:24.467986 26595 leader_election.cc:304] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:24.469043 26924 raft_consensus.cc:2804] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:24.469489 26924 raft_consensus.cc:493] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:24.469872 26924 raft_consensus.cc:3060] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:24.389050 26913 tablet_bootstrap.cc:654] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.484978 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:24.484736 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8d28094f407f435190e32f3d52716436"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:24.485637 26516 raft_consensus.cc:2468] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:24.486754 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d28094f407f435190e32f3d52716436 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.488940 26924 raft_consensus.cc:515] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.498788 26916 tablet_bootstrap.cc:492] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:24.499230 26916 ts_tablet_manager.cc:1449] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.127s user 0.004s sys 0.009s
I20260928 20:02:24.501830 26916 raft_consensus.cc:359] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.502660 26916 raft_consensus.cc:385] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.502952 26916 raft_consensus.cc:740] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.503629 26916 consensus_queue.cc:260] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.513691 26231 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet fcda27b79bfc4e9498c0f489fa64fec0
I20260928 20:02:24.515250 26922 ts_tablet_manager.cc:1975] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.515627 26922 log.cc:1199] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:24.516284 26922 ts_tablet_manager.cc:1996] T 02b3676d95d04b15bd3b1292e8d1a247 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:24.520934 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 02b3676d95d04b15bd3b1292e8d1a247 (table default.Table_c187bbd5ed2041d4b2fca02e78383df5 [id=dff446c9839d4195853336e5da0fb453]) successfully deleted
I20260928 20:02:24.524570 26916 ts_tablet_manager.cc:1480] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.025s user 0.006s sys 0.001s
I20260928 20:02:24.528255 26916 tablet_bootstrap.cc:492] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:24.532817 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b18984d23e43f39fb68864b42a4edf" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:24.533067 26924 leader_election.cc:290] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:24.533420 26516 raft_consensus.cc:3060] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:24.535444 26916 tablet_bootstrap.cc:654] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:24.546880 26740 leader_election.cc:343] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 2d1000b5632141c6a9419179bf16dcad
I20260928 20:02:24.548473 26740 leader_election.cc:304] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:24.554525 26916 tablet_bootstrap.cc:492] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:24.555025 26916 ts_tablet_manager.cc:1449] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.009s
I20260928 20:02:24.554921 26516 raft_consensus.cc:2468] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:24.555601 26931 raft_consensus.cc:2804] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:24.556064 26931 raft_consensus.cc:493] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:24.556443 26931 raft_consensus.cc:3060] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:24.556548 26595 leader_election.cc:304] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:24.557466 26924 raft_consensus.cc:2804] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:24.563208 26924 raft_consensus.cc:697] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:24.557875 26916 raft_consensus.cc:359] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.564102 26916 raft_consensus.cc:385] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.564419 26916 raft_consensus.cc:740] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.564329 26924 consensus_queue.cc:237] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.565276 26916 consensus_queue.cc:260] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.567628 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b18984d23e43f39fb68864b42a4edf" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:24.571475 26594 leader_election.cc:343] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:24.572645 26916 ts_tablet_manager.cc:1480] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260928 20:02:24.573617 26916 tablet_bootstrap.cc:492] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:24.569934 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b18984d23e43f39fb68864b42a4edf" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:24.578860 26594 leader_election.cc:343] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:24.586792 26916 tablet_bootstrap.cc:654] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.606828 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5a8a538adf994e70a530cb4130225ce0" } new_table_name: "default.Table_f83033031d614d5a8a0749c87bec6898" modify_external_catalogs: true
I20260928 20:02:24.607707 26916 tablet_bootstrap.cc:492] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:24.608075 26916 ts_tablet_manager.cc:1449] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.000s
I20260928 20:02:24.610917 26916 raft_consensus.cc:359] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.611521 26916 raft_consensus.cc:385] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.611766 26916 raft_consensus.cc:740] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.611846 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e10c75a291f54d29a3aab953bbb55a97" } new_table_name: "default.Table_5659158ccabb4ffd883f0166791f9fcb" modify_external_catalogs: true
I20260928 20:02:24.612445 26916 consensus_queue.cc:260] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.614645 26228 catalog_manager.cc:5838] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:24.616344 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:24.619570 26916 ts_tablet_manager.cc:1480] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260928 20:02:24.622924 26916 tablet_bootstrap.cc:492] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:24.629150 26916 tablet_bootstrap.cc:654] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.633919 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b18984d23e43f39fb68864b42a4edf" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:24.635473 26450 leader_election.cc:343] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:24.637285 26913 tablet_bootstrap.cc:492] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:24.637794 26913 ts_tablet_manager.cc:1449] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.372s user 0.014s sys 0.000s
I20260928 20:02:24.642335 26924 raft_consensus.cc:493] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:24.641577 26931 raft_consensus.cc:515] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.642901 26924 raft_consensus.cc:515] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.645325 26924 leader_election.cc:290] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:24.646608 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:24.647004 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:24.647418 26804 raft_consensus.cc:2393] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:24.647575 26516 raft_consensus.cc:2468] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:24.648721 26595 leader_election.cc:304] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:24.649904 26924 raft_consensus.cc:2804] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:24.650624 26924 raft_consensus.cc:493] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:24.650910 26924 raft_consensus.cc:3060] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:24.654000 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b18984d23e43f39fb68864b42a4edf" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:24.656024 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:24.657634 26924 raft_consensus.cc:515] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.658746 26659 raft_consensus.cc:2393] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:24.659160 26450 leader_election.cc:304] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:24.660362 26926 raft_consensus.cc:2749] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:24.661628 26739 leader_election.cc:343] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 2d1000b5632141c6a9419179bf16dcad
I20260928 20:02:24.662029 26739 leader_election.cc:304] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:24.662700 26739 raft_consensus.cc:2686] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:24.663362 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:24.663882 26516 raft_consensus.cc:3060] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:24.670651 26516 raft_consensus.cc:2468] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:24.671729 26595 leader_election.cc:304] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:24.672137 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:24.672749 26955 raft_consensus.cc:2804] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:24.673034 26515 raft_consensus.cc:2393] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:24.675333 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:24.676005 26804 raft_consensus.cc:2393] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:24.677814 26955 raft_consensus.cc:697] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:24.678447 26924 leader_election.cc:290] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:24.678820 26955 consensus_queue.cc:237] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.679296 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ef49ea9d544363a3045fc6fb00a003" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:24.696060 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet e4ef49ea9d544363a3045fc6fb00a003
I20260928 20:02:24.699553 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ef49ea9d544363a3045fc6fb00a003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.700253 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ef49ea9d544363a3045fc6fb00a003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:24.702394 26927 tablet_replica.cc:333] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:24.702369 26739 leader_election.cc:304] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:24.702696 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ef49ea9d544363a3045fc6fb00a003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:24.703109 26927 raft_consensus.cc:2243] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:24.703626 26922 tablet_replica.cc:333] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:24.704015 26927 pending_rounds.cc:70] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:24.704293 26927 pending_rounds.cc:77] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403050212278272 op_type: NO_OP noop_request { }
I20260928 20:02:24.704726 26927 raft_consensus.cc:2889] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:24.704875 26922 raft_consensus.cc:2243] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:24.705085 26927 raft_consensus.cc:2272] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.705339 26922 raft_consensus.cc:2272] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.705307 26961 raft_consensus.cc:2749] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:02:24.707600 26922 ts_tablet_manager.cc:1962] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.719301 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_abfade30587a49dcab87b8e5dc46e421" } modify_external_catalogs: true
I20260928 20:02:24.719872 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_abfade30587a49dcab87b8e5dc46e421" } modify_external_catalogs: true
I20260928 20:02:24.723891 26927 ts_tablet_manager.cc:1962] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.743790 26931 leader_election.cc:290] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:24.746995 26923 ts_tablet_manager.cc:1975] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.747680 26923 log.cc:1199] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/2d1000b5632141c6a9419179bf16dcad
I20260928 20:02:24.748912 26923 ts_tablet_manager.cc:1996] T 2d1000b5632141c6a9419179bf16dcad P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:24.752805 26922 ts_tablet_manager.cc:1975] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.753286 26922 log.cc:1199] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/e4ef49ea9d544363a3045fc6fb00a003
I20260928 20:02:24.758368 26913 raft_consensus.cc:359] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.759320 26913 raft_consensus.cc:385] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.759738 26913 raft_consensus.cc:740] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.760936 26913 consensus_queue.cc:260] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.769775 26912 tablet_bootstrap.cc:492] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:24.770342 26912 ts_tablet_manager.cc:1449] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.365s user 0.037s sys 0.075s
I20260928 20:02:24.774277 26912 raft_consensus.cc:359] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.775089 26912 raft_consensus.cc:385] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.775393 26912 raft_consensus.cc:740] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.776678 26912 consensus_queue.cc:260] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.778919 26912 ts_tablet_manager.cc:1480] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260928 20:02:24.782262 26922 ts_tablet_manager.cc:1996] T e4ef49ea9d544363a3045fc6fb00a003 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:24.786243 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_b787fdc4cb8045858e69185417f866bf [id=182ad975306c41cfa6c08ce13fab93dc]) successfully deleted
I20260928 20:02:24.761626 26927 ts_tablet_manager.cc:1975] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:24.787515 26927 log.cc:1199] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/e4ef49ea9d544363a3045fc6fb00a003
I20260928 20:02:24.788604 26927 ts_tablet_manager.cc:1996] T e4ef49ea9d544363a3045fc6fb00a003 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:24.792356 26912 tablet_bootstrap.cc:492] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:24.792507 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_b787fdc4cb8045858e69185417f866bf [id=182ad975306c41cfa6c08ce13fab93dc]) successfully deleted
I20260928 20:02:24.797247 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet f744fa4f9f144c4f93579cc48ba758f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:24.799464 26912 tablet_bootstrap.cc:654] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.827505 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 2d1000b5632141c6a9419179bf16dcad (table default.Table_6923039c2fc143bfb9c8f15e8ef7cddb [id=a0195e3cdd334211b881ca7d224262a1]) successfully deleted
W20260928 20:02:24.829996 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 02b3676d95d04b15bd3b1292e8d1a247 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02b3676d95d04b15bd3b1292e8d1a247 already in progress: creating tablet
I20260928 20:02:24.848567 26916 tablet_bootstrap.cc:492] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:24.849153 26916 ts_tablet_manager.cc:1449] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.226s user 0.088s sys 0.105s
I20260928 20:02:24.851902 26913 ts_tablet_manager.cc:1480] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.214s user 0.004s sys 0.004s
I20260928 20:02:24.852562 26916 raft_consensus.cc:359] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.853425 26916 raft_consensus.cc:385] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.853761 26916 raft_consensus.cc:740] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.854775 26916 consensus_queue.cc:260] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:24.857298 26916 ts_tablet_manager.cc:1480] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
I20260928 20:02:24.858597 26923 tablet_replica.cc:333] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:24.864084 26913 tablet_bootstrap.cc:492] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:24.865478 26923 raft_consensus.cc:2243] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:24.870368 26923 raft_consensus.cc:2272] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:24.872834 26923 ts_tablet_manager.cc:1962] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:24.904330 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e3096cc9a70b4fffb636bb16c6751a8f" } modify_external_catalogs: true
I20260928 20:02:24.905066 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e3096cc9a70b4fffb636bb16c6751a8f" } modify_external_catalogs: true
I20260928 20:02:24.914994 26913 tablet_bootstrap.cc:654] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.960465 26912 tablet_bootstrap.cc:492] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:24.960912 26912 ts_tablet_manager.cc:1449] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.169s user 0.046s sys 0.074s
I20260928 20:02:24.963464 26912 raft_consensus.cc:359] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:24.964123 26912 raft_consensus.cc:385] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:24.964395 26912 raft_consensus.cc:740] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:24.965166 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ba1054d754ca498d9a0ea4c560f4eabe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:24.965094 26912 consensus_queue.cc:260] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:24.967298 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba1054d754ca498d9a0ea4c560f4eabe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:24.967482 26912 ts_tablet_manager.cc:1480] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260928 20:02:24.982522 26912 tablet_bootstrap.cc:492] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:24.964247 26923 ts_tablet_manager.cc:1975] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:24.983899 26923 log.cc:1199] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/e4ef49ea9d544363a3045fc6fb00a003
I20260928 20:02:24.984673 26923 ts_tablet_manager.cc:1996] T e4ef49ea9d544363a3045fc6fb00a003 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:24.988478 26923 tablet_replica.cc:333] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:02:24.988358 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 56628us
I20260928 20:02:24.988745 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet e4ef49ea9d544363a3045fc6fb00a003 (table default.Table_b787fdc4cb8045858e69185417f866bf [id=182ad975306c41cfa6c08ce13fab93dc]) successfully deleted
I20260928 20:02:24.990697 26912 tablet_bootstrap.cc:654] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:24.996889 26923 raft_consensus.cc:2243] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:24.997471 26923 raft_consensus.cc:2272] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:25.002573 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3be58e4a14614d5e87ffad4c0864d418 consensus state has no leader
I20260928 20:02:25.007951 26923 ts_tablet_manager.cc:1962] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:25.011907 26926 raft_consensus.cc:493] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.012418 26926 raft_consensus.cc:515] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.014376 26926 leader_election.cc:290] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.016957 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eec17e7fb1949289d428d6dc0721de3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:25.018375 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eec17e7fb1949289d428d6dc0721de3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:25.019166 26659 raft_consensus.cc:2468] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:25.022408 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3ba3f8e87b1a4886a888778dd5986aa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.024524 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ba3f8e87b1a4886a888778dd5986aa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:25.026911 26450 leader_election.cc:343] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:25.027768 26450 leader_election.cc:304] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:25.029058 26926 raft_consensus.cc:2804] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:25.029438 26926 raft_consensus.cc:493] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:25.029757 26926 raft_consensus.cc:3060] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.043493 26926 raft_consensus.cc:515] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.046401 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eec17e7fb1949289d428d6dc0721de3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:25.047791 26450 leader_election.cc:343] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:25.056252 26913 tablet_bootstrap.cc:492] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:25.056362 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eec17e7fb1949289d428d6dc0721de3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:25.056916 26913 ts_tablet_manager.cc:1449] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.193s user 0.006s sys 0.008s
I20260928 20:02:25.056981 26659 raft_consensus.cc:3060] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.060635 26913 raft_consensus.cc:359] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.061571 26913 raft_consensus.cc:385] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.065146 26659 raft_consensus.cc:2468] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:25.066471 26450 leader_election.cc:304] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:25.076062 26968 raft_consensus.cc:2804] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:25.077670 26926 leader_election.cc:290] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.079207 26968 raft_consensus.cc:697] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:25.077854 26923 ts_tablet_manager.cc:1975] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:25.080104 26968 consensus_queue.cc:237] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.080911 26923 log.cc:1199] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/f744fa4f9f144c4f93579cc48ba758f4
I20260928 20:02:25.082804 26923 ts_tablet_manager.cc:1996] T f744fa4f9f144c4f93579cc48ba758f4 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:25.084380 26229 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 6964b93b5bc7420d86d62dfbcaee9a33
I20260928 20:02:25.091949 26912 tablet_bootstrap.cc:492] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.092374 26912 ts_tablet_manager.cc:1449] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.110s user 0.006s sys 0.010s
I20260928 20:02:25.061933 26913 raft_consensus.cc:740] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.093786 26913 consensus_queue.cc:260] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.094986 26912 raft_consensus.cc:359] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:25.097236 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet f744fa4f9f144c4f93579cc48ba758f4 (table default.Table_ba8f5c1c63f948c49e46ab622554c64b [id=9cb4c836dd9443588ae6ae3fee3f0be4]) successfully deleted
I20260928 20:02:25.095620 26912 raft_consensus.cc:385] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.099749 26912 raft_consensus.cc:740] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.101059 26912 consensus_queue.cc:260] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:25.108330 26913 ts_tablet_manager.cc:1480] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.051s user 0.009s sys 0.001s
I20260928 20:02:25.109500 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_9513d351920c4195b6b8f30509cabfe2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.111276 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9513d351920c4195b6b8f30509cabfe2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:25.115082 26912 ts_tablet_manager.cc:1480] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.022s user 0.005s sys 0.002s
I20260928 20:02:25.116329 26912 tablet_bootstrap.cc:492] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.126055 26912 tablet_bootstrap.cc:654] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.126736 26968 raft_consensus.cc:493] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.127586 26968 raft_consensus.cc:515] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.134361 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:25.135879 26450 leader_election.cc:343] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:25.137784 26968 leader_election.cc:290] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.137777 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:25.145943 26659 raft_consensus.cc:2468] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:25.148154 26450 leader_election.cc:304] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:25.149977 26968 raft_consensus.cc:2804] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:25.150619 26968 raft_consensus.cc:493] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:25.151228 26968 raft_consensus.cc:3060] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.162544 26913 tablet_bootstrap.cc:492] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:25.168201 26912 tablet_bootstrap.cc:492] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.168634 26912 ts_tablet_manager.cc:1449] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.005s
I20260928 20:02:25.171640 26912 raft_consensus.cc:359] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.172603 26912 raft_consensus.cc:385] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.172878 26912 raft_consensus.cc:740] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.182358 26912 consensus_queue.cc:260] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.184031 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_5cd150c8577d46cea13b798b7b39c6be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.186676 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cd150c8577d46cea13b798b7b39c6be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:25.197155 26912 ts_tablet_manager.cc:1480] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.028s user 0.002s sys 0.006s
I20260928 20:02:25.215052 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_5a8a538adf994e70a530cb4130225ce0 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 1 got 0
I20260928 20:02:25.217263 26233 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:25.218415 26912 tablet_bootstrap.cc:492] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.221366 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_5a8a538adf994e70a530cb4130225ce0 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 1 got 0
W20260928 20:02:25.224109 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2eec17e7fb1949289d428d6dc0721de3 consensus state has no leader
I20260928 20:02:25.224491 26912 tablet_bootstrap.cc:654] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.226333 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 8a74c26724ae484a972944f96cc566c3 (DEFAULT_TABLE table=default.Table_f1d14889209b44d09285f01ec61a6d3c [id=c4c5b23cfb734682950f782df145fc06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.228029 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a74c26724ae484a972944f96cc566c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.237399 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 8a74c26724ae484a972944f96cc566c3 (DEFAULT_TABLE table=default.Table_f1d14889209b44d09285f01ec61a6d3c [id=c4c5b23cfb734682950f782df145fc06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.238757 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a74c26724ae484a972944f96cc566c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.242542 26931 raft_consensus.cc:493] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.243064 26931 raft_consensus.cc:515] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:25.245292 26931 leader_election.cc:290] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.246338 26912 tablet_bootstrap.cc:492] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.246719 26912 ts_tablet_manager.cc:1449] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.000s
W20260928 20:02:25.247908 26739 leader_election.cc:343] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:25.249037 26912 raft_consensus.cc:359] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.249658 26912 raft_consensus.cc:385] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:02:25.253816 26740 leader_election.cc:343] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:25.255406 26740 leader_election.cc:304] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:25.255767 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 (DEFAULT_TABLE table=default.Table_c63f34886f194863b4ef99dc2d8e18f8 [id=dfa0ff0ece9f40fa9639f928a48bfcad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.256522 26931 raft_consensus.cc:2749] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:25.257365 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f70d607ddd441ea78d4c729ad529e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.249904 26912 raft_consensus.cc:740] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.263679 26912 consensus_queue.cc:260] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.265090 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 8a74c26724ae484a972944f96cc566c3 (DEFAULT_TABLE table=default.Table_f1d14889209b44d09285f01ec61a6d3c [id=c4c5b23cfb734682950f782df145fc06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.266287 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a74c26724ae484a972944f96cc566c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.268623 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 (DEFAULT_TABLE table=default.Table_c63f34886f194863b4ef99dc2d8e18f8 [id=dfa0ff0ece9f40fa9639f928a48bfcad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.269625 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f70d607ddd441ea78d4c729ad529e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.271852 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 30e47366cc02478290e02df5cb984691 (DEFAULT_TABLE table=default.Table_d5ac97f88b1b45d0b963c86490ab99d3 [id=c486fcc978ac4403a4fde5327a8e3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.272956 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e47366cc02478290e02df5cb984691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.273298 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 (DEFAULT_TABLE table=default.Table_c63f34886f194863b4ef99dc2d8e18f8 [id=dfa0ff0ece9f40fa9639f928a48bfcad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.273793 26912 ts_tablet_manager.cc:1480] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260928 20:02:25.274435 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f70d607ddd441ea78d4c729ad529e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.286686 26912 tablet_bootstrap.cc:492] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.294920 26916 tablet_bootstrap.cc:492] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:25.296820 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 30e47366cc02478290e02df5cb984691 (DEFAULT_TABLE table=default.Table_d5ac97f88b1b45d0b963c86490ab99d3 [id=c486fcc978ac4403a4fde5327a8e3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.297902 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e47366cc02478290e02df5cb984691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.298575 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d5ac97f88b1b45d0b963c86490ab99d3" } new_table_name: "default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa" modify_external_catalogs: true
I20260928 20:02:25.301244 26916 tablet_bootstrap.cc:654] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.304798 26233 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_61f6326a3df6454fbaf5d908063a48bf [id=459c7e835c364f1cb8b3a572190234d7]). Expected version 1 got 0
I20260928 20:02:25.311825 26916 tablet_bootstrap.cc:492] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:25.311092 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5659158ccabb4ffd883f0166791f9fcb" } modify_external_catalogs: true
I20260928 20:02:25.312212 26916 ts_tablet_manager.cc:1449] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20260928 20:02:25.312230 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5659158ccabb4ffd883f0166791f9fcb" } modify_external_catalogs: true
I20260928 20:02:25.315042 26916 raft_consensus.cc:359] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.315689 26916 raft_consensus.cc:385] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.315951 26916 raft_consensus.cc:740] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.316568 26916 consensus_queue.cc:260] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.318629 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_ba68d3b03ca844658c1a1de74314f453 [id=75885afaa1e345bbbd03e28c895c79d5]). Expected version 1 got 0
I20260928 20:02:25.319556 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:25.324447 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b3676d95d04b15bd3b1292e8d1a247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:23 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:25.325248 26923 tablet_replica.cc:333] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:25.326061 26923 raft_consensus.cc:2243] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:25.326588 26923 raft_consensus.cc:2272] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:25.328931 26912 tablet_bootstrap.cc:654] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.329715 26923 ts_tablet_manager.cc:1962] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:25.337352 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 30e47366cc02478290e02df5cb984691 (DEFAULT_TABLE table=default.Table_d5ac97f88b1b45d0b963c86490ab99d3 [id=c486fcc978ac4403a4fde5327a8e3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:25.338550 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e47366cc02478290e02df5cb984691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:25.342676 26969 raft_consensus.cc:493] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.343106 26969 raft_consensus.cc:515] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.344594 26916 ts_tablet_manager.cc:1480] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.032s user 0.001s sys 0.005s
I20260928 20:02:25.345533 26969 leader_election.cc:290] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.346904 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be58e4a14614d5e87ffad4c0864d418" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:25.347930 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_61f6326a3df6454fbaf5d908063a48bf [id=459c7e835c364f1cb8b3a572190234d7]). Expected version 1 got 0
I20260928 20:02:25.350965 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be58e4a14614d5e87ffad4c0864d418" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:25.353049 26450 leader_election.cc:343] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:25.353924 26450 leader_election.cc:343] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:25.354486 26450 leader_election.cc:304] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:25.355542 26969 raft_consensus.cc:2749] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:25.362213 26916 tablet_bootstrap.cc:492] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:25.366885 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_34bca48461484fc4a8c9fa9f70fa799f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.369473 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34bca48461484fc4a8c9fa9f70fa799f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:25.382619 26916 tablet_bootstrap.cc:654] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.391551 26912 tablet_bootstrap.cc:492] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.391986 26912 ts_tablet_manager.cc:1449] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.106s user 0.005s sys 0.009s
I20260928 20:02:25.406992 26912 raft_consensus.cc:359] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.407655 26912 raft_consensus.cc:385] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.407900 26912 raft_consensus.cc:740] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.411770 26916 tablet_bootstrap.cc:492] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:25.412161 26916 ts_tablet_manager.cc:1449] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.000s
I20260928 20:02:25.414510 26912 consensus_queue.cc:260] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.415104 26923 ts_tablet_manager.cc:1975] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:25.422147 26923 log.cc:1199] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/02b3676d95d04b15bd3b1292e8d1a247
I20260928 20:02:25.422924 26923 ts_tablet_manager.cc:1996] T 02b3676d95d04b15bd3b1292e8d1a247 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:25.429991 26912 ts_tablet_manager.cc:1480] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.038s user 0.005s sys 0.001s
I20260928 20:02:25.430693 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 02b3676d95d04b15bd3b1292e8d1a247 (table default.Table_c187bbd5ed2041d4b2fca02e78383df5 [id=dff446c9839d4195853336e5da0fb453]) successfully deleted
I20260928 20:02:25.437938 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba68d3b03ca844658c1a1de74314f453" } new_table_name: "default.Table_5c2de312e14245d48623ff64b5e0baa8" modify_external_catalogs: true
I20260928 20:02:25.441188 26912 tablet_bootstrap.cc:492] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.430769 26916 raft_consensus.cc:359] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.442621 26916 raft_consensus.cc:385] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.442898 26916 raft_consensus.cc:740] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.443504 26916 consensus_queue.cc:260] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.445286 26916 ts_tablet_manager.cc:1480] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.033s user 0.004s sys 0.000s
I20260928 20:02:25.447743 26969 raft_consensus.cc:493] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.448205 26969 raft_consensus.cc:515] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:25.454672 26450 leader_election.cc:343] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 30e47366cc02478290e02df5cb984691
W20260928 20:02:25.455313 26450 leader_election.cc:343] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 30e47366cc02478290e02df5cb984691
I20260928 20:02:25.455668 26450 leader_election.cc:304] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:25.456494 26926 raft_consensus.cc:2749] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:25.462689 26968 raft_consensus.cc:515] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.465945 26804 raft_consensus.cc:3060] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.472218 26931 raft_consensus.cc:493] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.472890 26931 raft_consensus.cc:515] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.474846 26968 leader_election.cc:290] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.475057 26931 leader_election.cc:290] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.477451 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:25.478538 26515 raft_consensus.cc:2393] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:25.482354 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:25.483096 26659 raft_consensus.cc:2468] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:25.484905 26739 leader_election.cc:304] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:25.486304 26931 raft_consensus.cc:2804] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:25.486755 26931 raft_consensus.cc:493] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:25.487133 26931 raft_consensus.cc:3060] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.450014 26969 leader_election.cc:290] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.493361 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:25.493822 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:25.494390 26659 raft_consensus.cc:3060] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.495347 26515 raft_consensus.cc:1275] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:02:25.502511 26969 raft_consensus.cc:493] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.503044 26969 raft_consensus.cc:515] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.505225 26969 leader_election.cc:290] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.507269 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7158add996a4281941e77ab8f9f8ad2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:25.507941 26802 raft_consensus.cc:2468] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:25.509018 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7158add996a4281941e77ab8f9f8ad2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:25.512395 26955 consensus_queue.cc:1048] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:25.512693 26450 leader_election.cc:343] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:25.513406 26450 leader_election.cc:304] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:25.514495 26969 raft_consensus.cc:2804] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:25.514835 26969 raft_consensus.cc:493] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:25.515172 26969 raft_consensus.cc:3060] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:25.518658 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_61f6326a3df6454fbaf5d908063a48bf [id=459c7e835c364f1cb8b3a572190234d7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet aec06a31e9034182a3e23dce21ac8b3e consensus state has no leader
I20260928 20:02:25.501837 26659 raft_consensus.cc:2468] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:25.532162 26450 leader_election.cc:304] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:25.533069 26968 raft_consensus.cc:2804] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:25.533739 26968 raft_consensus.cc:697] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:25.534543 26968 consensus_queue.cc:237] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.548487 26969 raft_consensus.cc:515] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.552022 26913 tablet_bootstrap.cc:654] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.564723 26969 leader_election.cc:290] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.587348 26912 tablet_bootstrap.cc:654] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.592360 26913 tablet_bootstrap.cc:492] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:25.592747 26913 ts_tablet_manager.cc:1449] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.430s user 0.014s sys 0.000s
I20260928 20:02:25.595026 26913 raft_consensus.cc:359] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.595666 26913 raft_consensus.cc:385] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.595904 26913 raft_consensus.cc:740] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.603991 26804 raft_consensus.cc:1275] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:02:25.605914 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_560504da8c694a95a0b601d4f3998d96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.608101 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_560504da8c694a95a0b601d4f3998d96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:25.609258 26978 consensus_queue.cc:1048] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:25.596575 26913 consensus_queue.cc:260] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.606876 26931 raft_consensus.cc:515] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.614691 26803 raft_consensus.cc:2393] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:25.621526 26913 ts_tablet_manager.cc:1480] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260928 20:02:25.623117 26913 tablet_bootstrap.cc:492] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:25.623996 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:25.624881 26659 raft_consensus.cc:2393] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:25.625231 26931 leader_election.cc:290] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:25.635288 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 47887.8us
I20260928 20:02:25.645704 26912 tablet_bootstrap.cc:492] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.646257 26912 ts_tablet_manager.cc:1449] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.205s user 0.014s sys 0.003s
I20260928 20:02:25.646540 26913 tablet_bootstrap.cc:654] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.662213 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7158add996a4281941e77ab8f9f8ad2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:25.662801 26803 raft_consensus.cc:3060] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.663826 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7158add996a4281941e77ab8f9f8ad2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:25.664363 26659 raft_consensus.cc:3060] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:25.668161 26913 tablet_bootstrap.cc:492] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:25.668540 26913 ts_tablet_manager.cc:1449] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.006s
I20260928 20:02:25.670821 26913 raft_consensus.cc:359] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.671444 26913 raft_consensus.cc:385] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.671684 26913 raft_consensus.cc:740] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.671808 26659 raft_consensus.cc:2468] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:25.672561 26913 consensus_queue.cc:260] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.673656 26450 leader_election.cc:304] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:25.674508 26913 ts_tablet_manager.cc:1480] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260928 20:02:25.676781 26969 raft_consensus.cc:2804] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:25.676889 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec06a31e9034182a3e23dce21ac8b3e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:25.677606 26969 raft_consensus.cc:697] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:25.677732 26912 raft_consensus.cc:359] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.678436 26912 raft_consensus.cc:385] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.678727 26969 consensus_queue.cc:237] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.678711 26912 raft_consensus.cc:740] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.682857 26912 consensus_queue.cc:260] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.688060 26913 tablet_bootstrap.cc:492] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:25.701002 26740 leader_election.cc:304] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:25.704720 26803 raft_consensus.cc:2468] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:25.706395 26912 ts_tablet_manager.cc:1480] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.060s user 0.006s sys 0.000s
I20260928 20:02:25.707253 26912 tablet_bootstrap.cc:492] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.707813 26972 mvcc.cc:204] Tried to move back new op lower bound from 7334403053210923008 to 7334403049744429056. Current Snapshot: MvccSnapshot[applied={T|T < 7334403053210923008}]
I20260928 20:02:25.708811 26988 raft_consensus.cc:2749] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:02:25.713179 26913 tablet_bootstrap.cc:654] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.721261 26912 tablet_bootstrap.cc:654] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.733935 26916 tablet_bootstrap.cc:492] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:25.740695 26916 tablet_bootstrap.cc:654] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.743682 26991 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:25.747768 26992 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:25.763510 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30e47366cc02478290e02df5cb984691 consensus state has no leader
I20260928 20:02:25.782943 26994 mvcc.cc:204] Tried to move back new op lower bound from 7334403053210923008 to 7334403049744429056. Current Snapshot: MvccSnapshot[applied={T|T < 7334403053210923008}]
I20260928 20:02:25.788395 26916 tablet_bootstrap.cc:492] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:25.788821 26916 ts_tablet_manager.cc:1449] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.055s user 0.011s sys 0.000s
I20260928 20:02:25.791188 26916 raft_consensus.cc:359] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.791797 26916 raft_consensus.cc:385] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.792078 26916 raft_consensus.cc:740] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.794178 26913 tablet_bootstrap.cc:492] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:25.794618 26913 ts_tablet_manager.cc:1449] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.107s user 0.014s sys 0.012s
I20260928 20:02:25.799778 26913 raft_consensus.cc:359] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.800441 26913 raft_consensus.cc:385] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.800689 26913 raft_consensus.cc:740] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.810330 26916 consensus_queue.cc:260] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.812930 26916 ts_tablet_manager.cc:1480] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260928 20:02:25.813547 26913 consensus_queue.cc:260] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.815828 26913 ts_tablet_manager.cc:1480] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260928 20:02:25.816581 26913 tablet_bootstrap.cc:492] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:25.845031 26913 tablet_bootstrap.cc:654] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.860311 26999 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:25.863288 26912 tablet_bootstrap.cc:492] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.863925 26912 ts_tablet_manager.cc:1449] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.157s user 0.066s sys 0.059s
I20260928 20:02:25.866521 26912 raft_consensus.cc:359] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.868875 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7efdb347f47442929bd480ef8c1b3f47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.870586 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7efdb347f47442929bd480ef8c1b3f47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:25.873282 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d467734bfa0b4fc1bc617954ce95836e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:25.875097 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d467734bfa0b4fc1bc617954ce95836e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:25.878240 26912 raft_consensus.cc:385] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.878568 26912 raft_consensus.cc:740] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.880889 26912 consensus_queue.cc:260] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.881832 26913 tablet_bootstrap.cc:492] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:25.882290 26913 ts_tablet_manager.cc:1449] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.006s
I20260928 20:02:25.885102 26913 raft_consensus.cc:359] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.886001 26913 raft_consensus.cc:385] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.886338 26913 raft_consensus.cc:740] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.887118 26913 consensus_queue.cc:260] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.893230 26913 ts_tablet_manager.cc:1480] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260928 20:02:25.897110 26913 tablet_bootstrap.cc:492] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:25.898253 26912 ts_tablet_manager.cc:1480] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260928 20:02:25.903048 26913 tablet_bootstrap.cc:654] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.911164 26912 tablet_bootstrap.cc:492] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.924340 26912 tablet_bootstrap.cc:654] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:25.924846 26999 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:25.926378 26992 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:25.931798 26913 tablet_bootstrap.cc:492] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:25.932256 26913 ts_tablet_manager.cc:1449] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.004s
I20260928 20:02:25.932113 26991 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:25.934891 26913 raft_consensus.cc:359] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.935501 26913 raft_consensus.cc:385] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.935773 26913 raft_consensus.cc:740] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.936370 26913 consensus_queue.cc:260] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.945971 26913 ts_tablet_manager.cc:1480] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.013s user 0.003s sys 0.001s
I20260928 20:02:25.964395 26969 consensus_queue.cc:1048] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:25.973245 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba1054d754ca498d9a0ea4c560f4eabe" } new_table_name: "default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2" modify_external_catalogs: true
I20260928 20:02:25.977946 26912 tablet_bootstrap.cc:492] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:25.978374 26912 ts_tablet_manager.cc:1449] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.067s user 0.015s sys 0.018s
I20260928 20:02:25.980588 26912 raft_consensus.cc:359] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.981330 26912 raft_consensus.cc:385] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:25.981578 26912 raft_consensus.cc:740] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:25.982352 26912 consensus_queue.cc:260] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.986514 26912 ts_tablet_manager.cc:1480] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260928 20:02:25.994971 26969 raft_consensus.cc:493] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:25.995455 26969 raft_consensus.cc:515] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:25.996065 26912 tablet_bootstrap.cc:492] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:25.997526 26969 leader_election.cc:290] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:25.999064 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f70d607ddd441ea78d4c729ad529e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:25.999653 26804 raft_consensus.cc:2468] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:26.000034 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f70d607ddd441ea78d4c729ad529e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:26.000624 26658 raft_consensus.cc:2468] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:26.001194 26450 leader_election.cc:304] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:26.002692 26969 raft_consensus.cc:2804] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:26.003036 26969 raft_consensus.cc:493] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:26.003392 26969 raft_consensus.cc:3060] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.005515 26988 raft_consensus.cc:493] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.005961 26988 raft_consensus.cc:515] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.007990 26988 leader_election.cc:290] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:26.008878 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eec17e7fb1949289d428d6dc0721de3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:26.009968 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eec17e7fb1949289d428d6dc0721de3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:26.014459 26739 leader_election.cc:304] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:26.017704 26912 tablet_bootstrap.cc:654] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:26.017926 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260928 20:02:26.020924 26988 raft_consensus.cc:2749] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:26.020784 26969 raft_consensus.cc:515] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.023885 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f70d607ddd441ea78d4c729ad529e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:26.024938 26804 raft_consensus.cc:3060] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.031950 26804 raft_consensus.cc:2468] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:26.035810 26450 leader_election.cc:304] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:26.036753 26968 raft_consensus.cc:2804] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:26.044346 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f70d607ddd441ea78d4c729ad529e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:26.044900 26658 raft_consensus.cc:3060] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.052101 26658 raft_consensus.cc:2468] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:26.054260 26969 leader_election.cc:290] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:26.057076 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 665b24041d5e4348a28df63af1735312 (DEFAULT_TABLE table=default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 [id=3124342cb4fb46c4bdfd465c3e582053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.058269 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665b24041d5e4348a28df63af1735312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.057971 26231 catalog_manager.cc:5838] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:26.060159 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:26.061131 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_61f6326a3df6454fbaf5d908063a48bf [id=459c7e835c364f1cb8b3a572190234d7]). Expected version 1 got 0
I20260928 20:02:26.061896 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet e7158add996a4281941e77ab8f9f8ad2
I20260928 20:02:26.063457 26230 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 39) took 1347 ms. Trace:
I20260928 20:02:26.063896 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 665b24041d5e4348a28df63af1735312 (DEFAULT_TABLE table=default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 [id=3124342cb4fb46c4bdfd465c3e582053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.064749 26912 tablet_bootstrap.cc:492] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:26.065126 26912 ts_tablet_manager.cc:1449] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.000s
I20260928 20:02:26.065376 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665b24041d5e4348a28df63af1735312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.071897 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 665b24041d5e4348a28df63af1735312 (DEFAULT_TABLE table=default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 [id=3124342cb4fb46c4bdfd465c3e582053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.073019 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665b24041d5e4348a28df63af1735312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.074069 26804 raft_consensus.cc:3060] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.076064 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet e7158add996a4281941e77ab8f9f8ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:26.077808 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet e7158add996a4281941e77ab8f9f8ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:26.080027 26494 tablet_service.cc:1511] Processing CreateTablet for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (DEFAULT_TABLE table=default.Table_ba1054d754ca498d9a0ea4c560f4eabe [id=474b74c08e6348da8e5de4405064735f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.081534 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87b70e9dcf04ba7915e1f5124aa36e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.082136 26782 tablet_service.cc:1511] Processing CreateTablet for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (DEFAULT_TABLE table=default.Table_ba1054d754ca498d9a0ea4c560f4eabe [id=474b74c08e6348da8e5de4405064735f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.082405 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 (DEFAULT_TABLE table=default.Table_3ba3f8e87b1a4886a888778dd5986aa7 [id=b710280fc0e54970a0283a2eaa9f2efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.083036 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 (DEFAULT_TABLE table=default.Table_3ba3f8e87b1a4886a888778dd5986aa7 [id=b710280fc0e54970a0283a2eaa9f2efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.083205 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet e7158add996a4281941e77ab8f9f8ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:26.084266 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4bfa1d40a346ba9d4c60728c243647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.083758 26639 tablet_service.cc:1511] Processing CreateTablet for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (DEFAULT_TABLE table=default.Table_ba1054d754ca498d9a0ea4c560f4eabe [id=474b74c08e6348da8e5de4405064735f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.085487 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87b70e9dcf04ba7915e1f5124aa36e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.086215 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 7e27a1855f8e4425ad51fba9025c5174 (DEFAULT_TABLE table=default.Table_8d28094f407f435190e32f3d52716436 [id=b5bed5274cdf4c1f886428eb339e5f57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.086833 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 (DEFAULT_TABLE table=default.Table_3ba3f8e87b1a4886a888778dd5986aa7 [id=b710280fc0e54970a0283a2eaa9f2efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.087733 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e27a1855f8e4425ad51fba9025c5174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.090214 26998 raft_consensus.cc:493] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.090695 26998 raft_consensus.cc:515] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.091806 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4bfa1d40a346ba9d4c60728c243647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.092782 26998 leader_election.cc:290] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:26.094470 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be58e4a14614d5e87ffad4c0864d418" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:26.095057 26803 raft_consensus.cc:2468] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:26.096571 26594 leader_election.cc:304] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:26.098424 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 3be58e4a14614d5e87ffad4c0864d418
I20260928 20:02:26.063827 26230 rpcz_store.cc:276] 0928 20:02:24.716531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:24.716673 (+ 142us) service_pool.cc:224] Handling call
0928 20:02:24.719199 (+ 2526us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:24.720300 (+ 1101us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:24.720784 (+ 484us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:24.720912 (+ 128us) catalog_manager.cc:2863] Locking tablets
0928 20:02:25.212615 (+491703us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:25.758586 (+545971us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:25.758816 (+ 230us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:26.061795 (+302979us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:26.063394 (+ 1599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:25.639172 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:25.639594 (+ 422us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:25.639624 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:02:25.639641 (+ 17us) tablet.cc:662] Decoding operations
0928 20:02:25.639992 (+ 351us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:25.640031 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:25.640054 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:25.640297 (+ 243us) tablet.cc:701] Row locks acquired
0928 20:02:25.640309 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:25.640415 (+ 106us) write_op.cc:270] Start()
0928 20:02:25.640495 (+ 80us) write_op.cc:276] Timestamp: P: 1790625745640356 usec, L: 0
0928 20:02:25.640510 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:25.647440 (+ 6930us) log.cc:844] Serialized 733 byte log entry
0928 20:02:25.649736 (+ 2296us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:25.755256 (+105520us) op_driver.cc:464] REPLICATION: finished
0928 20:02:25.757297 (+ 2041us) write_op.cc:301] APPLY: starting
0928 20:02:25.757358 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:25.757466 (+ 108us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:25.757483 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:25.757706 (+ 223us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:25.757853 (+ 147us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:25.757895 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:25.758075 (+ 180us) log.cc:844] Serialized 28 byte log entry
0928 20:02:25.758281 (+ 206us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:25.758368 (+ 87us) write_op.cc:454] Released schema lock
0928 20:02:25.758398 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:25.758625 (+ 227us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:25.758647 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":3816832,"child_traces":[["op",{"apply.queue_time_us":1773,"apply.run_cpu_time_us":1316,"apply.run_wall_time_us":1316,"num_ops":2,"prepare.queue_time_us":424781,"prepare.run_cpu_time_us":2937,"prepare.run_wall_time_us":18596,"raft.queue_time_us":136,"raft.run_cpu_time_us":754,"raft.run_wall_time_us":1687,"replication_time_us":114645,"spinlock_wait_cycles":14655744}]]}
I20260928 20:02:26.102928 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be58e4a14614d5e87ffad4c0864d418 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:25 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:26.106289 26998 raft_consensus.cc:2804] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:26.106675 26998 raft_consensus.cc:493] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:26.106979 26998 raft_consensus.cc:3060] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.112138 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be58e4a14614d5e87ffad4c0864d418 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:25 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:26.113312 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be58e4a14614d5e87ffad4c0864d418 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:25 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:26.122268 26968 raft_consensus.cc:697] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:26.123939 26968 consensus_queue.cc:237] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.131307 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 7e27a1855f8e4425ad51fba9025c5174 (DEFAULT_TABLE table=default.Table_8d28094f407f435190e32f3d52716436 [id=b5bed5274cdf4c1f886428eb339e5f57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.139169 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 7e27a1855f8e4425ad51fba9025c5174 (DEFAULT_TABLE table=default.Table_8d28094f407f435190e32f3d52716436 [id=b5bed5274cdf4c1f886428eb339e5f57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.140509 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e27a1855f8e4425ad51fba9025c5174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.153359 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f (DEFAULT_TABLE table=default.Table_d38019b8225f48d7ae6cded1a37dd923 [id=ccf8d181f86a4deeac64646304c637e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.126487 26998 raft_consensus.cc:515] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.159101 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f (DEFAULT_TABLE table=default.Table_d38019b8225f48d7ae6cded1a37dd923 [id=ccf8d181f86a4deeac64646304c637e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.160395 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8bbd88762641c7ad49db92fc116b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.161572 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f (DEFAULT_TABLE table=default.Table_d38019b8225f48d7ae6cded1a37dd923 [id=ccf8d181f86a4deeac64646304c637e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:26.162714 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8bbd88762641c7ad49db92fc116b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.173808 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_61f6326a3df6454fbaf5d908063a48bf" } new_table_name: "default.Table_1338bfc0097241ffbaf0ac5e3efe1f42" modify_external_catalogs: true
I20260928 20:02:26.176165 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87b70e9dcf04ba7915e1f5124aa36e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.178895 27009 tablet_replica.cc:333] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:26.179116 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4bfa1d40a346ba9d4c60728c243647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.180330 27009 raft_consensus.cc:2243] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:26.181187 27009 pending_rounds.cc:70] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Trying to abort 1 pending ops.
I20260928 20:02:26.181473 27009 pending_rounds.cc:77] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403054310105088 op_type: NO_OP noop_request { }
W20260928 20:02:26.181785 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 110878us
I20260928 20:02:26.183646 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e27a1855f8e4425ad51fba9025c5174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.175745 26912 raft_consensus.cc:359] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.185427 26912 raft_consensus.cc:385] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.185707 26912 raft_consensus.cc:740] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.186462 26912 consensus_queue.cc:260] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.184962 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be58e4a14614d5e87ffad4c0864d418" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:26.191051 26516 raft_consensus.cc:2468] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:26.184779 27007 consensus_queue.cc:1048] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260928 20:02:26.181878 27009 raft_consensus.cc:2889] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:26.200016 26912 ts_tablet_manager.cc:1480] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.135s user 0.007s sys 0.000s
I20260928 20:02:26.199680 27009 raft_consensus.cc:2272] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:26.215086 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f87b70e9dcf04ba7915e1f5124aa36e2 consensus state has no leader
I20260928 20:02:26.217121 27009 ts_tablet_manager.cc:1962] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.220794 26916 tablet_bootstrap.cc:492] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:26.223668 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aec06a31e9034182a3e23dce21ac8b3e consensus state has no leader
I20260928 20:02:26.226822 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8bbd88762641c7ad49db92fc116b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:26.236200 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:26.237293 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]). Expected version 1 got 0
I20260928 20:02:26.245592 27010 tablet_replica.cc:333] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:26.246447 27010 raft_consensus.cc:2243] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:26.246891 27010 raft_consensus.cc:2272] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.248719 27010 ts_tablet_manager.cc:1962] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.249511 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_574c02870e14491dbd36bb31f00b3cc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.251197 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_574c02870e14491dbd36bb31f00b3cc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.259262 26230 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_5c2de312e14245d48623ff64b5e0baa8 [id=75885afaa1e345bbbd03e28c895c79d5] alter complete (version 2)
I20260928 20:02:26.259681 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_bffcee37a58246d080c1be814e418f5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.263302 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bffcee37a58246d080c1be814e418f5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.264418 27011 tablet_replica.cc:333] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:26.265232 27011 raft_consensus.cc:2243] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:26.266166 27011 raft_consensus.cc:2272] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.284904 26912 tablet_bootstrap.cc:492] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:26.287348 27011 ts_tablet_manager.cc:1962] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.301520 26913 tablet_bootstrap.cc:492] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:26.305887 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:26.306533 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]). Expected version 1 got 0
I20260928 20:02:26.312091 26916 tablet_bootstrap.cc:654] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.312692 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_47107cc2ebe04af38af59a3a81e8dc62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.314502 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47107cc2ebe04af38af59a3a81e8dc62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.320094 26913 tablet_bootstrap.cc:654] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.330695 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d38019b8225f48d7ae6cded1a37dd923" } modify_external_catalogs: true
I20260928 20:02:26.331229 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d38019b8225f48d7ae6cded1a37dd923" } modify_external_catalogs: true
I20260928 20:02:26.332348 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6a805bebbc0a4dd3a67a10a375687f54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:26.330526 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c63f34886f194863b4ef99dc2d8e18f8" } modify_external_catalogs: true
I20260928 20:02:26.335143 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c63f34886f194863b4ef99dc2d8e18f8" } modify_external_catalogs: true
W20260928 20:02:26.336863 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a805bebbc0a4dd3a67a10a375687f54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.340041 27011 ts_tablet_manager.cc:1975] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:26.341126 27011 log.cc:1199] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/e7158add996a4281941e77ab8f9f8ad2
I20260928 20:02:26.341912 27011 ts_tablet_manager.cc:1996] T e7158add996a4281941e77ab8f9f8ad2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:26.345109 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet e7158add996a4281941e77ab8f9f8ad2 (table default.Table_abfade30587a49dcab87b8e5dc46e421 [id=5b5d8145e3d84cf48c9a97d748c5c3d9]) successfully deleted
I20260928 20:02:26.352087 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:26.353961 26916 tablet_bootstrap.cc:492] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:26.354377 26916 ts_tablet_manager.cc:1449] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.134s user 0.011s sys 0.002s
I20260928 20:02:26.355281 27009 ts_tablet_manager.cc:1975] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:26.356118 27009 log.cc:1199] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/e7158add996a4281941e77ab8f9f8ad2
I20260928 20:02:26.356673 26916 raft_consensus.cc:359] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.357066 27009 ts_tablet_manager.cc:1996] T e7158add996a4281941e77ab8f9f8ad2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:26.357704 26998 leader_election.cc:290] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:26.358479 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be58e4a14614d5e87ffad4c0864d418" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:26.359020 26804 raft_consensus.cc:3060] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.359035 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be58e4a14614d5e87ffad4c0864d418" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:26.359503 26516 raft_consensus.cc:3060] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.363130 26916 raft_consensus.cc:385] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.363409 26916 raft_consensus.cc:740] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.364159 26912 tablet_bootstrap.cc:654] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.364113 26916 consensus_queue.cc:260] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.375939 26916 ts_tablet_manager.cc:1480] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.021s user 0.004s sys 0.001s
I20260928 20:02:26.392215 26913 tablet_bootstrap.cc:492] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:26.392673 26913 ts_tablet_manager.cc:1449] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.091s user 0.007s sys 0.003s
I20260928 20:02:26.397195 26912 tablet_bootstrap.cc:492] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:26.397814 26912 ts_tablet_manager.cc:1449] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.113s user 0.012s sys 0.000s
I20260928 20:02:26.398645 26916 tablet_bootstrap.cc:492] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:26.399189 26913 raft_consensus.cc:359] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.399797 26913 raft_consensus.cc:385] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.400025 26913 raft_consensus.cc:740] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.400713 26913 consensus_queue.cc:260] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.407913 26992 tablet.cc:1751] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:26.414052 26916 tablet_bootstrap.cc:654] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.417184 26991 tablet.cc:1751] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:26.433435 26916 tablet_bootstrap.cc:492] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:26.438985 26516 raft_consensus.cc:2468] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:26.440133 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet e7158add996a4281941e77ab8f9f8ad2 (table default.Table_abfade30587a49dcab87b8e5dc46e421 [id=5b5d8145e3d84cf48c9a97d748c5c3d9]) successfully deleted
I20260928 20:02:26.440510 27009 tablet_replica.cc:333] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:26.440310 26595 leader_election.cc:304] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.441155 26998 raft_consensus.cc:2804] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:26.441347 27009 raft_consensus.cc:2243] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:26.441601 26916 ts_tablet_manager.cc:1449] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.000s
I20260928 20:02:26.441859 27009 raft_consensus.cc:2272] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.444074 26916 raft_consensus.cc:359] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.444701 26916 raft_consensus.cc:385] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.444945 26916 raft_consensus.cc:740] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.450150 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 6d8bbd88762641c7ad49db92fc116b4f
I20260928 20:02:26.450135 26916 consensus_queue.cc:260] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.451985 26916 ts_tablet_manager.cc:1480] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260928 20:02:26.452805 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]). Expected version 1 got 0
I20260928 20:02:26.452996 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:26.457870 26912 raft_consensus.cc:359] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.458165 26999 tablet.cc:1751] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:26.458559 26912 raft_consensus.cc:385] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.458833 26912 raft_consensus.cc:740] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.459441 26912 consensus_queue.cc:260] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.461331 26912 ts_tablet_manager.cc:1480] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.063s user 0.001s sys 0.001s
I20260928 20:02:26.466043 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5cd150c8577d46cea13b798b7b39c6be" } new_table_name: "default.Table_b786838c638b4e269c6373465a97855f" modify_external_catalogs: true
I20260928 20:02:26.467968 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:26.470083 26916 tablet_bootstrap.cc:492] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:26.472702 26804 raft_consensus.cc:2468] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:26.478048 27008 raft_consensus.cc:493] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.478427 27011 tablet_replica.cc:333] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:26.478515 27008 raft_consensus.cc:515] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.481014 27008 leader_election.cc:290] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:26.481732 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:26.482784 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87b70e9dcf04ba7915e1f5124aa36e2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:26.483491 26659 raft_consensus.cc:2468] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:26.485198 26450 leader_election.cc:304] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.487330 26998 raft_consensus.cc:697] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:26.487461 27008 raft_consensus.cc:2804] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:26.487789 27008 raft_consensus.cc:493] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:26.488082 27008 raft_consensus.cc:3060] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.488161 26998 consensus_queue.cc:237] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.489511 27007 raft_consensus.cc:493] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.490343 27007 raft_consensus.cc:515] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.492398 27007 leader_election.cc:290] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:26.495124 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a74c26724ae484a972944f96cc566c3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:26.495908 26913 ts_tablet_manager.cc:1480] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.103s user 0.002s sys 0.005s
I20260928 20:02:26.495967 26659 raft_consensus.cc:2468] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:26.444363 27009 ts_tablet_manager.cc:1962] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.497355 26450 leader_election.cc:304] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.498198 27007 raft_consensus.cc:2804] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:26.498528 27007 raft_consensus.cc:493] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:26.498850 27007 raft_consensus.cc:3060] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.501621 26916 tablet_bootstrap.cc:654] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.505448 27008 raft_consensus.cc:515] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.505198 26235 catalog_manager.cc:5838] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:26.506737 27007 raft_consensus.cc:515] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.507503 27008 leader_election.cc:290] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:26.506808 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_1338bfc0097241ffbaf0ac5e3efe1f42 [id=459c7e835c364f1cb8b3a572190234d7]). Expected version 2 got 0
I20260928 20:02:26.508468 27007 leader_election.cc:290] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:26.509253 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:26.510489 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87b70e9dcf04ba7915e1f5124aa36e2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:26.511042 26658 raft_consensus.cc:3060] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.512264 27010 ts_tablet_manager.cc:1975] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:26.512388 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]). Expected version 1 got 0
I20260928 20:02:26.514240 27010 log.cc:1199] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/e7158add996a4281941e77ab8f9f8ad2
I20260928 20:02:26.514909 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 49f70d607ddd441ea78d4c729ad529e5
I20260928 20:02:26.515031 27010 ts_tablet_manager.cc:1996] T e7158add996a4281941e77ab8f9f8ad2 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:26.517403 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a74c26724ae484a972944f96cc566c3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:26.517956 26657 raft_consensus.cc:3060] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.524190 27009 ts_tablet_manager.cc:1975] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:26.524091 26658 raft_consensus.cc:2468] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:26.524673 27009 log.cc:1199] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/3be58e4a14614d5e87ffad4c0864d418
I20260928 20:02:26.525458 27009 ts_tablet_manager.cc:1996] T 3be58e4a14614d5e87ffad4c0864d418 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:26.525305 26657 raft_consensus.cc:2468] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:26.526021 26450 leader_election.cc:304] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.515584 26231 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3ba3f8e87b1a4886a888778dd5986aa7" } new_table_name: "default.Table_5a9d98eec9c847f4bfa6de33dedf04dd" modify_external_catalogs: true
I20260928 20:02:26.526926 26450 leader_election.cc:304] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.527747 27008 raft_consensus.cc:2804] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:26.528045 26913 tablet_bootstrap.cc:492] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:26.528177 27008 raft_consensus.cc:697] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:26.528915 27008 consensus_queue.cc:237] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.516834 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_074fa99958dd4bcdb27668ca50658ff8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.534216 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_074fa99958dd4bcdb27668ca50658ff8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.534636 26916 tablet_bootstrap.cc:492] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:26.535002 26916 ts_tablet_manager.cc:1449] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.006s
I20260928 20:02:26.535725 26913 tablet_bootstrap.cc:654] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.536597 26969 raft_consensus.cc:2804] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:26.537081 26969 raft_consensus.cc:697] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:26.518395 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d65f8d2cec034d47917d20d370000367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:26.537863 26969 consensus_queue.cc:237] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.538270 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 3be58e4a14614d5e87ffad4c0864d418 (table default.Table_5659158ccabb4ffd883f0166791f9fcb [id=9d6bd1be950040e692bc9b982360c642]) successfully deleted
W20260928 20:02:26.538542 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d65f8d2cec034d47917d20d370000367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:26.540584 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 6d8bbd88762641c7ad49db92fc116b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8bbd88762641c7ad49db92fc116b4f already in progress: creating tablet
I20260928 20:02:26.541436 26988 raft_consensus.cc:493] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.541911 26988 raft_consensus.cc:515] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.543869 26988 leader_election.cc:290] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:26.546308 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:26.546607 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:26.547217 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a74c26724ae484a972944f96cc566c3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:26.547617 26916 raft_consensus.cc:359] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.548259 26916 raft_consensus.cc:385] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.548249 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a74c26724ae484a972944f96cc566c3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:26.548508 26916 raft_consensus.cc:740] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.548995 26657 raft_consensus.cc:2393] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:26.549130 26916 consensus_queue.cc:260] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.550050 26739 leader_election.cc:304] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:26.551085 26988 raft_consensus.cc:3060] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.551760 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:26.554905 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f87b70e9dcf04ba7915e1f5124aa36e2 consensus state has no leader
I20260928 20:02:26.558497 26988 raft_consensus.cc:2749] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:26.558259 27007 consensus_queue.cc:1048] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:26.560429 27009 tablet_replica.cc:333] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:26.565541 27009 raft_consensus.cc:2243] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:26.567368 26913 tablet_bootstrap.cc:492] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:26.567787 26913 ts_tablet_manager.cc:1449] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.000s
I20260928 20:02:26.571266 27009 pending_rounds.cc:70] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Trying to abort 1 pending ops.
I20260928 20:02:26.571550 27009 pending_rounds.cc:77] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403056234835968 op_type: NO_OP noop_request { }
I20260928 20:02:26.573057 27009 raft_consensus.cc:2889] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260928 20:02:26.575915 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d27a3bd58866482f80fae7afe0ad48d7 has no consensus state
I20260928 20:02:26.576764 27011 raft_consensus.cc:2243] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:26.578476 27009 raft_consensus.cc:2272] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.561614 26916 ts_tablet_manager.cc:1480] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.026s user 0.005s sys 0.001s
I20260928 20:02:26.578473 26913 raft_consensus.cc:359] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.579540 27011 pending_rounds.cc:70] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:26.579691 26916 tablet_bootstrap.cc:492] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:26.580612 27011 pending_rounds.cc:77] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403057640710144 op_type: NO_OP noop_request { }
I20260928 20:02:26.584880 27009 ts_tablet_manager.cc:1962] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.585495 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87b70e9dcf04ba7915e1f5124aa36e2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:26.585628 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a74c26724ae484a972944f96cc566c3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:26.586689 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a74c26724ae484a972944f96cc566c3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:26.590451 26450 leader_election.cc:343] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:26.585531 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87b70e9dcf04ba7915e1f5124aa36e2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:26.593183 26803 raft_consensus.cc:2468] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:26.594063 26916 tablet_bootstrap.cc:654] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:26.596297 26450 leader_election.cc:343] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:26.579131 26913 raft_consensus.cc:385] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.599474 26913 raft_consensus.cc:740] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.600193 26913 consensus_queue.cc:260] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.602389 26913 ts_tablet_manager.cc:1480] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260928 20:02:26.603231 26913 tablet_bootstrap.cc:492] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:26.606843 27011 raft_consensus.cc:2889] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:26.607836 26912 tablet_bootstrap.cc:492] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:26.609728 27010 tablet_replica.cc:333] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:26.611479 27010 raft_consensus.cc:2243] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:26.611935 27010 raft_consensus.cc:2272] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.613720 27010 ts_tablet_manager.cc:1962] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.615828 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet e7158add996a4281941e77ab8f9f8ad2 (table default.Table_abfade30587a49dcab87b8e5dc46e421 [id=5b5d8145e3d84cf48c9a97d748c5c3d9]) successfully deleted
I20260928 20:02:26.616581 27011 raft_consensus.cc:2272] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.622475 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6f6393f79f38418e8831658c89026a7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.624480 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f6393f79f38418e8831658c89026a7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.641100 27009 ts_tablet_manager.cc:1975] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:26.641497 27009 log.cc:1199] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/49f70d607ddd441ea78d4c729ad529e5
I20260928 20:02:26.642338 27009 ts_tablet_manager.cc:1996] T 49f70d607ddd441ea78d4c729ad529e5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:26.645632 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 49f70d607ddd441ea78d4c729ad529e5 (table default.Table_c63f34886f194863b4ef99dc2d8e18f8 [id=dfa0ff0ece9f40fa9639f928a48bfcad]) successfully deleted
I20260928 20:02:26.676612 27008 consensus_queue.cc:1048] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:26.684522 27011 ts_tablet_manager.cc:1962] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:26.619658 26913 tablet_bootstrap.cc:654] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.696226 26912 tablet_bootstrap.cc:654] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.697885 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1338bfc0097241ffbaf0ac5e3efe1f42" } modify_external_catalogs: true
I20260928 20:02:26.698706 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1338bfc0097241ffbaf0ac5e3efe1f42" } modify_external_catalogs: true
I20260928 20:02:26.700738 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b9d9cb7b957d4289b115bc082d8550e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.702431 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9d9cb7b957d4289b115bc082d8550e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.713413 26998 raft_consensus.cc:493] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.713900 26998 raft_consensus.cc:515] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.715830 26998 leader_election.cc:290] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:26.717437 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e47366cc02478290e02df5cb984691" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:26.718137 26803 raft_consensus.cc:2468] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:26.719123 26992 tablet.cc:1751] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:26.720763 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e47366cc02478290e02df5cb984691" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:26.721463 26516 raft_consensus.cc:2468] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:26.723606 26595 leader_election.cc:304] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.725320 26998 raft_consensus.cc:2804] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:26.725685 26998 raft_consensus.cc:493] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:26.726001 26998 raft_consensus.cc:3060] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.734973 26916 tablet_bootstrap.cc:492] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:26.735404 26916 ts_tablet_manager.cc:1449] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.156s user 0.021s sys 0.031s
I20260928 20:02:26.737767 26991 tablet.cc:1751] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:26.737687 26916 raft_consensus.cc:359] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.738432 26916 raft_consensus.cc:385] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.738689 26916 raft_consensus.cc:740] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.739431 26916 consensus_queue.cc:260] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.744486 26916 ts_tablet_manager.cc:1480] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260928 20:02:26.747669 26916 tablet_bootstrap.cc:492] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:26.753517 26916 tablet_bootstrap.cc:654] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.763824 26232 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30" } modify_external_catalogs: true
I20260928 20:02:26.764384 26232 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30" } modify_external_catalogs: true
I20260928 20:02:26.774257 26913 tablet_bootstrap.cc:492] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:26.724561 26999 tablet.cc:1751] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:26.766381 27010 ts_tablet_manager.cc:1975] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:26.774690 26913 ts_tablet_manager.cc:1449] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.172s user 0.006s sys 0.003s
I20260928 20:02:26.774976 27010 log.cc:1199] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/3be58e4a14614d5e87ffad4c0864d418
I20260928 20:02:26.775651 27010 ts_tablet_manager.cc:1996] T 3be58e4a14614d5e87ffad4c0864d418 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:26.776886 26913 raft_consensus.cc:359] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.777537 26913 raft_consensus.cc:385] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.777791 26913 raft_consensus.cc:740] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.778368 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 3be58e4a14614d5e87ffad4c0864d418 (table default.Table_5659158ccabb4ffd883f0166791f9fcb [id=9d6bd1be950040e692bc9b982360c642]) successfully deleted
W20260928 20:02:26.779966 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 6d8bbd88762641c7ad49db92fc116b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8bbd88762641c7ad49db92fc116b4f already in progress: creating tablet
I20260928 20:02:26.784850 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f1d14889209b44d09285f01ec61a6d3c" } new_table_name: "default.Table_c3a7d9da79be4906b5e673b04b2b6b0a" modify_external_catalogs: true
I20260928 20:02:26.788276 27010 tablet_replica.cc:333] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:26.793821 27010 raft_consensus.cc:2243] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:26.799507 26231 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c4bfa1d40a346ba9d4c60728c243647 consensus state has no leader
I20260928 20:02:26.802423 27010 raft_consensus.cc:2272] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.802667 26998 raft_consensus.cc:515] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.804636 27010 ts_tablet_manager.cc:1962] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:26.804286 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 51621.3us
I20260928 20:02:26.816172 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e47366cc02478290e02df5cb984691" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:26.816999 26803 raft_consensus.cc:3060] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.822271 26998 leader_election.cc:290] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:26.823438 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e47366cc02478290e02df5cb984691" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:26.823995 26516 raft_consensus.cc:3060] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.826038 26803 raft_consensus.cc:2468] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:26.832254 26516 raft_consensus.cc:2468] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:26.834152 26595 leader_election.cc:304] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:26.845880 26998 raft_consensus.cc:2804] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:26.851912 26916 tablet_bootstrap.cc:492] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:26.852103 26998 raft_consensus.cc:697] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:26.852358 26916 ts_tablet_manager.cc:1449] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.107s user 0.015s sys 0.024s
I20260928 20:02:26.853116 26998 consensus_queue.cc:237] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:26.855052 26916 raft_consensus.cc:359] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.856065 26916 raft_consensus.cc:385] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.856331 26916 raft_consensus.cc:740] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.857052 26916 consensus_queue.cc:260] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.868948 26916 ts_tablet_manager.cc:1480] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260928 20:02:26.838551 26913 consensus_queue.cc:260] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.877079 27018 raft_consensus.cc:493] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:26.877549 27018 raft_consensus.cc:515] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.880199 27018 leader_election.cc:290] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:26.881064 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e27a1855f8e4425ad51fba9025c5174" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:26.882377 27010 ts_tablet_manager.cc:1975] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:26.882768 27010 log.cc:1199] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/49f70d607ddd441ea78d4c729ad529e5
I20260928 20:02:26.882781 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e27a1855f8e4425ad51fba9025c5174" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:26.883459 27010 ts_tablet_manager.cc:1996] T 49f70d607ddd441ea78d4c729ad529e5 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:26.883368 26515 raft_consensus.cc:2468] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:02:26.884974 26594 leader_election.cc:343] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:26.885774 26595 leader_election.cc:304] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:26.886515 27018 raft_consensus.cc:2804] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:26.886920 27018 raft_consensus.cc:493] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:26.887581 27018 raft_consensus.cc:3060] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.893707 26912 tablet_bootstrap.cc:492] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:26.890369 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 49f70d607ddd441ea78d4c729ad529e5 (table default.Table_c63f34886f194863b4ef99dc2d8e18f8 [id=dfa0ff0ece9f40fa9639f928a48bfcad]) successfully deleted
I20260928 20:02:26.894196 26912 ts_tablet_manager.cc:1449] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.287s user 0.008s sys 0.003s
I20260928 20:02:26.900127 27018 raft_consensus.cc:515] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.902807 26913 ts_tablet_manager.cc:1480] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.128s user 0.006s sys 0.000s
I20260928 20:02:26.903333 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e27a1855f8e4425ad51fba9025c5174" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:26.903743 26913 tablet_bootstrap.cc:492] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:26.906407 26912 raft_consensus.cc:359] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.907094 26912 raft_consensus.cc:385] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.907344 26912 raft_consensus.cc:740] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:26.907714 26594 leader_election.cc:343] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:26.908521 26912 consensus_queue.cc:260] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.912503 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e27a1855f8e4425ad51fba9025c5174" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:26.913108 26516 raft_consensus.cc:3060] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:26.934737 26912 ts_tablet_manager.cc:1480] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.040s user 0.004s sys 0.001s
I20260928 20:02:26.937326 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0529ae2d974b46d6872cafb69c103d33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:26.938458 26913 tablet_bootstrap.cc:654] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:26.939165 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0529ae2d974b46d6872cafb69c103d33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.953684 26516 raft_consensus.cc:2468] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:26.941521 26912 tablet_bootstrap.cc:492] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:26.958699 27011 ts_tablet_manager.cc:1975] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:26.959093 27011 log.cc:1199] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/3be58e4a14614d5e87ffad4c0864d418
I20260928 20:02:26.959822 27011 ts_tablet_manager.cc:1996] T 3be58e4a14614d5e87ffad4c0864d418 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:26.963939 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_911e0630d48c4bd7b8f844cee768908b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:26.965724 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_911e0630d48c4bd7b8f844cee768908b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:26.975569 26912 tablet_bootstrap.cc:654] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:26.979523 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 3be58e4a14614d5e87ffad4c0864d418 (table default.Table_5659158ccabb4ffd883f0166791f9fcb [id=9d6bd1be950040e692bc9b982360c642]) successfully deleted
W20260928 20:02:26.981228 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 6d8bbd88762641c7ad49db92fc116b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d8bbd88762641c7ad49db92fc116b4f already in progress: creating tablet
I20260928 20:02:26.982935 27011 tablet_replica.cc:333] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:26.984187 27011 raft_consensus.cc:2243] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:26.986029 26913 tablet_bootstrap.cc:492] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:26.986624 26913 ts_tablet_manager.cc:1449] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.083s user 0.008s sys 0.002s
I20260928 20:02:26.988948 26913 raft_consensus.cc:359] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.989643 26913 raft_consensus.cc:385] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:26.989933 26913 raft_consensus.cc:740] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:26.991269 26913 consensus_queue.cc:260] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:26.990480 27011 raft_consensus.cc:2272] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:26.997830 26913 ts_tablet_manager.cc:1480] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260928 20:02:27.002795 26913 tablet_bootstrap.cc:492] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:26.998854 27011 ts_tablet_manager.cc:1962] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.019039 26912 tablet_bootstrap.cc:492] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:27.019526 26912 ts_tablet_manager.cc:1449] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.078s user 0.012s sys 0.000s
I20260928 20:02:27.022781 26912 raft_consensus.cc:359] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.030505 26912 raft_consensus.cc:385] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.030972 26912 raft_consensus.cc:740] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.031925 26912 consensus_queue.cc:260] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.035033 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6a805bebbc0a4dd3a67a10a375687f54" } new_table_name: "default.Table_cc5abaa8c7cd4a05b417f7cee23527e7" modify_external_catalogs: true
I20260928 20:02:27.040020 26912 ts_tablet_manager.cc:1480] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260928 20:02:27.046262 26913 tablet_bootstrap.cc:654] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.052649 26595 leader_election.cc:304] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:27.051090 26912 tablet_bootstrap.cc:492] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:27.053552 26998 raft_consensus.cc:2804] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:27.054003 26998 raft_consensus.cc:697] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
W20260928 20:02:27.057468 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a74c26724ae484a972944f96cc566c3 consensus state has no leader
I20260928 20:02:27.067829 26912 tablet_bootstrap.cc:654] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.074756 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 4aeb153250d848c8bdc02b917f6c11a0 (DEFAULT_TABLE table=default.Table_47107cc2ebe04af38af59a3a81e8dc62 [id=0957feb93a5345938705f3b7a3ec8394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.075821 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aeb153250d848c8bdc02b917f6c11a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.078423 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3] alter complete (version 2)
I20260928 20:02:27.084282 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 4aeb153250d848c8bdc02b917f6c11a0 (DEFAULT_TABLE table=default.Table_47107cc2ebe04af38af59a3a81e8dc62 [id=0957feb93a5345938705f3b7a3ec8394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.085418 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aeb153250d848c8bdc02b917f6c11a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.087724 26492 tablet_service.cc:1511] Processing CreateTablet for tablet ba87a379ae6a4feabfbc9fd6ba2d488e (DEFAULT_TABLE table=default.Table_bffcee37a58246d080c1be814e418f5f [id=785cc43f9b7d4d02aa025ab9ec645ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.088753 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba87a379ae6a4feabfbc9fd6ba2d488e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.090345 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet e7158add996a4281941e77ab8f9f8ad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:24 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.090960 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 49f70d607ddd441ea78d4c729ad529e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:27.092684 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet e7158add996a4281941e77ab8f9f8ad2 because the tablet was not found. No further retry: Not found: Tablet not found: e7158add996a4281941e77ab8f9f8ad2
W20260928 20:02:27.093276 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 49f70d607ddd441ea78d4c729ad529e5 because the tablet was not found. No further retry: Not found: Tablet not found: 49f70d607ddd441ea78d4c729ad529e5
I20260928 20:02:27.097746 26780 tablet_service.cc:1511] Processing CreateTablet for tablet ba87a379ae6a4feabfbc9fd6ba2d488e (DEFAULT_TABLE table=default.Table_bffcee37a58246d080c1be814e418f5f [id=785cc43f9b7d4d02aa025ab9ec645ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.098837 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba87a379ae6a4feabfbc9fd6ba2d488e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.101725 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 56d16f263a4d439b98ea11156f4997fe (DEFAULT_TABLE table=default.Table_574c02870e14491dbd36bb31f00b3cc8 [id=5556b2b20a4343c5b98fc7c73e2aebfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.102825 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d16f263a4d439b98ea11156f4997fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:27.108232 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 22) took 780 ms (client timeout 1000 ms). Trace:
I20260928 20:02:27.120986 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 56d16f263a4d439b98ea11156f4997fe (DEFAULT_TABLE table=default.Table_574c02870e14491dbd36bb31f00b3cc8 [id=5556b2b20a4343c5b98fc7c73e2aebfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.122305 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d16f263a4d439b98ea11156f4997fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.124549 26493 tablet_service.cc:1511] Processing CreateTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 (DEFAULT_TABLE table=default.Table_7efdb347f47442929bd480ef8c1b3f47 [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.125694 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e2b9af466b474bb4bda5d4b246aa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.125722 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_cad16d3252864a33acdd97cbb42fa80b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:27.127322 26782 tablet_service.cc:1511] Processing CreateTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 (DEFAULT_TABLE table=default.Table_7efdb347f47442929bd480ef8c1b3f47 [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:27.127485 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cad16d3252864a33acdd97cbb42fa80b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.128466 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e2b9af466b474bb4bda5d4b246aa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.134734 27018 leader_election.cc:290] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:27.135563 26636 tablet_service.cc:1511] Processing CreateTablet for tablet ba87a379ae6a4feabfbc9fd6ba2d488e (DEFAULT_TABLE table=default.Table_bffcee37a58246d080c1be814e418f5f [id=785cc43f9b7d4d02aa025ab9ec645ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.136662 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba87a379ae6a4feabfbc9fd6ba2d488e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.136459 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 4aeb153250d848c8bdc02b917f6c11a0 (DEFAULT_TABLE table=default.Table_47107cc2ebe04af38af59a3a81e8dc62 [id=0957feb93a5345938705f3b7a3ec8394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.137507 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aeb153250d848c8bdc02b917f6c11a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.138406 26998 consensus_queue.cc:237] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.142899 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 56d16f263a4d439b98ea11156f4997fe (DEFAULT_TABLE table=default.Table_574c02870e14491dbd36bb31f00b3cc8 [id=5556b2b20a4343c5b98fc7c73e2aebfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.144200 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d16f263a4d439b98ea11156f4997fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.147852 27011 ts_tablet_manager.cc:1975] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:27.148281 27011 log.cc:1199] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/49f70d607ddd441ea78d4c729ad529e5
I20260928 20:02:27.149008 27011 ts_tablet_manager.cc:1996] T 49f70d607ddd441ea78d4c729ad529e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:27.150293 26638 tablet_service.cc:1511] Processing CreateTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 (DEFAULT_TABLE table=default.Table_7efdb347f47442929bd480ef8c1b3f47 [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.151584 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2e2b9af466b474bb4bda5d4b246aa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.160529 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 49f70d607ddd441ea78d4c729ad529e5 (table default.Table_c63f34886f194863b4ef99dc2d8e18f8 [id=dfa0ff0ece9f40fa9639f928a48bfcad]) successfully deleted
I20260928 20:02:27.167706 26494 tablet_service.cc:1511] Processing CreateTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 (DEFAULT_TABLE table=default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.168813 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27a3bd58866482f80fae7afe0ad48d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:27.117843 26235 rpcz_store.cc:269] 0928 20:02:26.327714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:26.352350 (+ 24636us) service_pool.cc:224] Handling call
0928 20:02:27.108161 (+755811us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:26.583538 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:26.583942 (+ 404us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:26.583966 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:26.583979 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:26.584258 (+ 279us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:26.584300 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:26.584324 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:26.584472 (+ 148us) tablet.cc:701] Row locks acquired
0928 20:02:26.584485 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:26.584595 (+ 110us) write_op.cc:270] Start()
0928 20:02:26.584672 (+ 77us) write_op.cc:276] Timestamp: P: 1790625746584539 usec, L: 0
0928 20:02:26.584687 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:26.619974 (+ 35287us) log.cc:844] Serialized 535 byte log entry
0928 20:02:26.639580 (+ 19606us) op_driver.cc:464] REPLICATION: finished
0928 20:02:26.640059 (+ 479us) write_op.cc:301] APPLY: starting
0928 20:02:26.640117 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:26.640212 (+ 95us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:26.640311 (+ 99us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:26.640511 (+ 200us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:26.640669 (+ 158us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:26.640728 (+ 59us) write_op.cc:312] APPLY: finished
0928 20:02:26.640917 (+ 189us) log.cc:844] Serialized 22 byte log entry
0928 20:02:26.641067 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:26.641151 (+ 84us) write_op.cc:454] Released schema lock
0928 20:02:26.641181 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:26.658264 (+ 17083us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:26.658288 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85058,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":311,"apply.run_cpu_time_us":1316,"apply.run_wall_time_us":1315,"num_ops":1,"prepare.queue_time_us":68830,"prepare.run_cpu_time_us":2181,"prepare.run_wall_time_us":74715,"raft.queue_time_us":151,"raft.run_cpu_time_us":742,"raft.run_wall_time_us":1624,"replication_time_us":54777}]]}
I20260928 20:02:27.191813 26969 raft_consensus.cc:493] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.192461 26912 tablet_bootstrap.cc:492] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:27.193045 26912 ts_tablet_manager.cc:1449] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.142s user 0.004s sys 0.006s
I20260928 20:02:27.196657 26912 raft_consensus.cc:359] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.205890 26968 raft_consensus.cc:493] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.206437 26968 raft_consensus.cc:515] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.223479 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet aec06a31e9034182a3e23dce21ac8b3e
I20260928 20:02:27.227613 26968 leader_election.cc:290] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:27.214447 26783 tablet_service.cc:1511] Processing CreateTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 (DEFAULT_TABLE table=default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.226686 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet aec06a31e9034182a3e23dce21ac8b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:27.229535 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4bfa1d40a346ba9d4c60728c243647" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:27.231417 26803 raft_consensus.cc:2468] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:27.231814 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27a3bd58866482f80fae7afe0ad48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.232786 27010 tablet_replica.cc:333] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:27.232795 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 665b24041d5e4348a28df63af1735312
I20260928 20:02:27.233669 27010 raft_consensus.cc:2243] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:27.234282 27010 raft_consensus.cc:2272] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.237094 27010 ts_tablet_manager.cc:1962] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.240608 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 665b24041d5e4348a28df63af1735312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:27.244709 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2c0586b4eade4864849f11f68ed45467"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.246565 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c0586b4eade4864849f11f68ed45467 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:27.248342 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6c0cc7bd109493cacf990dd1e2728f0 has no consensus state
I20260928 20:02:27.249747 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]). Expected version 1 got 0
W20260928 20:02:27.249084 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 44079.2us
I20260928 20:02:27.250706 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 8c4bfa1d40a346ba9d4c60728c243647 (table default.Table_5a9d98eec9c847f4bfa6de33dedf04dd [id=b710280fc0e54970a0283a2eaa9f2efc]). Expected version 1 got 0
I20260928 20:02:27.254982 26450 leader_election.cc:304] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:27.256177 26968 raft_consensus.cc:2804] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:27.256510 26968 raft_consensus.cc:493] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:27.256811 26968 raft_consensus.cc:3060] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.260854 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet aec06a31e9034182a3e23dce21ac8b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.261188 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 665b24041d5e4348a28df63af1735312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.261608 27009 tablet_replica.cc:333] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:27.261797 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_074fa99958dd4bcdb27668ca50658ff8" } new_table_name: "default.Table_8fbaf845832a4eb58670a1c3a9953c39" modify_external_catalogs: true
I20260928 20:02:27.262425 27009 raft_consensus.cc:2243] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:27.263405 27009 raft_consensus.cc:2272] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.264452 26912 raft_consensus.cc:385] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.264825 26912 raft_consensus.cc:740] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.266184 27009 ts_tablet_manager.cc:1962] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.265707 26912 consensus_queue.cc:260] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.284649 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6eec7cf0b6d741809b9b24d3e5ea216e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.286816 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6eec7cf0b6d741809b9b24d3e5ea216e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.290642 26912 ts_tablet_manager.cc:1480] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.096s user 0.003s sys 0.004s
I20260928 20:02:27.284564 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_75d3d3007f5b4c929142c1ec075e54f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.295642 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75d3d3007f5b4c929142c1ec075e54f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.298570 26988 raft_consensus.cc:493] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.299171 26988 raft_consensus.cc:515] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.301484 26988 leader_election.cc:290] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:27.254267 26969 raft_consensus.cc:515] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.307294 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e27a1855f8e4425ad51fba9025c5174" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:27.308036 26516 raft_consensus.cc:2393] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:27.314335 26782 tablet_service.cc:1511] Processing CreateTablet for tablet ee8db8da5c3a42679d26c22396938fd2 (DEFAULT_TABLE table=default.Table_9513d351920c4195b6b8f30509cabfe2 [id=7eeccc44c73f46b88801b8107c5b1cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.320341 26968 raft_consensus.cc:515] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.321450 26916 tablet_bootstrap.cc:492] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:27.327490 26916 tablet_bootstrap.cc:654] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.331207 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8bbd88762641c7ad49db92fc116b4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:27.332201 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4bfa1d40a346ba9d4c60728c243647" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:27.332826 26804 raft_consensus.cc:3060] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.335383 26494 tablet_service.cc:1511] Processing CreateTablet for tablet ee8db8da5c3a42679d26c22396938fd2 (DEFAULT_TABLE table=default.Table_9513d351920c4195b6b8f30509cabfe2 [id=7eeccc44c73f46b88801b8107c5b1cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.335893 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8c4bfa1d40a346ba9d4c60728c243647 (table default.Table_5a9d98eec9c847f4bfa6de33dedf04dd [id=b710280fc0e54970a0283a2eaa9f2efc]). Expected version 1 got 0
I20260928 20:02:27.336894 26235 catalog_manager.cc:5838] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:27.338388 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]). Expected version 1 got 0
W20260928 20:02:27.338837 26450 leader_election.cc:343] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:27.339246 26235 catalog_manager.cc:5838] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:27.340353 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8db8da5c3a42679d26c22396938fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.341645 27010 ts_tablet_manager.cc:1975] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:27.342319 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]). Expected version 1 got 0
I20260928 20:02:27.343794 26916 tablet_bootstrap.cc:492] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:27.344206 26916 ts_tablet_manager.cc:1449] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.001s
I20260928 20:02:27.344170 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet aec06a31e9034182a3e23dce21ac8b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:27.339020 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8db8da5c3a42679d26c22396938fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.347602 26632 tablet_service.cc:1511] Processing CreateTablet for tablet ee8db8da5c3a42679d26c22396938fd2 (DEFAULT_TABLE table=default.Table_9513d351920c4195b6b8f30509cabfe2 [id=7eeccc44c73f46b88801b8107c5b1cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.348815 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8db8da5c3a42679d26c22396938fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.349036 26804 raft_consensus.cc:2468] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:27.335687 26492 tablet_service.cc:1511] Processing CreateTablet for tablet e6b8e89ff26a439c8f6d7784cd179698 (DEFAULT_TABLE table=default.Table_34bca48461484fc4a8c9fa9f70fa799f [id=219bcf821c96465eb48c3199ea6f4237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.350334 26450 leader_election.cc:304] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:27.351151 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b8e89ff26a439c8f6d7784cd179698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.351204 27008 raft_consensus.cc:2804] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:27.351131 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4bfa1d40a346ba9d4c60728c243647" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:27.351728 26656 raft_consensus.cc:3060] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.356042 27010 log.cc:1199] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/aec06a31e9034182a3e23dce21ac8b3e
I20260928 20:02:27.345198 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4bfa1d40a346ba9d4c60728c243647" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.358742 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8bbd88762641c7ad49db92fc116b4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.359372 26658 raft_consensus.cc:2468] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:27.360239 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e27a1855f8e4425ad51fba9025c5174" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.361064 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 665b24041d5e4348a28df63af1735312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:27.221671 26639 tablet_service.cc:1511] Processing CreateTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 (DEFAULT_TABLE table=default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.362211 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27a3bd58866482f80fae7afe0ad48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.357407 27011 tablet_replica.cc:333] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:27.362876 26916 raft_consensus.cc:359] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.366648 26916 raft_consensus.cc:385] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.366910 26916 raft_consensus.cc:740] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.367568 27011 raft_consensus.cc:2243] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:27.368089 27011 raft_consensus.cc:2272] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.369194 26968 leader_election.cc:290] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:27.369361 26913 tablet_bootstrap.cc:492] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:27.369355 26450 leader_election.cc:304] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:27.370545 26913 ts_tablet_manager.cc:1449] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.368s user 0.021s sys 0.020s
I20260928 20:02:27.374261 27011 ts_tablet_manager.cc:1962] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.363302 26912 tablet_bootstrap.cc:492] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:27.371233 26739 leader_election.cc:304] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:27.381153 27045 raft_consensus.cc:2804] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:27.381186 26988 raft_consensus.cc:3060] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.381479 27045 raft_consensus.cc:493] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:27.381753 27045 raft_consensus.cc:3060] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.383304 27008 raft_consensus.cc:697] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:27.384094 27008 consensus_queue.cc:237] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.385761 26912 tablet_bootstrap.cc:654] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.385821 26916 consensus_queue.cc:260] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.387665 26916 ts_tablet_manager.cc:1480] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20260928 20:02:27.388159 26988 raft_consensus.cc:2749] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:27.388513 26916 tablet_bootstrap.cc:492] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:27.389350 27010 ts_tablet_manager.cc:1996] T aec06a31e9034182a3e23dce21ac8b3e P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:27.392236 26783 tablet_service.cc:1511] Processing CreateTablet for tablet e6b8e89ff26a439c8f6d7784cd179698 (DEFAULT_TABLE table=default.Table_34bca48461484fc4a8c9fa9f70fa799f [id=219bcf821c96465eb48c3199ea6f4237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.392457 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_1338bfc0097241ffbaf0ac5e3efe1f42 [id=459c7e835c364f1cb8b3a572190234d7]) successfully deleted
I20260928 20:02:27.395202 26633 tablet_service.cc:1511] Processing CreateTablet for tablet e6b8e89ff26a439c8f6d7784cd179698 (DEFAULT_TABLE table=default.Table_34bca48461484fc4a8c9fa9f70fa799f [id=219bcf821c96465eb48c3199ea6f4237]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.307313 26969 leader_election.cc:290] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:27.400516 27009 ts_tablet_manager.cc:1975] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:27.404436 26656 raft_consensus.cc:2468] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:27.405416 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9ca77e114c4d06bde1bcd862c8eccf (DEFAULT_TABLE table=default.Table_d467734bfa0b4fc1bc617954ce95836e [id=bfbc8f3e5a924682a1dd0a5996898e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.411917 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b8e89ff26a439c8f6d7784cd179698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.419164 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca77e114c4d06bde1bcd862c8eccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.407291 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9ca77e114c4d06bde1bcd862c8eccf (DEFAULT_TABLE table=default.Table_d467734bfa0b4fc1bc617954ce95836e [id=bfbc8f3e5a924682a1dd0a5996898e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.423523 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca77e114c4d06bde1bcd862c8eccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.421391 26493 tablet_service.cc:1511] Processing CreateTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 (DEFAULT_TABLE table=default.Table_560504da8c694a95a0b601d4f3998d96 [id=ee0ddf3f7b2c42bfb01a4a12edea45d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.425762 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4df1bab40024f97a5ad5acf358e3c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.427937 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0529ae2d974b46d6872cafb69c103d33" } modify_external_catalogs: true
I20260928 20:02:27.428480 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0529ae2d974b46d6872cafb69c103d33" } modify_external_catalogs: true
I20260928 20:02:27.422228 27008 consensus_queue.cc:1048] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:27.445013 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5d73fef88894a51b9fa04cb70e29d43 has no consensus state
I20260928 20:02:27.455883 26119 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
/tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.252:44461
--webserver_interface=127.25.129.252
--webserver_port=43621
--builtin_ntp_servers=127.25.129.212:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260928 20:02:27.465595 26916 tablet_bootstrap.cc:654] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.446036 27009 log.cc:1199] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/aec06a31e9034182a3e23dce21ac8b3e
I20260928 20:02:27.466794 27009 ts_tablet_manager.cc:1996] T aec06a31e9034182a3e23dce21ac8b3e P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:27.467584 26913 raft_consensus.cc:359] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.467803 26631 tablet_service.cc:1511] Processing CreateTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 (DEFAULT_TABLE table=default.Table_560504da8c694a95a0b601d4f3998d96 [id=ee0ddf3f7b2c42bfb01a4a12edea45d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.468241 26913 raft_consensus.cc:385] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.468508 26913 raft_consensus.cc:740] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.468974 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4df1bab40024f97a5ad5acf358e3c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.469463 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_1338bfc0097241ffbaf0ac5e3efe1f42 [id=459c7e835c364f1cb8b3a572190234d7]) successfully deleted
I20260928 20:02:27.397099 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b8e89ff26a439c8f6d7784cd179698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.422051 26988 raft_consensus.cc:493] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.478799 26988 raft_consensus.cc:515] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.481269 26988 leader_election.cc:290] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:27.484826 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665b24041d5e4348a28df63af1735312" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:27.394162 27010 tablet_replica.cc:333] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:27.491643 27045 raft_consensus.cc:515] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.475984 27009 tablet_replica.cc:333] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:27.509925 26516 raft_consensus.cc:2468] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:27.518878 27009 raft_consensus.cc:2243] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:27.519685 27009 raft_consensus.cc:2272] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.532228 26231 master_service.cc:960] ReplaceTablet: received request to replace tablet f87b70e9dcf04ba7915e1f5124aa36e2 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:27.535511 26234 master_service.cc:960] ReplaceTablet: received request to replace tablet 7e27a1855f8e4425ad51fba9025c5174 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:27.542745 27045 leader_election.cc:290] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:27.545873 27009 ts_tablet_manager.cc:1962] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.545640 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8d28094f407f435190e32f3d52716436" } modify_external_catalogs: true
I20260928 20:02:27.548203 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8d28094f407f435190e32f3d52716436" } modify_external_catalogs: true
I20260928 20:02:27.549197 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7efdb347f47442929bd480ef8c1b3f47" } new_table_name: "default.Table_48a9e11420f442ef9d1f3c2e4bb7c20c" modify_external_catalogs: true
I20260928 20:02:27.469094 26913 consensus_queue.cc:260] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.561533 26916 tablet_bootstrap.cc:492] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:27.562444 26916 ts_tablet_manager.cc:1449] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.174s user 0.006s sys 0.005s
I20260928 20:02:27.567560 26916 raft_consensus.cc:359] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.568243 26916 raft_consensus.cc:385] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.568517 26916 raft_consensus.cc:740] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.569150 26916 consensus_queue.cc:260] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:27.572345 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a5d73fef88894a51b9fa04cb70e29d43 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a5d73fef88894a51b9fa04cb70e29d43 has no consensus state
I20260928 20:02:27.576572 26236 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 5027cd67a4e943cd93b434a3e05d805c
I20260928 20:02:27.503638 26782 tablet_service.cc:1511] Processing CreateTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 (DEFAULT_TABLE table=default.Table_560504da8c694a95a0b601d4f3998d96 [id=ee0ddf3f7b2c42bfb01a4a12edea45d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.506275 26988 raft_consensus.cc:493] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.579735 26988 raft_consensus.cc:515] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.581759 26916 ts_tablet_manager.cc:1480] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.019s user 0.004s sys 0.002s
I20260928 20:02:27.537271 26740 leader_election.cc:304] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:27.582692 26916 tablet_bootstrap.cc:492] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:27.542124 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8bbd88762641c7ad49db92fc116b4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:27.464519 26912 tablet_bootstrap.cc:492] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:27.410226 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9ca77e114c4d06bde1bcd862c8eccf (DEFAULT_TABLE table=default.Table_d467734bfa0b4fc1bc617954ce95836e [id=bfbc8f3e5a924682a1dd0a5996898e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:27.583617 26912 ts_tablet_manager.cc:1449] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.220s user 0.009s sys 0.001s
I20260928 20:02:27.584257 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca77e114c4d06bde1bcd862c8eccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.586264 26912 raft_consensus.cc:359] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.586863 26912 raft_consensus.cc:385] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.587096 26912 raft_consensus.cc:740] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:27.588640 26450 leader_election.cc:343] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:27.581928 26988 leader_election.cc:290] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:27.589483 26988 raft_consensus.cc:2804] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:27.589820 26988 raft_consensus.cc:493] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:27.590184 26988 raft_consensus.cc:3060] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.591789 26912 consensus_queue.cc:260] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.592463 26804 raft_consensus.cc:3060] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.593626 26912 ts_tablet_manager.cc:1480] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260928 20:02:27.594652 26912 tablet_bootstrap.cc:492] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:27.623874 26912 tablet_bootstrap.cc:654] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:27.628958 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 91770.7us
I20260928 20:02:27.630625 27009 ts_tablet_manager.cc:1975] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:27.630823 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87b70e9dcf04ba7915e1f5124aa36e2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:27.631007 27009 log.cc:1199] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/665b24041d5e4348a28df63af1735312
I20260928 20:02:27.631887 27009 ts_tablet_manager.cc:1996] T 665b24041d5e4348a28df63af1735312 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:27.634025 27045 raft_consensus.cc:493] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.634482 27045 raft_consensus.cc:515] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.634887 26969 consensus_queue.cc:1048] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:27.636310 27045 leader_election.cc:290] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:27.638062 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:27.640000 26450 leader_election.cc:343] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:27.644834 26916 tablet_bootstrap.cc:654] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.648283 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665b24041d5e4348a28df63af1735312" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.648983 26659 raft_consensus.cc:2468] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:27.654424 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f87b70e9dcf04ba7915e1f5124aa36e2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.665066 26916 tablet_bootstrap.cc:492] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:27.665591 26916 ts_tablet_manager.cc:1449] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.005s
W20260928 20:02:27.677690 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2e2b9af466b474bb4bda5d4b246aa45 consensus state has no leader
I20260928 20:02:27.682973 26912 tablet_bootstrap.cc:492] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:27.684288 27018 consensus_queue.cc:1048] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:27.686609 26913 ts_tablet_manager.cc:1480] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.316s user 0.005s sys 0.001s
I20260928 20:02:27.688380 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4df1bab40024f97a5ad5acf358e3c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:27.690248 26988 raft_consensus.cc:515] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.699602 26912 ts_tablet_manager.cc:1449] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.089s user 0.006s sys 0.008s
I20260928 20:02:27.703845 26913 tablet_bootstrap.cc:492] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:27.705603 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet f87b70e9dcf04ba7915e1f5124aa36e2
I20260928 20:02:27.707592 26231 catalog_manager.cc:6934] ReplaceTablet: tablet f87b70e9dcf04ba7915e1f5124aa36e2 deleted and replaced by tablet 47bf3dd9ed054197b4208324938d96b0
I20260928 20:02:27.710063 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 7e27a1855f8e4425ad51fba9025c5174
I20260928 20:02:27.711499 26234 catalog_manager.cc:6934] ReplaceTablet: tablet 7e27a1855f8e4425ad51fba9025c5174 deleted and replaced by tablet 583d005c68fd4e30ad705080c620226a
I20260928 20:02:27.712145 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet f87b70e9dcf04ba7915e1f5124aa36e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 47bf3dd9ed054197b4208324938d96b0) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:27.713039 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e27a1855f8e4425ad51fba9025c5174 with delete_type TABLET_DATA_DELETED (replaced by tablet 583d005c68fd4e30ad705080c620226a) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:27.714198 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 8c4bfa1d40a346ba9d4c60728c243647 (table default.Table_5a9d98eec9c847f4bfa6de33dedf04dd [id=b710280fc0e54970a0283a2eaa9f2efc]). Expected version 1 got 0
I20260928 20:02:27.714322 26988 leader_election.cc:290] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:27.714956 26229 catalog_manager.cc:5838] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:27.720531 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet f87b70e9dcf04ba7915e1f5124aa36e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 47bf3dd9ed054197b4208324938d96b0) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.721535 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e27a1855f8e4425ad51fba9025c5174 with delete_type TABLET_DATA_DELETED (replaced by tablet 583d005c68fd4e30ad705080c620226a) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.724582 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e27a1855f8e4425ad51fba9025c5174 with delete_type TABLET_DATA_DELETED (replaced by tablet 583d005c68fd4e30ad705080c620226a) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:27.669445 26916 raft_consensus.cc:359] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.725329 26916 raft_consensus.cc:385] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.724921 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]). Expected version 1 got 0
I20260928 20:02:27.725744 26916 raft_consensus.cc:740] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.725440 26969 consensus_queue.cc:1048] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:02:27.725701 26740 leader_election.cc:343] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 665b24041d5e4348a28df63af1735312
I20260928 20:02:27.726868 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 665b24041d5e4348a28df63af1735312 (table default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 [id=3124342cb4fb46c4bdfd465c3e582053]) successfully deleted
I20260928 20:02:27.728272 26916 consensus_queue.cc:260] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.737599 26916 ts_tablet_manager.cc:1480] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.072s user 0.007s sys 0.002s
I20260928 20:02:27.741125 27010 raft_consensus.cc:2243] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:27.741871 27010 raft_consensus.cc:2272] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.742571 26912 raft_consensus.cc:359] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.743424 26912 raft_consensus.cc:385] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.743678 26912 raft_consensus.cc:740] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.748134 27010 ts_tablet_manager.cc:1962] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.745925 26912 consensus_queue.cc:260] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.751351 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet f87b70e9dcf04ba7915e1f5124aa36e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 47bf3dd9ed054197b4208324938d96b0) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:27.754176 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8bbd88762641c7ad49db92fc116b4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:27.754879 26912 ts_tablet_manager.cc:1480] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.055s user 0.006s sys 0.001s
I20260928 20:02:27.754848 26659 raft_consensus.cc:3060] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.756203 27009 tablet_replica.cc:333] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:27.755760 26912 tablet_bootstrap.cc:492] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:27.766063 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_48a9e11420f442ef9d1f3c2e4bb7c20c" } new_table_name: "default.Table_84b84e38b1a343b082d36bca0a4fa27d" modify_external_catalogs: true
I20260928 20:02:27.770869 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e37f5f95bc984b27b7fb29e83e336618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.772740 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e37f5f95bc984b27b7fb29e83e336618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.777632 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2721556696834890a816325ba8ace11f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.779428 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2721556696834890a816325ba8ace11f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.775038 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_9e005d2ba4ca46d387ac5abf817b9c45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.785210 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e005d2ba4ca46d387ac5abf817b9c45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.793821 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5a9d98eec9c847f4bfa6de33dedf04dd" } modify_external_catalogs: true
I20260928 20:02:27.794397 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5a9d98eec9c847f4bfa6de33dedf04dd" } modify_external_catalogs: true
I20260928 20:02:27.797560 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.798578 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_fb67972a9c71416faf4f741a20f47b06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:27.800284 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb67972a9c71416faf4f741a20f47b06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:27.807771 26913 tablet_bootstrap.cc:654] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:27.816793 26450 leader_election.cc:343] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:27.817205 26450 leader_election.cc:304] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:27.818811 27008 consensus_queue.cc:1048] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:27.820300 27008 raft_consensus.cc:2749] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:27.821849 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2e2b9af466b474bb4bda5d4b246aa45 consensus state has no leader
I20260928 20:02:27.827577 26916 tablet_bootstrap.cc:492] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:27.830699 27009 raft_consensus.cc:2243] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:27.833804 27009 raft_consensus.cc:2272] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.835727 26739 leader_election.cc:304] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:27.839010 27009 ts_tablet_manager.cc:1962] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:27.843335 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665b24041d5e4348a28df63af1735312" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:27.843904 26656 raft_consensus.cc:3060] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:27.850766 26656 raft_consensus.cc:2468] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:27.853668 26988 raft_consensus.cc:2749] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:27.854465 27018 consensus_queue.cc:1048] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:27.855014 26739 leader_election.cc:304] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:27.855626 26739 raft_consensus.cc:2686] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:27.862715 26912 tablet_bootstrap.cc:654] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.866012 26230 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 583d005c68fd4e30ad705080c620226a
I20260928 20:02:27.872763 26659 raft_consensus.cc:2468] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:27.876191 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet aec06a31e9034182a3e23dce21ac8b3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.876885 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 665b24041d5e4348a28df63af1735312 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.877506 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:27.881605 26916 tablet_bootstrap.cc:654] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:27.889561 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9e005d2ba4ca46d387ac5abf817b9c45" } new_table_name: "default.Table_15a05c7f96404a8484bdae6486a0e200" modify_external_catalogs: true
I20260928 20:02:27.893590 27009 ts_tablet_manager.cc:1975] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:27.895462 27009 log.cc:1199] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/f87b70e9dcf04ba7915e1f5124aa36e2
I20260928 20:02:27.897012 27009 ts_tablet_manager.cc:1996] T f87b70e9dcf04ba7915e1f5124aa36e2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:27.916082 26916 tablet_bootstrap.cc:492] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:27.918069 26916 ts_tablet_manager.cc:1449] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.091s user 0.007s sys 0.006s
I20260928 20:02:27.922655 26916 raft_consensus.cc:359] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.925820 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]) successfully deleted
I20260928 20:02:27.927484 26916 raft_consensus.cc:385] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:27.929440 26916 raft_consensus.cc:740] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:27.912578 27010 ts_tablet_manager.cc:1975] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:27.931646 26916 consensus_queue.cc:260] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.930826 27009 tablet_replica.cc:333] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:27.943286 26916 ts_tablet_manager.cc:1480] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.024s user 0.004s sys 0.003s
I20260928 20:02:27.944120 27009 raft_consensus.cc:2243] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:27.944897 27009 raft_consensus.cc:2272] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:27.946645 27009 ts_tablet_manager.cc:1962] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:27.951926 27068 log.cc:927] Time spent T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260928 20:02:27.952278 26916 tablet_bootstrap.cc:492] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:27.954703 26450 leader_election.cc:304] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:27.955559 27045 raft_consensus.cc:2804] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:27.955997 27045 raft_consensus.cc:697] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:27.956781 27045 consensus_queue.cc:237] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:27.961724 27008 raft_consensus.cc:493] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.962160 27008 raft_consensus.cc:515] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:27.963893 27008 leader_election.cc:290] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:27.969364 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2b9af466b474bb4bda5d4b246aa45" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:27.961407 27010 log.cc:1199] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/665b24041d5e4348a28df63af1735312
I20260928 20:02:27.973826 27010 ts_tablet_manager.cc:1996] T 665b24041d5e4348a28df63af1735312 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:27.982218 27070 tablet.cc:1751] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:27.971647 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2b9af466b474bb4bda5d4b246aa45" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:27.942515 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 119009us
W20260928 20:02:27.986516 26450 leader_election.cc:343] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:27.987232 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:27.988663 26450 leader_election.cc:343] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:27.989066 26450 leader_election.cc:304] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:27.994845 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 665b24041d5e4348a28df63af1735312 (table default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 [id=3124342cb4fb46c4bdfd465c3e582053]) successfully deleted
I20260928 20:02:27.984298 26912 tablet_bootstrap.cc:492] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:27.988838 27053 raft_consensus.cc:493] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:27.995901 27053 raft_consensus.cc:515] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.002238 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aeb153250d848c8bdc02b917f6c11a0" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:02:28.003738 26740 leader_election.cc:343] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.004087 27010 tablet_replica.cc:333] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:28.003189 27053 leader_election.cc:290] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:28.004861 26912 ts_tablet_manager.cc:1449] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.249s user 0.016s sys 0.003s
I20260928 20:02:28.005216 26916 tablet_bootstrap.cc:654] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.007524 26912 raft_consensus.cc:359] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.009685 26969 raft_consensus.cc:2749] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:28.017962 27008 raft_consensus.cc:493] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.018554 27008 raft_consensus.cc:515] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:28.019467 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 has no consensus state
I20260928 20:02:28.019374 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aeb153250d848c8bdc02b917f6c11a0" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:27.974340 27011 ts_tablet_manager.cc:1975] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:28.026424 27011 log.cc:1199] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/aec06a31e9034182a3e23dce21ac8b3e
I20260928 20:02:28.026865 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d65f8d2cec034d47917d20d370000367" } new_table_name: "default.Table_6239910b69934cbbb9e960245e388e02" modify_external_catalogs: true
I20260928 20:02:28.030239 27011 ts_tablet_manager.cc:1996] T aec06a31e9034182a3e23dce21ac8b3e P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:28.035655 26912 raft_consensus.cc:385] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.035976 26912 raft_consensus.cc:740] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.037042 26912 consensus_queue.cc:260] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.041213 27009 ts_tablet_manager.cc:1975] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:28.041640 27009 log.cc:1199] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/7e27a1855f8e4425ad51fba9025c5174
I20260928 20:02:28.042243 27008 leader_election.cc:290] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:28.004880 27010 raft_consensus.cc:2243] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.044858 27010 raft_consensus.cc:2272] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.053252 27010 ts_tablet_manager.cc:1962] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.018535 27073 tablet.cc:1751] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:28.022320 26739 leader_election.cc:343] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.054399 26739 leader_election.cc:304] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:28.055104 27009 ts_tablet_manager.cc:1996] T 7e27a1855f8e4425ad51fba9025c5174 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:28.056262 27053 raft_consensus.cc:2749] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:28.059518 26234 master_service.cc:960] ReplaceTablet: received request to replace tablet b2e2b9af466b474bb4bda5d4b246aa45 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:28.061689 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba87a379ae6a4feabfbc9fd6ba2d488e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:28.063235 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57189d2450924921aecc1ee81c1cb952 has no consensus state
I20260928 20:02:28.063705 26801 raft_consensus.cc:2468] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
W20260928 20:02:28.064977 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet aec06a31e9034182a3e23dce21ac8b3e because the tablet was not found. No further retry: Not found: Tablet not found: aec06a31e9034182a3e23dce21ac8b3e
W20260928 20:02:28.067718 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 665b24041d5e4348a28df63af1735312 because the tablet was not found. No further retry: Not found: Tablet not found: 665b24041d5e4348a28df63af1735312
I20260928 20:02:28.070524 27009 tablet_replica.cc:333] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:28.071168 27009 raft_consensus.cc:2243] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:28.071771 27009 pending_rounds.cc:70] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Trying to abort 1 pending ops.
I20260928 20:02:28.071983 27009 pending_rounds.cc:77] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403063645855744 op_type: NO_OP noop_request { }
I20260928 20:02:28.072290 27009 raft_consensus.cc:2889] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:28.072592 27009 raft_consensus.cc:2272] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:28.057147 26594 consensus_peers.cc:597] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:28.060642 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba87a379ae6a4feabfbc9fd6ba2d488e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:28.029246 26913 tablet_bootstrap.cc:492] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:28.075165 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_560504da8c694a95a0b601d4f3998d96" } modify_external_catalogs: true
I20260928 20:02:28.075670 26913 ts_tablet_manager.cc:1449] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.372s user 0.004s sys 0.009s
I20260928 20:02:28.075683 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_560504da8c694a95a0b601d4f3998d96" } modify_external_catalogs: true
I20260928 20:02:28.076382 27080 tablet.cc:1751] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:28.081241 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_74657ad59de141059b3292c1b529868c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:28.083328 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74657ad59de141059b3292c1b529868c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.086062 27009 ts_tablet_manager.cc:1962] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:28.090170 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 63565.1us
I20260928 20:02:28.090711 26450 leader_election.cc:304] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:28.092010 27074 raft_consensus.cc:2804] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:28.092336 27074 raft_consensus.cc:493] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:28.092628 27074 raft_consensus.cc:3060] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.094929 26229 master_service.cc:960] ReplaceTablet: received request to replace tablet d27a3bd58866482f80fae7afe0ad48d7 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:28.096840 27011 tablet_replica.cc:333] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:28.098480 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet aec06a31e9034182a3e23dce21ac8b3e (table default.Table_1338bfc0097241ffbaf0ac5e3efe1f42 [id=459c7e835c364f1cb8b3a572190234d7]) successfully deleted
I20260928 20:02:28.106352 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_49cde204e2ef4ab9ad1024eb51d8d76e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:28.108637 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49cde204e2ef4ab9ad1024eb51d8d76e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.081334 27078 tablet.cc:1751] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:28.116334 26913 raft_consensus.cc:359] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.116987 26913 raft_consensus.cc:385] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.117238 26913 raft_consensus.cc:740] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.118041 27009 ts_tablet_manager.cc:1975] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:28.117919 26913 consensus_queue.cc:260] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.118392 27009 log.cc:1199] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/6d8bbd88762641c7ad49db92fc116b4f
I20260928 20:02:28.119094 27009 ts_tablet_manager.cc:1996] T 6d8bbd88762641c7ad49db92fc116b4f P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:28.128521 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 29a489266ffc47a498e8541408a1f6a2 (DEFAULT_TABLE table=default.Table_2c0586b4eade4864849f11f68ed45467 [id=10827de24c9348b8a73fb743b32a9188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.129609 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a489266ffc47a498e8541408a1f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.133786 26912 ts_tablet_manager.cc:1480] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.129s user 0.006s sys 0.000s
I20260928 20:02:28.135746 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 29a489266ffc47a498e8541408a1f6a2 (DEFAULT_TABLE table=default.Table_2c0586b4eade4864849f11f68ed45467 [id=10827de24c9348b8a73fb743b32a9188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.097922 27011 raft_consensus.cc:2243] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.138646 27011 raft_consensus.cc:2272] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.139523 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:28.140771 27011 ts_tablet_manager.cc:1962] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.143043 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.147022 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.149161 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b2e2b9af466b474bb4bda5d4b246aa45
I20260928 20:02:28.150722 26234 catalog_manager.cc:6934] ReplaceTablet: tablet b2e2b9af466b474bb4bda5d4b246aa45 deleted and replaced by tablet 03370aeac73549a195a16382aa6f9de3
I20260928 20:02:28.155911 27073 tablet.cc:1751] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:28.153859 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]). Expected version 1 got 0
I20260928 20:02:28.156905 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 with delete_type TABLET_DATA_DELETED (replaced by tablet 03370aeac73549a195a16382aa6f9de3) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.159291 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]). Expected version 1 got 0
I20260928 20:02:28.160347 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 8c4bfa1d40a346ba9d4c60728c243647
I20260928 20:02:28.164011 26913 ts_tablet_manager.cc:1480] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.088s user 0.007s sys 0.000s
I20260928 20:02:28.164849 26913 tablet_bootstrap.cc:492] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:28.164804 26236 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]). Expected version 1 got 0
I20260928 20:02:28.167407 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]). Expected version 1 got 0
I20260928 20:02:28.168161 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]). Expected version 1 got 0
I20260928 20:02:28.168244 27010 ts_tablet_manager.cc:1975] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:28.168591 27010 log.cc:1199] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/7e27a1855f8e4425ad51fba9025c5174
I20260928 20:02:28.169267 27010 ts_tablet_manager.cc:1996] T 7e27a1855f8e4425ad51fba9025c5174 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:28.170928 27053 raft_consensus.cc:493] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.171347 27053 raft_consensus.cc:515] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:28.173288 27053 leader_election.cc:290] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:28.175539 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8bbd88762641c7ad49db92fc116b4f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:28.176326 26659 raft_consensus.cc:2393] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:28.182067 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.182792 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 with delete_type TABLET_DATA_DELETED (replaced by tablet 03370aeac73549a195a16382aa6f9de3) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.183188 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 6d8bbd88762641c7ad49db92fc116b4f (table default.Table_d38019b8225f48d7ae6cded1a37dd923 [id=ccf8d181f86a4deeac64646304c637e3]) successfully deleted
I20260928 20:02:28.183559 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:27 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.185585 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:27 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.186190 27009 tablet_replica.cc:333] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:28.187067 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d8bbd88762641c7ad49db92fc116b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:26 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.187117 27009 raft_consensus.cc:2243] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.187638 27009 raft_consensus.cc:2272] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.188445 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 with delete_type TABLET_DATA_DELETED (replaced by tablet 03370aeac73549a195a16382aa6f9de3) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.148175 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_013206933b0d4b2b9165cc1216c6f2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:28.188848 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:27 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:28.190063 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_013206933b0d4b2b9165cc1216c6f2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:28.190850 26740 leader_election.cc:343] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 6d8bbd88762641c7ad49db92fc116b4f
I20260928 20:02:28.191226 26740 leader_election.cc:304] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:28.192188 27053 raft_consensus.cc:3060] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.195747 26633 tablet_service.cc:1511] Processing CreateTablet for tablet e162b25e0db14a35bfe6657f620affdb (DEFAULT_TABLE table=default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.197219 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e162b25e0db14a35bfe6657f620affdb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:28.197485 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet a4df1bab40024f97a5ad5acf358e3c26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4df1bab40024f97a5ad5acf358e3c26 already in progress: creating tablet
I20260928 20:02:28.198485 27008 raft_consensus.cc:493] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.199065 27008 raft_consensus.cc:515] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.201233 27008 leader_election.cc:290] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:28.201318 27053 raft_consensus.cc:2749] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:28.202416 26912 tablet_bootstrap.cc:492] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:28.202984 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 29a489266ffc47a498e8541408a1f6a2 (DEFAULT_TABLE table=default.Table_2c0586b4eade4864849f11f68ed45467 [id=10827de24c9348b8a73fb743b32a9188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.204043 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a489266ffc47a498e8541408a1f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.207249 27009 ts_tablet_manager.cc:1962] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.207861 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a489266ffc47a498e8541408a1f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.204771 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7f275a96cadb4937b6e221953176c523"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:28.213378 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f275a96cadb4937b6e221953176c523 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.216833 26784 tablet_service.cc:1511] Processing CreateTablet for tablet e162b25e0db14a35bfe6657f620affdb (DEFAULT_TABLE table=default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.217131 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet d27a3bd58866482f80fae7afe0ad48d7
I20260928 20:02:28.217798 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e162b25e0db14a35bfe6657f620affdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.218616 26229 catalog_manager.cc:6934] ReplaceTablet: tablet d27a3bd58866482f80fae7afe0ad48d7 deleted and replaced by tablet caf030c329e64d208a3f507804edbd54
I20260928 20:02:28.221302 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 with delete_type TABLET_DATA_DELETED (replaced by tablet caf030c329e64d208a3f507804edbd54) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.224790 27010 tablet_replica.cc:333] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:28.225924 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 with delete_type TABLET_DATA_DELETED (replaced by tablet caf030c329e64d208a3f507804edbd54) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.226967 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fb67972a9c71416faf4f741a20f47b06" } new_table_name: "default.Table_86b3bc9639cc4c559abb3772910430a7" modify_external_catalogs: true
W20260928 20:02:28.227332 26450 leader_election.cc:343] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.230727 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 with delete_type TABLET_DATA_DELETED (replaced by tablet caf030c329e64d208a3f507804edbd54) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.231078 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a3bd58866482f80fae7afe0ad48d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:28.225641 27010 raft_consensus.cc:2243] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:28.234653 26450 leader_election.cc:343] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.234789 27010 raft_consensus.cc:2272] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.242502 27010 ts_tablet_manager.cc:1962] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.245268 26912 tablet_bootstrap.cc:654] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.247244 27074 raft_consensus.cc:515] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.247759 26916 tablet_bootstrap.cc:492] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:28.248116 26916 ts_tablet_manager.cc:1449] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.296s user 0.024s sys 0.051s
I20260928 20:02:28.250612 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba87a379ae6a4feabfbc9fd6ba2d488e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:28.250985 26916 raft_consensus.cc:359] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.251582 26916 raft_consensus.cc:385] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.252705 26495 tablet_service.cc:1511] Processing CreateTablet for tablet e162b25e0db14a35bfe6657f620affdb (DEFAULT_TABLE table=default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.253628 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e162b25e0db14a35bfe6657f620affdb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:28.255396 26450 leader_election.cc:343] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.259526 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27a3bd58866482f80fae7afe0ad48d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:28.261256 26229 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e815b1a62974067bf6edfbccc3b0d81 has no consensus state
W20260928 20:02:28.263217 26450 leader_election.cc:343] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.263603 26450 leader_election.cc:304] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:28.252275 26916 raft_consensus.cc:740] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.273231 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6f6393f79f38418e8831658c89026a7a" } new_table_name: "default.Table_1020721d72be4939981ee823fd491385" modify_external_catalogs: true
I20260928 20:02:28.276057 26916 consensus_queue.cc:260] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.286083 27070 tablet.cc:1751] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:28.288928 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 (DEFAULT_TABLE table=default.Table_6f6393f79f38418e8831658c89026a7a [id=595b27bd872444779dc921821e18648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.290222 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abc6a2ae4984413be9ba769d42dc072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.295374 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 (DEFAULT_TABLE table=default.Table_6f6393f79f38418e8831658c89026a7a [id=595b27bd872444779dc921821e18648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.296494 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abc6a2ae4984413be9ba769d42dc072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.298378 26231 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06] alter complete (version 1)
I20260928 20:02:28.299777 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 57189d2450924921aecc1ee81c1cb952 (DEFAULT_TABLE table=default.Table_6239910b69934cbbb9e960245e388e02 [id=a6bf9e2083eb4fa7b7e44135ce5f7fdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.300845 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57189d2450924921aecc1ee81c1cb952. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:28.310976 26229 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6abc6a2ae4984413be9ba769d42dc072 consensus state has no leader
I20260928 20:02:28.317598 26913 tablet_bootstrap.cc:654] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.321640 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 57189d2450924921aecc1ee81c1cb952 (DEFAULT_TABLE table=default.Table_6239910b69934cbbb9e960245e388e02 [id=a6bf9e2083eb4fa7b7e44135ce5f7fdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.318427 27008 raft_consensus.cc:2749] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:28.322445 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 (DEFAULT_TABLE table=default.Table_6f6393f79f38418e8831658c89026a7a [id=595b27bd872444779dc921821e18648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.324255 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abc6a2ae4984413be9ba769d42dc072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.324559 27074 leader_election.cc:290] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:28.324054 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 60868.9us
I20260928 20:02:28.324793 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 57189d2450924921aecc1ee81c1cb952 (DEFAULT_TABLE table=default.Table_6239910b69934cbbb9e960245e388e02 [id=a6bf9e2083eb4fa7b7e44135ce5f7fdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.325830 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57189d2450924921aecc1ee81c1cb952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.328956 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba87a379ae6a4feabfbc9fd6ba2d488e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:28.333431 26801 raft_consensus.cc:3060] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:28.348608 26595 consensus_peers.cc:597] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e27a1855f8e4425ad51fba9025c5174. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:28.348939 27074 consensus_queue.cc:1048] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:28.351085 26916 ts_tablet_manager.cc:1480] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.103s user 0.007s sys 0.001s
I20260928 20:02:28.360311 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42] alter complete (version 1)
I20260928 20:02:28.364300 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_654238d4e0904888886070248583950a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:28.365839 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_654238d4e0904888886070248583950a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.374601 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_86b3bc9639cc4c559abb3772910430a7" } modify_external_catalogs: true
I20260928 20:02:28.375335 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_86b3bc9639cc4c559abb3772910430a7" } modify_external_catalogs: true
I20260928 20:02:28.378149 26801 raft_consensus.cc:2468] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:28.386250 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57189d2450924921aecc1ee81c1cb952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.387782 27009 ts_tablet_manager.cc:1975] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:28.388238 27009 log.cc:1199] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b2e2b9af466b474bb4bda5d4b246aa45
I20260928 20:02:28.388926 27009 ts_tablet_manager.cc:1996] T b2e2b9af466b474bb4bda5d4b246aa45 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:28.392164 26916 tablet_bootstrap.cc:492] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:28.391966 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4adff15039a443e4a3b9450d5b0cc415"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:28.396803 26637 tablet_service.cc:1511] Processing CreateTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 (DEFAULT_TABLE table=default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.397878 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c0cc7bd109493cacf990dd1e2728f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.405898 26782 tablet_service.cc:1511] Processing CreateTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 (DEFAULT_TABLE table=default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.408327 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c0cc7bd109493cacf990dd1e2728f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.409250 26450 leader_election.cc:304] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:28.409981 27074 raft_consensus.cc:2804] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:28.410619 27074 raft_consensus.cc:697] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:28.412137 27074 consensus_queue.cc:237] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.415611 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_49cde204e2ef4ab9ad1024eb51d8d76e" } modify_external_catalogs: true
I20260928 20:02:28.416152 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_49cde204e2ef4ab9ad1024eb51d8d76e" } modify_external_catalogs: true
I20260928 20:02:28.427923 26913 tablet_bootstrap.cc:492] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:28.428323 26913 ts_tablet_manager.cc:1449] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.264s user 0.009s sys 0.000s
I20260928 20:02:28.428942 27045 consensus_queue.cc:1048] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:28.440208 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet b2e2b9af466b474bb4bda5d4b246aa45 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]) successfully deleted
I20260928 20:02:28.445793 26916 tablet_bootstrap.cc:654] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.453044 27009 tablet_replica.cc:333] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:28.454308 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4adff15039a443e4a3b9450d5b0cc415 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.455847 26913 raft_consensus.cc:359] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.449913 26228 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 8e815b1a62974067bf6edfbccc3b0d81
I20260928 20:02:28.460604 26912 tablet_bootstrap.cc:492] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:28.461283 26912 ts_tablet_manager.cc:1449] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.259s user 0.007s sys 0.004s
I20260928 20:02:28.463097 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 39fb6f22905945578fa74b671d31c5f3 (DEFAULT_TABLE table=default.Table_6eec7cf0b6d741809b9b24d3e5ea216e [id=eee23e85c2fc4db288997e5ce89850ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.464828 27010 ts_tablet_manager.cc:1975] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:28.468958 27009 raft_consensus.cc:2243] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:28.474433 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fb6f22905945578fa74b671d31c5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.474956 27010 log.cc:1199] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/f87b70e9dcf04ba7915e1f5124aa36e2
I20260928 20:02:28.476099 27010 ts_tablet_manager.cc:1996] T f87b70e9dcf04ba7915e1f5124aa36e2 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:28.479925 27009 raft_consensus.cc:2272] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.481122 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]) successfully deleted
I20260928 20:02:28.481791 27010 tablet_replica.cc:333] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:02:28.482331 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet a4df1bab40024f97a5ad5acf358e3c26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4df1bab40024f97a5ad5acf358e3c26 already in progress: creating tablet
I20260928 20:02:28.482419 27009 ts_tablet_manager.cc:1962] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:28.482936 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet b2e2b9af466b474bb4bda5d4b246aa45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2e2b9af466b474bb4bda5d4b246aa45 already in progress: creating tablet
I20260928 20:02:28.490618 26913 raft_consensus.cc:385] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.490952 26913 raft_consensus.cc:740] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.491676 26913 consensus_queue.cc:260] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.491794 26494 tablet_service.cc:1511] Processing CreateTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 (DEFAULT_TABLE table=default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.493788 26913 ts_tablet_manager.cc:1480] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.065s user 0.007s sys 0.000s
I20260928 20:02:28.494627 26913 tablet_bootstrap.cc:492] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:28.499464 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c0cc7bd109493cacf990dd1e2728f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.504171 27011 ts_tablet_manager.cc:1975] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:28.504596 27011 log.cc:1199] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/665b24041d5e4348a28df63af1735312
I20260928 20:02:28.505306 27011 ts_tablet_manager.cc:1996] T 665b24041d5e4348a28df63af1735312 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:28.507571 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 35) took 1164 ms. Trace:
I20260928 20:02:28.511689 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 39fb6f22905945578fa74b671d31c5f3 (DEFAULT_TABLE table=default.Table_6eec7cf0b6d741809b9b24d3e5ea216e [id=eee23e85c2fc4db288997e5ce89850ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.513015 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fb6f22905945578fa74b671d31c5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.466959 26912 raft_consensus.cc:359] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.516620 26912 raft_consensus.cc:385] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.516954 26912 raft_consensus.cc:740] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.517118 27011 rpcz_store.cc:276] 0928 20:02:27.343480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:27.345200 (+ 1720us) service_pool.cc:224] Handling call
0928 20:02:28.096614 (+751414us) ts_tablet_manager.cc:1197] Deleting tablet 665b24041d5e4348a28df63af1735312
0928 20:02:28.096677 (+ 63us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:28.397592 (+300915us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:28.504057 (+106465us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:28.507518 (+ 3461us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":735122}
I20260928 20:02:28.517705 26912 consensus_queue.cc:260] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.526853 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet d27a3bd58866482f80fae7afe0ad48d7 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:28.530448 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 39fb6f22905945578fa74b671d31c5f3 (DEFAULT_TABLE table=default.Table_6eec7cf0b6d741809b9b24d3e5ea216e [id=eee23e85c2fc4db288997e5ce89850ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.531530 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fb6f22905945578fa74b671d31c5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.537369 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 (DEFAULT_TABLE table=default.Table_b9d9cb7b957d4289b115bc082d8550e8 [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.538623 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882d1d6246dd4b3a81df5c57976ac631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.539268 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 (DEFAULT_TABLE table=default.Table_b9d9cb7b957d4289b115bc082d8550e8 [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.540343 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882d1d6246dd4b3a81df5c57976ac631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.543411 26781 tablet_service.cc:1511] Processing CreateTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 (DEFAULT_TABLE table=default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.544462 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d73fef88894a51b9fa04cb70e29d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.545579 26631 tablet_service.cc:1511] Processing CreateTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 (DEFAULT_TABLE table=default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.546528 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 665b24041d5e4348a28df63af1735312 (table default.Table_ab89e04c5b0e4a6c92b73c2d35b5ad30 [id=3124342cb4fb46c4bdfd465c3e582053]) successfully deleted
I20260928 20:02:28.547120 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d73fef88894a51b9fa04cb70e29d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.538131 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 (DEFAULT_TABLE table=default.Table_b9d9cb7b957d4289b115bc082d8550e8 [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.554883 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882d1d6246dd4b3a81df5c57976ac631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.555308 26912 ts_tablet_manager.cc:1480] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.094s user 0.004s sys 0.001s
I20260928 20:02:28.559518 27010 raft_consensus.cc:2243] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.560043 27010 raft_consensus.cc:2272] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.557819 27011 tablet_replica.cc:333] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:28.562826 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b9d9cb7b957d4289b115bc082d8550e8" } new_table_name: "default.Table_67bf18ee818a4291b2f1c8a0ff80078c" modify_external_catalogs: true
I20260928 20:02:28.563323 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6239910b69934cbbb9e960245e388e02" } new_table_name: "default.Table_43952762d1e746599a2d65da7c07de79" modify_external_catalogs: true
I20260928 20:02:28.564468 27011 raft_consensus.cc:2243] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.565435 27011 raft_consensus.cc:2272] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.570925 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_666ecf839a52492eaf418528a9d9f2cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:28.572456 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_666ecf839a52492eaf418528a9d9f2cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.576184 26916 tablet_bootstrap.cc:492] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:28.576604 26916 ts_tablet_manager.cc:1449] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.185s user 0.008s sys 0.008s
W20260928 20:02:28.577543 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8e815b1a62974067bf6edfbccc3b0d81 (table default.Table_86b3bc9639cc4c559abb3772910430a7 [id=1edcd231adf347d783301be79e65cb8c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e815b1a62974067bf6edfbccc3b0d81 has no consensus state
I20260928 20:02:28.578879 26916 raft_consensus.cc:359] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.579478 26916 raft_consensus.cc:385] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.579738 26916 raft_consensus.cc:740] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.583104 26233 master_service.cc:960] ReplaceTablet: received request to replace tablet 6abc6a2ae4984413be9ba769d42dc072 from {username='slave'} at 127.0.0.1:40138
W20260928 20:02:28.585757 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260928 20:02:28.589515 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260928 20:02:28.591826 26913 tablet_bootstrap.cc:654] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.592785 26231 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet ea54a8032b3d4479a48f6a0c899c5e86
I20260928 20:02:28.595955 27011 ts_tablet_manager.cc:1962] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.580322 26916 consensus_queue.cc:260] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:28.596719 26223 catalog_manager.cc:5136] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): alter failed for tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]),no further retry: Not found: Tablet not found: f87b70e9dcf04ba7915e1f5124aa36e2
I20260928 20:02:28.602165 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0c6396df18a447838b8edbf495c2f3dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:28.604529 26916 ts_tablet_manager.cc:1480] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.028s user 0.006s sys 0.001s
I20260928 20:02:28.604903 27053 raft_consensus.cc:493] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.605320 27053 raft_consensus.cc:515] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.607196 27053 leader_election.cc:290] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:28.608805 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:28.610664 26739 leader_election.cc:343] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.612190 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:28.612763 26516 raft_consensus.cc:2468] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:28.614022 26740 leader_election.cc:304] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:28.615123 27053 raft_consensus.cc:2804] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:28.615450 27053 raft_consensus.cc:493] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:28.615751 27053 raft_consensus.cc:3060] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.616510 26916 tablet_bootstrap.cc:492] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:28.624207 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57189d2450924921aecc1ee81c1cb952 consensus state has no leader
I20260928 20:02:28.630911 27074 raft_consensus.cc:493] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.631409 27074 raft_consensus.cc:515] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.632560 27053 raft_consensus.cc:515] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.633001 26916 tablet_bootstrap.cc:654] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.633227 27074 leader_election.cc:290] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:28.635123 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:28.636956 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:28.637355 26450 leader_election.cc:343] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.639576 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:28.640090 26516 raft_consensus.cc:3060] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.642444 27010 ts_tablet_manager.cc:1962] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.647048 26516 raft_consensus.cc:2468] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:28.648343 26740 leader_election.cc:304] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:28.650807 26913 tablet_bootstrap.cc:492] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:28.651997 26913 ts_tablet_manager.cc:1449] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.158s user 0.012s sys 0.000s
I20260928 20:02:28.652324 26912 tablet_bootstrap.cc:492] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:28.660319 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:28.662180 26495 tablet_service.cc:1511] Processing CreateTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 (DEFAULT_TABLE table=default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.663218 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d73fef88894a51b9fa04cb70e29d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.665162 27009 ts_tablet_manager.cc:1975] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:28.665989 27009 log.cc:1199] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/8c4bfa1d40a346ba9d4c60728c243647
W20260928 20:02:28.666714 26739 leader_election.cc:343] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.667253 26637 tablet_service.cc:1511] Processing CreateTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 (DEFAULT_TABLE table=default.Table_911e0630d48c4bd7b8f844cee768908b [id=cf711236531a4f2e82a29a160baa3b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.668285 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4f7ca1b194471bbad778ac4e89f6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.669124 27009 ts_tablet_manager.cc:1996] T 8c4bfa1d40a346ba9d4c60728c243647 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:28.668332 26230 catalog_manager.cc:5838] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
W20260928 20:02:28.673002 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c6396df18a447838b8edbf495c2f3dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.674505 26913 raft_consensus.cc:359] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.677317 27053 leader_election.cc:290] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:28.679400 27053 raft_consensus.cc:2804] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:28.681509 27053 raft_consensus.cc:697] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:28.682026 26779 tablet_service.cc:1511] Processing CreateTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 (DEFAULT_TABLE table=default.Table_911e0630d48c4bd7b8f844cee768908b [id=cf711236531a4f2e82a29a160baa3b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.682628 26913 raft_consensus.cc:385] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.684432 26913 raft_consensus.cc:740] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.684643 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4f7ca1b194471bbad778ac4e89f6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.693902 26491 tablet_service.cc:1511] Processing CreateTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 (DEFAULT_TABLE table=default.Table_911e0630d48c4bd7b8f844cee768908b [id=cf711236531a4f2e82a29a160baa3b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:28.694645 26913 consensus_queue.cc:260] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.695144 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4f7ca1b194471bbad778ac4e89f6c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:28.696121 27009 tablet_replica.cc:333] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:28.696784 27009 raft_consensus.cc:2243] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.697182 27009 raft_consensus.cc:2272] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.699259 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 8c4bfa1d40a346ba9d4c60728c243647 (table default.Table_5a9d98eec9c847f4bfa6de33dedf04dd [id=b710280fc0e54970a0283a2eaa9f2efc]) successfully deleted
I20260928 20:02:28.699255 27053 consensus_queue.cc:237] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.716336 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_786a5ea6a2f948a6ad4230ffaa356252"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:28.717175 27011 ts_tablet_manager.cc:1975] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:28.717561 27011 log.cc:1199] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/f87b70e9dcf04ba7915e1f5124aa36e2
W20260928 20:02:28.718192 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_786a5ea6a2f948a6ad4230ffaa356252 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.718649 26913 ts_tablet_manager.cc:1480] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.066s user 0.006s sys 0.001s
W20260928 20:02:28.718992 26450 leader_election.cc:343] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:28.719429 26450 leader_election.cc:304] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:28.720773 27074 raft_consensus.cc:2749] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:28.724099 26232 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_47107cc2ebe04af38af59a3a81e8dc62" } modify_external_catalogs: true
I20260928 20:02:28.724864 26232 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_47107cc2ebe04af38af59a3a81e8dc62" } modify_external_catalogs: true
I20260928 20:02:28.725809 26913 tablet_bootstrap.cc:492] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:28.728965 26916 tablet_bootstrap.cc:492] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:28.722275 27009 ts_tablet_manager.cc:1962] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.729386 26916 ts_tablet_manager.cc:1449] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.113s user 0.007s sys 0.003s
I20260928 20:02:28.740363 26916 raft_consensus.cc:359] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.741055 26916 raft_consensus.cc:385] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.741343 26916 raft_consensus.cc:740] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.742039 26916 consensus_queue.cc:260] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.745568 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_17646d9afe134fafb835619843fc9c55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:28.747334 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17646d9afe134fafb835619843fc9c55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:28.750427 26916 ts_tablet_manager.cc:1480] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260928 20:02:28.751282 26916 tablet_bootstrap.cc:492] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:28.758741 27011 ts_tablet_manager.cc:1996] T f87b70e9dcf04ba7915e1f5124aa36e2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:28.763976 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 40) took 1053 ms. Trace:
I20260928 20:02:28.768007 27011 rpcz_store.cc:276] 0928 20:02:27.710267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:27.712006 (+ 1739us) service_pool.cc:224] Handling call
0928 20:02:28.544642 (+832636us) ts_tablet_manager.cc:1197] Deleting tablet f87b70e9dcf04ba7915e1f5124aa36e2
0928 20:02:28.544729 (+ 87us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:28.676381 (+131652us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:28.717044 (+ 40663us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:28.763907 (+ 46863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":831999}
I20260928 20:02:28.768615 26912 tablet_bootstrap.cc:700] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Time spent opening tablet: real 0.111s user 0.003s sys 0.001s
I20260928 20:02:28.769258 27011 tablet_replica.cc:333] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:28.769379 26912 tablet_bootstrap.cc:654] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.769528 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet f87b70e9dcf04ba7915e1f5124aa36e2 (table default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]) successfully deleted
I20260928 20:02:28.765092 26913 tablet_bootstrap.cc:654] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.770020 27011 raft_consensus.cc:2243] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:28.778774 27011 pending_rounds.cc:70] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:28.779784 27011 pending_rounds.cc:77] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403060287610880 op_type: NO_OP noop_request { }
I20260928 20:02:28.780113 27009 ts_tablet_manager.cc:1975] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:28.780529 27009 log.cc:1199] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/d27a3bd58866482f80fae7afe0ad48d7
I20260928 20:02:28.780683 27011 raft_consensus.cc:2889] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:28.781172 27009 ts_tablet_manager.cc:1996] T d27a3bd58866482f80fae7afe0ad48d7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:28.781533 27011 raft_consensus.cc:2272] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.782656 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet d27a3bd58866482f80fae7afe0ad48d7 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]) successfully deleted
I20260928 20:02:28.796772 26231 master_service.cc:960] ReplaceTablet: received request to replace tablet d6c0cc7bd109493cacf990dd1e2728f0 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:28.801561 27011 ts_tablet_manager.cc:1962] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.812021 26916 tablet_bootstrap.cc:654] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.821525 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c3a7d9da79be4906b5e673b04b2b6b0a" } modify_external_catalogs: true
I20260928 20:02:28.822036 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c3a7d9da79be4906b5e673b04b2b6b0a" } modify_external_catalogs: true
I20260928 20:02:28.822688 27074 raft_consensus.cc:493] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.823128 27074 raft_consensus.cc:515] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.825116 27074 leader_election.cc:290] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:28.826918 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aeb153250d848c8bdc02b917f6c11a0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:28.827500 26801 raft_consensus.cc:2468] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:28.828819 26450 leader_election.cc:304] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:28.830325 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aeb153250d848c8bdc02b917f6c11a0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:28.831023 26659 raft_consensus.cc:2468] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:28.832590 27074 raft_consensus.cc:2804] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:28.832948 27074 raft_consensus.cc:493] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:28.833318 27074 raft_consensus.cc:3060] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.842530 27074 raft_consensus.cc:515] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:28.848651 26229 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 882d1d6246dd4b3a81df5c57976ac631 consensus state has no leader
I20260928 20:02:28.850257 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:28.851806 26233 catalog_manager.cc:6934] ReplaceTablet: tablet 6abc6a2ae4984413be9ba769d42dc072 deleted and replaced by tablet f2c365de7d204833aa9dfa4966f254cf
I20260928 20:02:28.852591 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.852626 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.853804 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.856091 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4aeb153250d848c8bdc02b917f6c11a0
I20260928 20:02:28.859066 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 4aeb153250d848c8bdc02b917f6c11a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.861187 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 4aeb153250d848c8bdc02b917f6c11a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.861493 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aeb153250d848c8bdc02b917f6c11a0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:28.861802 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 4aeb153250d848c8bdc02b917f6c11a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.862008 26659 raft_consensus.cc:3060] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.862406 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4bfa1d40a346ba9d4c60728c243647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:27 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.863655 27009 tablet_replica.cc:333] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:28.864311 27009 raft_consensus.cc:2243] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.864722 27009 raft_consensus.cc:2272] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:28.865540 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 6abc6a2ae4984413be9ba769d42dc072 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6abc6a2ae4984413be9ba769d42dc072 already in progress: creating tablet
I20260928 20:02:28.871203 26659 raft_consensus.cc:2468] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:28.872469 26450 leader_election.cc:304] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
W20260928 20:02:28.873044 26450 raft_consensus.cc:2686] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:28.875501 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aeb153250d848c8bdc02b917f6c11a0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:28.876027 26801 raft_consensus.cc:3060] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:28.878809 27074 leader_election.cc:290] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:28.879865 26916 tablet_bootstrap.cc:492] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:28.880228 26916 ts_tablet_manager.cc:1449] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.129s user 0.011s sys 0.007s
I20260928 20:02:28.881138 27009 ts_tablet_manager.cc:1962] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.882701 26916 raft_consensus.cc:359] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.883296 26916 raft_consensus.cc:385] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.883685 26916 raft_consensus.cc:740] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.884357 26916 consensus_queue.cc:260] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.888947 26916 ts_tablet_manager.cc:1480] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20260928 20:02:28.898077 26801 raft_consensus.cc:2468] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:28.898694 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet d6c0cc7bd109493cacf990dd1e2728f0
I20260928 20:02:28.900298 26231 catalog_manager.cc:6934] ReplaceTablet: tablet d6c0cc7bd109493cacf990dd1e2728f0 deleted and replaced by tablet ee464b814dbf4e4b89b2d1c019befac6
I20260928 20:02:28.901222 26913 tablet_bootstrap.cc:492] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:28.901623 26913 ts_tablet_manager.cc:1449] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.180s user 0.009s sys 0.006s
I20260928 20:02:28.902005 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_574c02870e14491dbd36bb31f00b3cc8" } new_table_name: "default.Table_073d3a55143c4c448dce7157adc7abf3" modify_external_catalogs: true
I20260928 20:02:28.902804 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee464b814dbf4e4b89b2d1c019befac6) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.903534 27010 ts_tablet_manager.cc:1975] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:28.903510 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee464b814dbf4e4b89b2d1c019befac6) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.903869 27010 log.cc:1199] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/8c4bfa1d40a346ba9d4c60728c243647
I20260928 20:02:28.904037 26913 raft_consensus.cc:359] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.905037 26913 raft_consensus.cc:385] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.905282 26913 raft_consensus.cc:740] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.906976 26912 tablet_bootstrap.cc:492] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:28.907343 26912 ts_tablet_manager.cc:1449] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.255s user 0.011s sys 0.002s
I20260928 20:02:28.908943 27009 ts_tablet_manager.cc:1975] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:28.911096 26912 raft_consensus.cc:359] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.911702 26912 raft_consensus.cc:385] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.911963 26912 raft_consensus.cc:740] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.920497 27010 ts_tablet_manager.cc:1996] T 8c4bfa1d40a346ba9d4c60728c243647 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:28.905885 26913 consensus_queue.cc:260] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.927541 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 8c4bfa1d40a346ba9d4c60728c243647 (table default.Table_5a9d98eec9c847f4bfa6de33dedf04dd [id=b710280fc0e54970a0283a2eaa9f2efc]) successfully deleted
I20260928 20:02:28.913875 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee464b814dbf4e4b89b2d1c019befac6) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.912607 26912 consensus_queue.cc:260] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.928289 27009 log.cc:1199] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4aeb153250d848c8bdc02b917f6c11a0
I20260928 20:02:28.938798 26913 ts_tablet_manager.cc:1480] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.037s user 0.004s sys 0.004s
I20260928 20:02:28.941243 27009 ts_tablet_manager.cc:1996] T 4aeb153250d848c8bdc02b917f6c11a0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:28.914707 26916 tablet_bootstrap.cc:492] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:28.944777 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 8a74c26724ae484a972944f96cc566c3
I20260928 20:02:28.944826 27018 raft_consensus.cc:493] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:28.945246 27018 raft_consensus.cc:515] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.947240 26913 tablet_bootstrap.cc:492] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:28.947607 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a74c26724ae484a972944f96cc566c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:28.950759 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a74c26724ae484a972944f96cc566c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:28.952836 26916 tablet_bootstrap.cc:654] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:28.951536 27018 leader_election.cc:290] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:28.938278 26912 ts_tablet_manager.cc:1480] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.031s user 0.006s sys 0.001s
I20260928 20:02:28.963117 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 4aeb153250d848c8bdc02b917f6c11a0 (table default.Table_47107cc2ebe04af38af59a3a81e8dc62 [id=0957feb93a5345938705f3b7a3ec8394]) successfully deleted
I20260928 20:02:28.964340 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:28.964823 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 8c4bfa1d40a346ba9d4c60728c243647 because the tablet was not found. No further retry: Not found: Tablet not found: 8c4bfa1d40a346ba9d4c60728c243647
I20260928 20:02:28.969254 27010 tablet_replica.cc:333] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:28.970613 27011 ts_tablet_manager.cc:1975] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 20:02:28.972154 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet d6c0cc7bd109493cacf990dd1e2728f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6c0cc7bd109493cacf990dd1e2728f0 already in progress: creating tablet
I20260928 20:02:28.972398 27010 raft_consensus.cc:2243] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:28.973444 27010 raft_consensus.cc:2272] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.974907 27009 tablet_replica.cc:333] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:28.977039 26916 tablet_bootstrap.cc:492] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:28.978412 26916 ts_tablet_manager.cc:1449] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.009s
I20260928 20:02:28.981160 27009 raft_consensus.cc:2243] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:28.983531 27009 raft_consensus.cc:2272] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:28.982371 26916 raft_consensus.cc:359] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.986423 26916 raft_consensus.cc:385] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:28.986703 26916 raft_consensus.cc:740] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:28.987412 27010 ts_tablet_manager.cc:1962] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:28.988446 26916 consensus_queue.cc:260] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:28.985580 26912 tablet_bootstrap.cc:492] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:28.991513 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d16f263a4d439b98ea11156f4997fe" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:28.992240 26515 raft_consensus.cc:2393] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:28.993006 26916 ts_tablet_manager.cc:1480] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260928 20:02:28.999393 27011 log.cc:1199] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/7e27a1855f8e4425ad51fba9025c5174
I20260928 20:02:28.989991 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a74c26724ae484a972944f96cc566c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:28.994436 26595 leader_election.cc:304] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:29.003155 27011 ts_tablet_manager.cc:1996] T 7e27a1855f8e4425ad51fba9025c5174 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:28.995754 27009 ts_tablet_manager.cc:1962] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.003679 27102 raft_consensus.cc:3060] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.009927 26912 tablet_bootstrap.cc:654] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.011449 26916 tablet_bootstrap.cc:492] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:29.013571 27102 raft_consensus.cc:2749] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:29.017443 26916 tablet_bootstrap.cc:654] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.027050 26912 tablet_bootstrap.cc:492] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:28.988817 26913 tablet_bootstrap.cc:654] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.029625 26912 ts_tablet_manager.cc:1449] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.007s
I20260928 20:02:29.030791 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f55cc836b1a4436baefce92d942dc0ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:29.016320 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 41) took 1304 ms. Trace:
I20260928 20:02:29.031430 27011 rpcz_store.cc:276] 0928 20:02:27.712019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:27.712893 (+ 874us) service_pool.cc:224] Handling call
0928 20:02:28.769097 (+1056204us) ts_tablet_manager.cc:1197] Deleting tablet 7e27a1855f8e4425ad51fba9025c5174
0928 20:02:28.769141 (+ 44us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:28.923351 (+154210us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:28.970501 (+ 47150us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.016255 (+ 45754us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1055665}
I20260928 20:02:29.031956 26912 raft_consensus.cc:359] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:29.032300 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f55cc836b1a4436baefce92d942dc0ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.032547 26912 raft_consensus.cc:385] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.032783 26912 raft_consensus.cc:740] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.033154 27011 tablet_replica.cc:333] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:29.033886 27011 raft_consensus.cc:2243] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.034391 27011 raft_consensus.cc:2272] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.035948 27011 ts_tablet_manager.cc:1962] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.040815 26912 consensus_queue.cc:260] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.048352 27102 raft_consensus.cc:493] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.048775 27102 raft_consensus.cc:515] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:29.052884 26595 leader_election.cc:343] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b2e2b9af466b474bb4bda5d4b246aa45
I20260928 20:02:29.054630 27102 leader_election.cc:290] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.056391 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2b9af466b474bb4bda5d4b246aa45" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:29.056618 26231 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_74657ad59de141059b3292c1b529868c" } new_table_name: "default.Table_08b55d52f8a64fba90ccea539ecd0681" modify_external_catalogs: true
I20260928 20:02:29.057008 26801 raft_consensus.cc:2468] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:29.058303 26594 leader_election.cc:304] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:29.059636 27010 ts_tablet_manager.cc:1975] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:29.060034 27010 log.cc:1199] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/6d8bbd88762641c7ad49db92fc116b4f
I20260928 20:02:29.060774 27010 ts_tablet_manager.cc:1996] T 6d8bbd88762641c7ad49db92fc116b4f P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:29.063313 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 6d8bbd88762641c7ad49db92fc116b4f (table default.Table_d38019b8225f48d7ae6cded1a37dd923 [id=ccf8d181f86a4deeac64646304c637e3]) successfully deleted
I20260928 20:02:29.054468 26912 ts_tablet_manager.cc:1480] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260928 20:02:29.067974 27102 raft_consensus.cc:2804] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:29.070503 26913 tablet_bootstrap.cc:492] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:29.070919 26913 ts_tablet_manager.cc:1449] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.124s user 0.012s sys 0.000s
I20260928 20:02:29.072500 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_15ea4a6742b5444593f1f985deb10b73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:29.072970 26912 tablet_bootstrap.cc:492] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:29.074297 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15ea4a6742b5444593f1f985deb10b73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.080473 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e37f5f95bc984b27b7fb29e83e336618" } modify_external_catalogs: true
I20260928 20:02:29.080996 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e37f5f95bc984b27b7fb29e83e336618" } modify_external_catalogs: true
I20260928 20:02:29.068300 27102 raft_consensus.cc:493] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:29.082252 27102 raft_consensus.cc:3060] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.082974 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet 882d1d6246dd4b3a81df5c57976ac631 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:29.087425 27010 tablet_replica.cc:333] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:29.088194 26916 tablet_bootstrap.cc:492] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:29.088301 27010 raft_consensus.cc:2243] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.088580 26916 ts_tablet_manager.cc:1449] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.011s
I20260928 20:02:29.088855 27010 raft_consensus.cc:2272] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.090842 27010 ts_tablet_manager.cc:1962] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.090792 26916 raft_consensus.cc:359] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.091347 26916 raft_consensus.cc:385] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.091576 26916 raft_consensus.cc:740] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.073810 26913 raft_consensus.cc:359] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.094465 26912 tablet_bootstrap.cc:654] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.094527 26913 raft_consensus.cc:385] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.094780 26913 raft_consensus.cc:740] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.095360 26913 consensus_queue.cc:260] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.096002 26916 consensus_queue.cc:260] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.101035 26913 ts_tablet_manager.cc:1480] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
W20260928 20:02:29.102272 26231 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b22118c942324613837c489142d129fa has no consensus state
I20260928 20:02:29.104054 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8b0494f6646c4da3a2555b1b10dfe6d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:29.105801 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b0494f6646c4da3a2555b1b10dfe6d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.114861 26916 ts_tablet_manager.cc:1480] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.026s user 0.006s sys 0.001s
I20260928 20:02:29.121855 26231 master_service.cc:960] ReplaceTablet: received request to replace tablet 30e47366cc02478290e02df5cb984691 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:29.125337 26913 tablet_bootstrap.cc:492] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:29.104913 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_66c47969a2564431967a2c6b50f7cd03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:29.128343 27009 ts_tablet_manager.cc:1975] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:29.129428 26912 tablet_bootstrap.cc:492] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:29.129822 26912 ts_tablet_manager.cc:1449] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.003s
I20260928 20:02:29.130767 26916 tablet_bootstrap.cc:492] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:29.131559 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66c47969a2564431967a2c6b50f7cd03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.132139 26912 raft_consensus.cc:359] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.132751 26912 raft_consensus.cc:385] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.132992 26912 raft_consensus.cc:740] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.133876 26912 consensus_queue.cc:260] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.134799 27102 raft_consensus.cc:515] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.136891 26916 tablet_bootstrap.cc:654] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.128701 27009 log.cc:1199] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/8a74c26724ae484a972944f96cc566c3
I20260928 20:02:29.140875 27009 ts_tablet_manager.cc:1996] T 8a74c26724ae484a972944f96cc566c3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:29.147322 26912 ts_tablet_manager.cc:1480] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.017s user 0.004s sys 0.001s
I20260928 20:02:29.143311 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]) successfully deleted
I20260928 20:02:29.157531 26912 tablet_bootstrap.cc:492] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:29.160207 27010 ts_tablet_manager.cc:1975] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:29.160566 27010 log.cc:1199] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/d27a3bd58866482f80fae7afe0ad48d7
I20260928 20:02:29.161181 27010 ts_tablet_manager.cc:1996] T d27a3bd58866482f80fae7afe0ad48d7 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:02:29.161454 26595 leader_election.cc:343] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b2e2b9af466b474bb4bda5d4b246aa45
I20260928 20:02:29.162406 27102 leader_election.cc:290] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.163645 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2e2b9af466b474bb4bda5d4b246aa45" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:29.164165 26801 raft_consensus.cc:3060] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.166846 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_43952762d1e746599a2d65da7c07de79" } modify_external_catalogs: true
I20260928 20:02:29.167519 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_43952762d1e746599a2d65da7c07de79" } modify_external_catalogs: true
I20260928 20:02:29.171418 26801 raft_consensus.cc:2468] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:29.172704 26594 leader_election.cc:304] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:29.173568 27074 raft_consensus.cc:493] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.174002 27074 raft_consensus.cc:515] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.175877 27074 leader_election.cc:290] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.178251 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e162b25e0db14a35bfe6657f620affdb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:29.179523 26916 tablet_bootstrap.cc:492] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:29.179626 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet d27a3bd58866482f80fae7afe0ad48d7 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]) successfully deleted
I20260928 20:02:29.179949 26916 ts_tablet_manager.cc:1449] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.006s
W20260928 20:02:29.179819 26450 leader_election.cc:343] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.180157 27018 raft_consensus.cc:2804] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:29.180246 27102 raft_consensus.cc:493] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.180708 27102 raft_consensus.cc:515] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.182538 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e162b25e0db14a35bfe6657f620affdb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:29.182583 26916 raft_consensus.cc:359] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.183167 26916 raft_consensus.cc:385] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.183418 26916 raft_consensus.cc:740] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:02:29.183879 26450 leader_election.cc:343] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.184015 26916 consensus_queue.cc:260] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.184284 26450 leader_election.cc:304] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:29.185315 26913 tablet_bootstrap.cc:654] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.185707 27008 raft_consensus.cc:2749] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:29.188135 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:29.188730 26515 raft_consensus.cc:2468] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:29.190030 26595 leader_election.cc:304] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
W20260928 20:02:29.192699 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 6abc6a2ae4984413be9ba769d42dc072 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6abc6a2ae4984413be9ba769d42dc072 already in progress: creating tablet
I20260928 20:02:29.196511 27102 leader_election.cc:290] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.199998 26916 ts_tablet_manager.cc:1480] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260928 20:02:29.199553 27011 ts_tablet_manager.cc:1975] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:29.201203 27011 log.cc:1199] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/6d8bbd88762641c7ad49db92fc116b4f
I20260928 20:02:29.204625 27011 ts_tablet_manager.cc:1996] T 6d8bbd88762641c7ad49db92fc116b4f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:29.204939 27018 raft_consensus.cc:697] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:29.205408 27110 raft_consensus.cc:2804] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:29.205762 27110 raft_consensus.cc:493] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:29.206593 27110 raft_consensus.cc:3060] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.208681 27018 consensus_queue.cc:237] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.197751 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:29.210541 26916 tablet_bootstrap.cc:492] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:29.211725 26594 leader_election.cc:343] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.198676 27010 tablet_replica.cc:333] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:29.213680 27010 raft_consensus.cc:2243] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.214184 27010 raft_consensus.cc:2272] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.216049 27010 ts_tablet_manager.cc:1962] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.216252 26916 tablet_bootstrap.cc:654] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.218552 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 42) took 1231 ms. Trace:
I20260928 20:02:29.190068 26912 tablet_bootstrap.cc:654] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.218863 27011 rpcz_store.cc:276] 0928 20:02:27.986812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:27.987062 (+ 250us) service_pool.cc:224] Handling call
0928 20:02:29.033004 (+1045942us) ts_tablet_manager.cc:1197] Deleting tablet 6d8bbd88762641c7ad49db92fc116b4f
0928 20:02:29.033052 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:29.116380 (+ 83328us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.199438 (+ 83058us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.218490 (+ 19052us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045287}
I20260928 20:02:29.222761 26229 catalog_manager.cc:5838] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:29.226903 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 6d8bbd88762641c7ad49db92fc116b4f (table default.Table_d38019b8225f48d7ae6cded1a37dd923 [id=ccf8d181f86a4deeac64646304c637e3]) successfully deleted
I20260928 20:02:29.228057 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 45) took 1081 ms. Trace:
I20260928 20:02:29.228371 27011 rpcz_store.cc:276] 0928 20:02:28.146738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.146854 (+ 116us) service_pool.cc:224] Handling call
0928 20:02:29.227744 (+1080890us) ts_tablet_manager.cc:1197] Deleting tablet a4df1bab40024f97a5ad5acf358e3c26
0928 20:02:29.227778 (+ 34us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:29.227997 (+ 219us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1080271}
I20260928 20:02:29.236545 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 8147a650aa614b2fb0af08077e60ddc8 (DEFAULT_TABLE table=default.Table_4adff15039a443e4a3b9450d5b0cc415 [id=cbeeebe708654140b78d52a0bed4c6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.237614 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8147a650aa614b2fb0af08077e60ddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.233438 26913 tablet_bootstrap.cc:492] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:29.238489 26913 ts_tablet_manager.cc:1449] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.113s user 0.011s sys 0.001s
I20260928 20:02:29.240818 26913 raft_consensus.cc:359] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:29.242054 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet a4df1bab40024f97a5ad5acf358e3c26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4df1bab40024f97a5ad5acf358e3c26 already in progress: creating tablet
I20260928 20:02:29.249015 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 8147a650aa614b2fb0af08077e60ddc8 (DEFAULT_TABLE table=default.Table_4adff15039a443e4a3b9450d5b0cc415 [id=cbeeebe708654140b78d52a0bed4c6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.250065 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8147a650aa614b2fb0af08077e60ddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.253293 26912 tablet_bootstrap.cc:492] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:29.253707 26912 ts_tablet_manager.cc:1449] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.096s user 0.005s sys 0.005s
I20260928 20:02:29.256126 26912 raft_consensus.cc:359] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.242878 27011 tablet_replica.cc:333] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:29.241321 27110 raft_consensus.cc:515] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.263540 26912 raft_consensus.cc:385] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.241415 26913 raft_consensus.cc:385] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.263808 26912 raft_consensus.cc:740] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.263868 26913 raft_consensus.cc:740] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.264582 26913 consensus_queue.cc:260] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.265276 27074 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.265446 26912 consensus_queue.cc:260] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.265728 27074 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.267252 26913 ts_tablet_manager.cc:1480] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.028s user 0.003s sys 0.001s
I20260928 20:02:29.267565 27074 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.268079 26913 tablet_bootstrap.cc:492] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:29.269240 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:29.270886 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:29.271481 26801 raft_consensus.cc:2468] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
W20260928 20:02:29.272717 26450 leader_election.cc:343] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.272779 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:29.273411 26515 raft_consensus.cc:3060] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.273473 26450 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:29.274844 27074 raft_consensus.cc:2804] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:29.275162 27074 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:29.275442 27074 raft_consensus.cc:3060] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.280607 26515 raft_consensus.cc:2468] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:29.280803 26912 ts_tablet_manager.cc:1480] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260928 20:02:29.281289 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 30e47366cc02478290e02df5cb984691
I20260928 20:02:29.281641 26912 tablet_bootstrap.cc:492] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:29.283106 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e47366cc02478290e02df5cb984691 with delete_type TABLET_DATA_DELETED (replaced by tablet afceff93f6f9401f94bab3e376925d12) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:29.284369 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e47366cc02478290e02df5cb984691 with delete_type TABLET_DATA_DELETED (replaced by tablet afceff93f6f9401f94bab3e376925d12) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:29.285072 27009 tablet_replica.cc:333] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:29.285362 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:29.285764 27009 raft_consensus.cc:2243] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.286377 27009 raft_consensus.cc:2272] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:29.286775 26594 leader_election.cc:343] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.288511 27009 ts_tablet_manager.cc:1962] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.290073 27110 leader_election.cc:290] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.291425 26913 tablet_bootstrap.cc:654] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.292153 27053 raft_consensus.cc:493] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.292630 27053 raft_consensus.cc:515] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.294999 27053 leader_election.cc:290] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:29.296537 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca77e114c4d06bde1bcd862c8eccf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:29.297111 26659 raft_consensus.cc:2468] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:29.298321 26739 leader_election.cc:304] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:29.299582 26231 catalog_manager.cc:6934] ReplaceTablet: tablet 30e47366cc02478290e02df5cb984691 deleted and replaced by tablet afceff93f6f9401f94bab3e376925d12
I20260928 20:02:29.299546 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e47366cc02478290e02df5cb984691 with delete_type TABLET_DATA_DELETED (replaced by tablet afceff93f6f9401f94bab3e376925d12) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:29.300202 27053 raft_consensus.cc:2804] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:29.300251 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca77e114c4d06bde1bcd862c8eccf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:29.300599 27053 raft_consensus.cc:493] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:29.300911 27053 raft_consensus.cc:3060] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.300935 26515 raft_consensus.cc:2468] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:29.304916 26912 tablet_bootstrap.cc:654] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.306864 26595 leader_election.cc:304] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:29.308040 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:29.308454 27110 raft_consensus.cc:2804] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:29.309109 27110 raft_consensus.cc:697] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:29.312094 27110 consensus_queue.cc:237] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.314733 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 8147a650aa614b2fb0af08077e60ddc8 (DEFAULT_TABLE table=default.Table_4adff15039a443e4a3b9450d5b0cc415 [id=cbeeebe708654140b78d52a0bed4c6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.315791 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8147a650aa614b2fb0af08077e60ddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.316483 26779 tablet_service.cc:1511] Processing CreateTablet for tablet d5ed5998a6194061839143c4adf4d3d4 (DEFAULT_TABLE table=default.Table_654238d4e0904888886070248583950a [id=911769c45f044f3b8772d685b79d2e30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.316746 27053 raft_consensus.cc:515] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.317548 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ed5998a6194061839143c4adf4d3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.317991 26493 tablet_service.cc:1511] Processing CreateTablet for tablet d5ed5998a6194061839143c4adf4d3d4 (DEFAULT_TABLE table=default.Table_654238d4e0904888886070248583950a [id=911769c45f044f3b8772d685b79d2e30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.319074 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ed5998a6194061839143c4adf4d3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.320286 27074 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.331835 26913 tablet_bootstrap.cc:492] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:29.332269 26913 ts_tablet_manager.cc:1449] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.006s
I20260928 20:02:29.332975 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:29.334389 26450 leader_election.cc:343] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.335999 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8be4bac0846045f1b0438d588fe17c76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:29.338227 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8be4bac0846045f1b0438d588fe17c76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.338316 27011 raft_consensus.cc:2243] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:29.339433 27011 pending_rounds.cc:70] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:29.339679 27011 pending_rounds.cc:77] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403068777713664 op_type: NO_OP noop_request { }
I20260928 20:02:29.339982 27011 raft_consensus.cc:2889] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:29.340283 27011 raft_consensus.cc:2272] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.342517 26231 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d467734bfa0b4fc1bc617954ce95836e" } new_table_name: "default.Table_074d381c532c42e29a79dd9296e083a6" modify_external_catalogs: true
I20260928 20:02:29.343381 27011 ts_tablet_manager.cc:1962] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.343622 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:29.344151 26801 raft_consensus.cc:3060] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.351809 26801 raft_consensus.cc:2468] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:29.355201 27053 leader_election.cc:290] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:29.356406 26450 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:29.334544 27010 ts_tablet_manager.cc:1975] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:29.358273 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca77e114c4d06bde1bcd862c8eccf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:29.358608 27010 log.cc:1199] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4aeb153250d848c8bdc02b917f6c11a0
I20260928 20:02:29.358870 26659 raft_consensus.cc:3060] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.357365 27008 raft_consensus.cc:493] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.359319 27010 ts_tablet_manager.cc:1996] T 4aeb153250d848c8bdc02b917f6c11a0 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:29.359428 27008 raft_consensus.cc:515] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.361569 27008 leader_election.cc:290] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.357426 27074 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.362479 27008 raft_consensus.cc:2804] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:29.363077 27008 raft_consensus.cc:697] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:29.357358 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca77e114c4d06bde1bcd862c8eccf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:29.367187 26515 raft_consensus.cc:3060] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.366930 27008 consensus_queue.cc:237] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.376030 26515 raft_consensus.cc:2468] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:29.377553 26740 leader_election.cc:304] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:29.378500 27053 raft_consensus.cc:2804] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:29.378643 26659 raft_consensus.cc:2468] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:29.380618 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 4aeb153250d848c8bdc02b917f6c11a0 (table default.Table_47107cc2ebe04af38af59a3a81e8dc62 [id=0957feb93a5345938705f3b7a3ec8394]) successfully deleted
I20260928 20:02:29.383260 26916 tablet_bootstrap.cc:492] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:29.383668 26916 ts_tablet_manager.cc:1449] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.173s user 0.016s sys 0.005s
I20260928 20:02:29.383613 26913 raft_consensus.cc:359] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.386003 26916 raft_consensus.cc:359] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.387079 26916 raft_consensus.cc:385] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.387348 26916 raft_consensus.cc:740] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.387748 27053 raft_consensus.cc:697] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:29.388310 26916 consensus_queue.cc:260] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.385003 26631 tablet_service.cc:1511] Processing CreateTablet for tablet d5ed5998a6194061839143c4adf4d3d4 (DEFAULT_TABLE table=default.Table_654238d4e0904888886070248583950a [id=911769c45f044f3b8772d685b79d2e30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.389710 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ed5998a6194061839143c4adf4d3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.395117 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_9a3c09ef67584c93a83248d42b2bf91d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:29.399287 26913 raft_consensus.cc:385] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.399623 26913 raft_consensus.cc:740] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.406138 27010 tablet_replica.cc:333] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:29.406867 27010 raft_consensus.cc:2243] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.407352 27010 raft_consensus.cc:2272] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.409005 27010 ts_tablet_manager.cc:1962] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.407272 26913 consensus_queue.cc:260] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.388489 27053 consensus_queue.cc:237] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.415191 26913 ts_tablet_manager.cc:1480] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.083s user 0.007s sys 0.000s
I20260928 20:02:29.422446 26913 tablet_bootstrap.cc:492] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:29.425881 26916 ts_tablet_manager.cc:1480] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.042s user 0.005s sys 0.002s
W20260928 20:02:29.428473 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 72164.4us
I20260928 20:02:29.433928 27009 ts_tablet_manager.cc:1975] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:29.434589 27009 log.cc:1199] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/30e47366cc02478290e02df5cb984691
I20260928 20:02:29.435319 27009 ts_tablet_manager.cc:1996] T 30e47366cc02478290e02df5cb984691 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:29.439352 26913 tablet_bootstrap.cc:654] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.439443 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1bab40024f97a5ad5acf358e3c26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:29.441432 26450 leader_election.cc:343] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.442690 26916 tablet_bootstrap.cc:492] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:29.415558 27011 ts_tablet_manager.cc:1975] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:29.443768 27011 log.cc:1199] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/b2e2b9af466b474bb4bda5d4b246aa45
I20260928 20:02:29.444585 27011 ts_tablet_manager.cc:1996] T b2e2b9af466b474bb4bda5d4b246aa45 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:29.451486 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet d6c0cc7bd109493cacf990dd1e2728f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6c0cc7bd109493cacf990dd1e2728f0 already in progress: creating tablet
W20260928 20:02:29.452651 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a3c09ef67584c93a83248d42b2bf91d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.458858 26493 tablet_service.cc:1511] Processing CreateTablet for tablet d374d592fda8402faac70a923049c9ad (DEFAULT_TABLE table=default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.462713 26912 tablet_bootstrap.cc:492] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:29.463217 26912 ts_tablet_manager.cc:1449] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.182s user 0.005s sys 0.007s
I20260928 20:02:29.466598 26912 raft_consensus.cc:359] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.467213 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 46) took 1279 ms. Trace:
I20260928 20:02:29.467511 27011 rpcz_store.cc:276] 0928 20:02:28.188170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.188281 (+ 111us) service_pool.cc:224] Handling call
0928 20:02:29.242741 (+1054460us) ts_tablet_manager.cc:1197] Deleting tablet b2e2b9af466b474bb4bda5d4b246aa45
0928 20:02:29.242778 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:29.339027 (+ 96249us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54000825d4. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5dfc9d2b01 00007f5dfca71bf2 00007f5dfceb3c7c 00007f5dfdb1f06a 00007f5dfdb51080 00007f5dfdb374ad 00007f5dfdb37459 00007f5dfdb373e9 00007f5dfdb373b1 00007f5dfdb365dd 00000000005bd5a4
0928 20:02:29.353193 (+ 14166us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.415437 (+ 62244us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.467154 (+ 51717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171628928,"tablet-delete.queue_time_us":1053905}
I20260928 20:02:29.468672 27011 tablet_replica.cc:333] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:29.469319 27011 raft_consensus.cc:2243] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.469748 27011 raft_consensus.cc:2272] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.473580 27011 ts_tablet_manager.cc:1962] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.474021 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]) successfully deleted
I20260928 20:02:29.468142 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d374d592fda8402faac70a923049c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.475477 27009 tablet_replica.cc:333] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:29.471248 26779 tablet_service.cc:1511] Processing CreateTablet for tablet b22118c942324613837c489142d129fa (DEFAULT_TABLE table=default.Table_08b55d52f8a64fba90ccea539ecd0681 [id=21db6c1a209b49f9b0ea4f7dd7373814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.479270 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22118c942324613837c489142d129fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.488746 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 882d1d6246dd4b3a81df5c57976ac631
I20260928 20:02:29.490203 26912 raft_consensus.cc:385] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.490490 26912 raft_consensus.cc:740] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.491135 26912 consensus_queue.cc:260] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.493511 26912 ts_tablet_manager.cc:1480] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.030s user 0.005s sys 0.000s
I20260928 20:02:29.494333 26912 tablet_bootstrap.cc:492] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:29.496162 27009 raft_consensus.cc:2243] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.496625 27009 raft_consensus.cc:2272] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.498992 27009 ts_tablet_manager.cc:1962] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.505716 26228 catalog_manager.cc:6934] ReplaceTablet: tablet 882d1d6246dd4b3a81df5c57976ac631 deleted and replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac
I20260928 20:02:29.506134 26916 tablet_bootstrap.cc:654] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.506371 27119 consensus_queue.cc:1048] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:29.507205 26631 tablet_service.cc:1511] Processing CreateTablet for tablet d374d592fda8402faac70a923049c9ad (DEFAULT_TABLE table=default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.509127 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d374d592fda8402faac70a923049c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.514386 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:29.517870 26656 raft_consensus.cc:3060] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:29.528153 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:29.530292 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:29.531543 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet b2e2b9af466b474bb4bda5d4b246aa45 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]) successfully deleted
I20260928 20:02:29.535982 27119 consensus_queue.cc:1048] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:29.537428 26491 tablet_service.cc:1511] Processing CreateTablet for tablet b22118c942324613837c489142d129fa (DEFAULT_TABLE table=default.Table_08b55d52f8a64fba90ccea539ecd0681 [id=21db6c1a209b49f9b0ea4f7dd7373814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.538590 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22118c942324613837c489142d129fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.545261 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1bab40024f97a5ad5acf358e3c26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:29.551489 26450 leader_election.cc:343] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.552099 26450 leader_election.cc:304] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:29.552909 26450 raft_consensus.cc:2686] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:29.563510 26494 tablet_service.cc:1511] Processing CreateTablet for tablet d938ea61370c493585d01a30e7381695 (DEFAULT_TABLE table=default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.564709 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d938ea61370c493585d01a30e7381695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.574702 27018 raft_consensus.cc:493] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.575212 27018 raft_consensus.cc:515] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.577291 27018 leader_election.cc:290] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.577654 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:29.579715 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.582540 26659 raft_consensus.cc:1275] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260928 20:02:29.583406 26594 leader_election.cc:343] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: d27a3bd58866482f80fae7afe0ad48d7
W20260928 20:02:29.583935 26595 leader_election.cc:343] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d27a3bd58866482f80fae7afe0ad48d7
I20260928 20:02:29.584329 26595 leader_election.cc:304] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:29.585311 27110 raft_consensus.cc:2749] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:29.586516 27053 consensus_queue.cc:1048] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:29.587831 26515 raft_consensus.cc:1275] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:02:29.590335 27053 consensus_queue.cc:1048] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:29.597565 26913 tablet_bootstrap.cc:492] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:29.598065 26913 ts_tablet_manager.cc:1449] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.176s user 0.008s sys 0.001s
I20260928 20:02:29.600672 26913 raft_consensus.cc:359] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.601504 26913 raft_consensus.cc:385] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.601749 26913 raft_consensus.cc:740] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.602589 26913 consensus_queue.cc:260] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.603394 26783 tablet_service.cc:1511] Processing CreateTablet for tablet d374d592fda8402faac70a923049c9ad (DEFAULT_TABLE table=default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.604537 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d374d592fda8402faac70a923049c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.608388 26913 ts_tablet_manager.cc:1480] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20260928 20:02:29.612527 27010 ts_tablet_manager.cc:1975] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:29.613548 26913 tablet_bootstrap.cc:492] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:29.627561 26916 tablet_bootstrap.cc:492] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:29.629139 26631 tablet_service.cc:1511] Processing CreateTablet for tablet b22118c942324613837c489142d129fa (DEFAULT_TABLE table=default.Table_08b55d52f8a64fba90ccea539ecd0681 [id=21db6c1a209b49f9b0ea4f7dd7373814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.627964 26916 ts_tablet_manager.cc:1449] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.185s user 0.013s sys 0.000s
I20260928 20:02:29.630303 26232 catalog_manager.cc:5838] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:29.632082 26916 raft_consensus.cc:359] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.632692 26916 raft_consensus.cc:385] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.632925 26916 raft_consensus.cc:740] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.636516 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22118c942324613837c489142d129fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.638650 27010 log.cc:1199] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/8a74c26724ae484a972944f96cc566c3
I20260928 20:02:29.640875 27010 ts_tablet_manager.cc:1996] T 8a74c26724ae484a972944f96cc566c3 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:29.624812 26912 tablet_bootstrap.cc:654] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.629698 26779 tablet_service.cc:1511] Processing CreateTablet for tablet d938ea61370c493585d01a30e7381695 (DEFAULT_TABLE table=default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.645355 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d938ea61370c493585d01a30e7381695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.649729 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (DEFAULT_TABLE table=default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.650152 26637 tablet_service.cc:1511] Processing CreateTablet for tablet d938ea61370c493585d01a30e7381695 (DEFAULT_TABLE table=default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.650781 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.651237 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d938ea61370c493585d01a30e7381695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.659578 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (DEFAULT_TABLE table=default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.660571 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.659121 26913 tablet_bootstrap.cc:654] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.642356 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet 882d1d6246dd4b3a81df5c57976ac631 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:29.662837 26916 consensus_queue.cc:260] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.665633 27008 raft_consensus.cc:493] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.666072 27008 raft_consensus.cc:515] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.667922 27008 leader_election.cc:290] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.670857 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abc6a2ae4984413be9ba769d42dc072" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:29.674496 26450 leader_election.cc:343] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.682435 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abc6a2ae4984413be9ba769d42dc072" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:29.683871 26450 leader_election.cc:343] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.684285 26450 leader_election.cc:304] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:29.685288 27008 raft_consensus.cc:2749] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:29.690563 26916 ts_tablet_manager.cc:1480] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.061s user 0.005s sys 0.000s
I20260928 20:02:29.694072 27011 ts_tablet_manager.cc:1975] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:29.695639 26916 tablet_bootstrap.cc:492] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:29.698480 27010 tablet_replica.cc:333] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:29.697934 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]) successfully deleted
W20260928 20:02:29.701398 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a5d73fef88894a51b9fa04cb70e29d43 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a5d73fef88894a51b9fa04cb70e29d43 consensus state has no leader
I20260928 20:02:29.705281 27011 log.cc:1199] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/8c4bfa1d40a346ba9d4c60728c243647
I20260928 20:02:29.706015 26913 tablet_bootstrap.cc:492] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:29.710626 26913 ts_tablet_manager.cc:1449] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.097s user 0.010s sys 0.000s
I20260928 20:02:29.711345 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (DEFAULT_TABLE table=default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.711248 27011 ts_tablet_manager.cc:1996] T 8c4bfa1d40a346ba9d4c60728c243647 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:29.712448 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.734017 27010 raft_consensus.cc:2243] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.734730 27010 raft_consensus.cc:2272] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.736049 26913 raft_consensus.cc:359] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.736524 27010 ts_tablet_manager.cc:1962] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.736696 26913 raft_consensus.cc:385] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.736938 26913 raft_consensus.cc:740] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.707878 26912 tablet_bootstrap.cc:492] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:29.714534 26781 tablet_service.cc:1511] Processing CreateTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c (DEFAULT_TABLE table=default.Table_75d3d3007f5b4c929142c1ec075e54f0 [id=3ceaf958c5e445639a07fa279736ee9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.738396 26912 ts_tablet_manager.cc:1449] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.244s user 0.010s sys 0.002s
I20260928 20:02:29.739161 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b087dcc9d5be4a9e89c35c359a18ca5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.740000 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 47) took 1551 ms. Trace:
I20260928 20:02:29.740397 27011 rpcz_store.cc:276] 0928 20:02:28.188497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.188644 (+ 147us) service_pool.cc:224] Handling call
0928 20:02:29.468536 (+1279892us) ts_tablet_manager.cc:1197] Deleting tablet 8c4bfa1d40a346ba9d4c60728c243647
0928 20:02:29.468575 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:29.619757 (+151182us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.693840 (+ 74083us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.739652 (+ 45812us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1279149}
I20260928 20:02:29.742007 27011 tablet_replica.cc:333] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:29.742832 27011 raft_consensus.cc:2243] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:29.743291 27011 raft_consensus.cc:2272] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:29.745240 27011 ts_tablet_manager.cc:1962] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:29.750793 27142 tablet.cc:1751] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:29.755290 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 8c4bfa1d40a346ba9d4c60728c243647 (table default.Table_5a9d98eec9c847f4bfa6de33dedf04dd [id=b710280fc0e54970a0283a2eaa9f2efc]) successfully deleted
I20260928 20:02:29.757987 26913 consensus_queue.cc:260] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.760648 26913 ts_tablet_manager.cc:1480] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260928 20:02:29.761803 26913 tablet_bootstrap.cc:492] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:29.767961 27132 mvcc.cc:204] Tried to move back new op lower bound from 7334403070174490624 to 7334403066830376960. Current Snapshot: MvccSnapshot[applied={T|T < 7334403070174490624}]
I20260928 20:02:29.771463 26493 tablet_service.cc:1511] Processing CreateTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c (DEFAULT_TABLE table=default.Table_75d3d3007f5b4c929142c1ec075e54f0 [id=3ceaf958c5e445639a07fa279736ee9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.780992 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b087dcc9d5be4a9e89c35c359a18ca5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.788636 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_94bb7f9333bc4698ad05e23d6003988a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:29.791043 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94bb7f9333bc4698ad05e23d6003988a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:29.721961 26916 tablet_bootstrap.cc:654] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.797880 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 57189d2450924921aecc1ee81c1cb952
I20260928 20:02:29.804104 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 57189d2450924921aecc1ee81c1cb952 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:29.804349 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet a5d73fef88894a51b9fa04cb70e29d43 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:29.800113 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:29.809055 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:29.811028 26632 tablet_service.cc:1511] Processing CreateTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c (DEFAULT_TABLE table=default.Table_75d3d3007f5b4c929142c1ec075e54f0 [id=3ceaf958c5e445639a07fa279736ee9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.812386 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b087dcc9d5be4a9e89c35c359a18ca5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.820111 27118 raft_consensus.cc:493] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:29.820521 26780 tablet_service.cc:1511] Processing CreateTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c (DEFAULT_TABLE table=default.Table_e37f5f95bc984b27b7fb29e83e336618 [id=cc2e9040c8104d3195750b14c727965d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.820582 27118 raft_consensus.cc:515] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.826124 26494 tablet_service.cc:1511] Processing CreateTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c (DEFAULT_TABLE table=default.Table_e37f5f95bc984b27b7fb29e83e336618 [id=cc2e9040c8104d3195750b14c727965d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.829727 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb970d91179e48cdbbb1e32a3ca3171c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.834860 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57189d2450924921aecc1ee81c1cb952" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:29.836321 26450 leader_election.cc:343] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.836196 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 57189d2450924921aecc1ee81c1cb952 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:29.840152 27145 tablet.cc:1751] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:29.841929 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 57189d2450924921aecc1ee81c1cb952 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:29.842852 27118 leader_election.cc:290] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:29.843930 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57189d2450924921aecc1ee81c1cb952" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:29.845348 26450 leader_election.cc:343] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:29.845739 26450 leader_election.cc:304] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:29.849627 27118 raft_consensus.cc:2749] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:29.851576 26913 tablet_bootstrap.cc:654] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.844385 26637 tablet_service.cc:1511] Processing CreateTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c (DEFAULT_TABLE table=default.Table_e37f5f95bc984b27b7fb29e83e336618 [id=cc2e9040c8104d3195750b14c727965d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.864655 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 03370aeac73549a195a16382aa6f9de3 (DEFAULT_TABLE table=default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.865659 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb970d91179e48cdbbb1e32a3ca3171c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.866272 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03370aeac73549a195a16382aa6f9de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.875015 27009 ts_tablet_manager.cc:1975] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:29.875466 27009 log.cc:1199] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:29.876263 27009 ts_tablet_manager.cc:1996] T a4df1bab40024f97a5ad5acf358e3c26 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:29.877362 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:29.879635 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet a4df1bab40024f97a5ad5acf358e3c26 (table default.Table_560504da8c694a95a0b601d4f3998d96 [id=ee0ddf3f7b2c42bfb01a4a12edea45d0]) successfully deleted
W20260928 20:02:29.881151 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 882d1d6246dd4b3a81df5c57976ac631 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 882d1d6246dd4b3a81df5c57976ac631 already in progress: creating tablet
W20260928 20:02:29.882074 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet cb970d91179e48cdbbb1e32a3ca3171c because the tablet was not found. No further retry: Not found: Tablet not found: cb970d91179e48cdbbb1e32a3ca3171c
W20260928 20:02:29.888515 26594 consensus_peers.cc:597] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:29.888605 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6eec7cf0b6d741809b9b24d3e5ea216e" } new_table_name: "default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5" modify_external_catalogs: true
I20260928 20:02:29.890710 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:29.902803 26495 tablet_service.cc:1511] Processing CreateTablet for tablet caf030c329e64d208a3f507804edbd54 (DEFAULT_TABLE table=default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.905546 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 03370aeac73549a195a16382aa6f9de3 (DEFAULT_TABLE table=default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.907070 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03370aeac73549a195a16382aa6f9de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.909828 26492 tablet_service.cc:1511] Processing CreateTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 (DEFAULT_TABLE table=default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.912046 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 47bf3dd9ed054197b4208324938d96b0 (DEFAULT_TABLE table=default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.914168 26633 tablet_service.cc:1511] Processing CreateTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 (DEFAULT_TABLE table=default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.915278 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.928292 26916 tablet_bootstrap.cc:492] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:29.928427 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb970d91179e48cdbbb1e32a3ca3171c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.928732 26916 ts_tablet_manager.cc:1449] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.233s user 0.010s sys 0.000s
I20260928 20:02:29.931157 26916 raft_consensus.cc:359] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.931767 26916 raft_consensus.cc:385] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.932024 26916 raft_consensus.cc:740] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.936810 26637 tablet_service.cc:1511] Processing CreateTablet for tablet caf030c329e64d208a3f507804edbd54 (DEFAULT_TABLE table=default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.937057 26916 consensus_queue.cc:260] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.937883 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf030c329e64d208a3f507804edbd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.938316 26913 tablet_bootstrap.cc:492] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:29.941012 26913 ts_tablet_manager.cc:1449] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.179s user 0.012s sys 0.001s
I20260928 20:02:29.942797 26916 ts_tablet_manager.cc:1480] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260928 20:02:29.943531 26913 raft_consensus.cc:359] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.944196 26913 raft_consensus.cc:385] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.944440 26913 raft_consensus.cc:740] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.958814 26913 consensus_queue.cc:260] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:29.963945 26913 ts_tablet_manager.cc:1480] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260928 20:02:29.970499 26913 tablet_bootstrap.cc:492] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:29.970424 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 47bf3dd9ed054197b4208324938d96b0 (DEFAULT_TABLE table=default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:29.971508 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bf3dd9ed054197b4208324938d96b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.927394 26912 raft_consensus.cc:359] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.974624 26912 raft_consensus.cc:385] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:29.974987 26912 raft_consensus.cc:740] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:29.975749 26912 consensus_queue.cc:260] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:29.981251 26913 tablet_bootstrap.cc:654] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:29.988586 27009 tablet_replica.cc:333] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:29.989269 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf030c329e64d208a3f507804edbd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.998270 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:29.998347 26916 tablet_bootstrap.cc:492] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.002749 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bf3dd9ed054197b4208324938d96b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.007740 26916 tablet_bootstrap.cc:654] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.010540 27009 raft_consensus.cc:2243] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:30.011016 27009 raft_consensus.cc:2272] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.013296 27009 ts_tablet_manager.cc:1962] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.015614 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7b71cef2215d4ba9a0d4cdb625664604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:30.017810 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b71cef2215d4ba9a0d4cdb625664604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:30.048713 26229 master_service.cc:960] ReplaceTablet: received request to replace tablet d374d592fda8402faac70a923049c9ad from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:30.055184 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 03370aeac73549a195a16382aa6f9de3 (DEFAULT_TABLE table=default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.056291 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03370aeac73549a195a16382aa6f9de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.053092 26235 catalog_manager.cc:5838] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:30.061420 26233 catalog_manager.cc:5838] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:30.069175 27011 ts_tablet_manager.cc:1975] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.069244 26912 ts_tablet_manager.cc:1480] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.331s user 0.008s sys 0.004s
I20260928 20:02:30.070186 26912 tablet_bootstrap.cc:492] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:30.069541 27011 log.cc:1199] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/d27a3bd58866482f80fae7afe0ad48d7
I20260928 20:02:30.073647 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_66c47969a2564431967a2c6b50f7cd03" } modify_external_catalogs: true
I20260928 20:02:30.074165 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_66c47969a2564431967a2c6b50f7cd03" } modify_external_catalogs: true
I20260928 20:02:30.076228 27011 ts_tablet_manager.cc:1996] T d27a3bd58866482f80fae7afe0ad48d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:30.076870 26232 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1020721d72be4939981ee823fd491385" } modify_external_catalogs: true
I20260928 20:02:30.077308 26232 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1020721d72be4939981ee823fd491385" } modify_external_catalogs: true
I20260928 20:02:30.081363 27118 raft_consensus.cc:493] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.081794 27118 raft_consensus.cc:515] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.083237 26782 tablet_service.cc:1511] Processing CreateTablet for tablet caf030c329e64d208a3f507804edbd54 (DEFAULT_TABLE table=default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.083734 27118 leader_election.cc:290] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:30.084251 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf030c329e64d208a3f507804edbd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.084998 26784 tablet_service.cc:1511] Processing CreateTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 (DEFAULT_TABLE table=default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.085956 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.086319 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet b2e2b9af466b474bb4bda5d4b246aa45 with delete_type TABLET_DATA_DELETED (replaced by tablet 03370aeac73549a195a16382aa6f9de3) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:30.086758 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 47bf3dd9ed054197b4208324938d96b0 (DEFAULT_TABLE table=default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2 [id=474b74c08e6348da8e5de4405064735f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.087816 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bf3dd9ed054197b4208324938d96b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.053051 27141 tablet.cc:1751] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:30.093845 26913 tablet_bootstrap.cc:492] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:30.094270 26913 ts_tablet_manager.cc:1449] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.124s user 0.007s sys 0.004s
I20260928 20:02:30.094926 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:30.097076 26450 leader_election.cc:343] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.097149 26913 raft_consensus.cc:359] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.098253 26913 raft_consensus.cc:385] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.098515 26913 raft_consensus.cc:740] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.098878 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.100378 26656 raft_consensus.cc:1275] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260928 20:02:30.102676 26450 leader_election.cc:343] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.103032 26450 leader_election.cc:304] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.103888 27118 raft_consensus.cc:2749] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:30.104590 27121 consensus_queue.cc:1048] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 20:02:30.109201 26515 raft_consensus.cc:1275] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:02:30.112884 27121 consensus_queue.cc:1048] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:30.115857 26913 consensus_queue.cc:260] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:30.117689 26595 consensus_peers.cc:597] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30e47366cc02478290e02df5cb984691. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:30.123513 26916 tablet_bootstrap.cc:492] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.123967 26916 ts_tablet_manager.cc:1449] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.000s
I20260928 20:02:30.124509 26913 ts_tablet_manager.cc:1480] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260928 20:02:30.127202 26916 raft_consensus.cc:359] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.127931 26916 raft_consensus.cc:385] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.128199 26916 raft_consensus.cc:740] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.128808 26916 consensus_queue.cc:260] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.129407 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet a5d73fef88894a51b9fa04cb70e29d43
I20260928 20:02:30.131331 26230 catalog_manager.cc:6934] ReplaceTablet: tablet a5d73fef88894a51b9fa04cb70e29d43 deleted and replaced by tablet 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:30.134765 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 with delete_type TABLET_DATA_DELETED (replaced by tablet 8163815661694d70ba4c2e36a424eaa1) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:30.140091 27110 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.140527 27110 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.142510 27110 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:30.143252 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:30.145985 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.146708 26804 raft_consensus.cc:2393] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:30.146785 26912 tablet_bootstrap.cc:654] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.061919 27010 ts_tablet_manager.cc:1975] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:30.148720 27010 log.cc:1199] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/30e47366cc02478290e02df5cb984691
I20260928 20:02:30.148865 26595 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.149641 26913 tablet_bootstrap.cc:492] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:30.150035 27110 raft_consensus.cc:3060] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.154453 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 with delete_type TABLET_DATA_DELETED (replaced by tablet 8163815661694d70ba4c2e36a424eaa1) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:30.156366 26913 tablet_bootstrap.cc:654] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.159544 27110 raft_consensus.cc:2749] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:30.165239 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 with delete_type TABLET_DATA_DELETED (replaced by tablet 8163815661694d70ba4c2e36a424eaa1) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:30.149425 27010 ts_tablet_manager.cc:1996] T 30e47366cc02478290e02df5cb984691 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:30.169371 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 49) took 1847 ms. Trace:
I20260928 20:02:30.169672 27011 rpcz_store.cc:276] 0928 20:02:28.230452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.230572 (+ 120us) service_pool.cc:224] Handling call
0928 20:02:29.741840 (+1511268us) ts_tablet_manager.cc:1197] Deleting tablet d27a3bd58866482f80fae7afe0ad48d7
0928 20:02:29.741907 (+ 67us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:29.825890 (+ 83983us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.069062 (+243172us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.078064 (+ 9002us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1510670}
I20260928 20:02:30.170830 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet d27a3bd58866482f80fae7afe0ad48d7 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]) successfully deleted
I20260928 20:02:30.171311 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 57) took 1319 ms. Trace:
I20260928 20:02:30.171593 27011 rpcz_store.cc:276] 0928 20:02:28.851932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.852489 (+ 557us) service_pool.cc:224] Handling call
0928 20:02:30.170946 (+1318457us) ts_tablet_manager.cc:1197] Deleting tablet 6abc6a2ae4984413be9ba769d42dc072
0928 20:02:30.170994 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:30.171262 (+ 268us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1317901}
I20260928 20:02:30.173175 27011 tablet_replica.cc:333] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:02:30.173449 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 6abc6a2ae4984413be9ba769d42dc072 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6abc6a2ae4984413be9ba769d42dc072 already in progress: creating tablet
I20260928 20:02:30.173884 27011 raft_consensus.cc:2243] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:30.174050 27118 consensus_queue.cc:1048] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:30.174397 27011 raft_consensus.cc:2272] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.176703 27011 ts_tablet_manager.cc:1962] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.190374 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]) successfully deleted
W20260928 20:02:30.197233 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 882d1d6246dd4b3a81df5c57976ac631 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 882d1d6246dd4b3a81df5c57976ac631 already in progress: creating tablet
I20260928 20:02:30.199615 26916 ts_tablet_manager.cc:1480] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.075s user 0.007s sys 0.000s
I20260928 20:02:30.201767 27158 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:30.202594 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 57189d2450924921aecc1ee81c1cb952 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57189d2450924921aecc1ee81c1cb952 already in progress: creating tablet
I20260928 20:02:30.205928 26913 tablet_bootstrap.cc:492] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:30.206363 26913 ts_tablet_manager.cc:1449] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.005s
W20260928 20:02:30.210259 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39fb6f22905945578fa74b671d31c5f3 consensus state has no leader
I20260928 20:02:30.212848 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b624c955d67b4573ac8431cd87fffb48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:30.214012 27142 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:30.215612 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b624c955d67b4573ac8431cd87fffb48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:30.218880 26916 tablet_bootstrap.cc:492] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.221690 26913 raft_consensus.cc:359] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.223356 26913 raft_consensus.cc:385] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.223623 26913 raft_consensus.cc:740] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.226152 27145 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:30.227746 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet cb970d91179e48cdbbb1e32a3ca3171c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb970d91179e48cdbbb1e32a3ca3171c already in progress: creating tablet
I20260928 20:02:30.242976 26916 tablet_bootstrap.cc:654] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.246306 27009 ts_tablet_manager.cc:1975] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.246358 26913 consensus_queue.cc:260] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.248901 27118 raft_consensus.cc:493] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.249307 27118 raft_consensus.cc:515] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.251169 27118 leader_election.cc:290] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:30.252281 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:30.253623 26450 leader_election.cc:343] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.246686 27009 log.cc:1199] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/57189d2450924921aecc1ee81c1cb952
I20260928 20:02:30.258984 27009 ts_tablet_manager.cc:1996] T 57189d2450924921aecc1ee81c1cb952 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:30.259593 26913 ts_tablet_manager.cc:1480] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.053s user 0.006s sys 0.001s
I20260928 20:02:30.261225 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 57189d2450924921aecc1ee81c1cb952 (table default.Table_43952762d1e746599a2d65da7c07de79 [id=a6bf9e2083eb4fa7b7e44135ce5f7fdc]) successfully deleted
I20260928 20:02:30.264806 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:30.266532 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:30.266682 26913 tablet_bootstrap.cc:492] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:30.271265 27110 raft_consensus.cc:493] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.271708 27110 raft_consensus.cc:515] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.272074 27009 tablet_replica.cc:333] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:30.272977 27009 raft_consensus.cc:2243] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:30.273547 27009 raft_consensus.cc:2272] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.273602 27110 leader_election.cc:290] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:30.276341 26595 leader_election.cc:343] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:30.276371 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c37d6d73b35a44c8a0128a0a59c8d9b2" } new_table_name: "default.Table_9677ccc247274c458c2a6d666b0546f1" modify_external_catalogs: true
I20260928 20:02:30.286417 26913 tablet_bootstrap.cc:654] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.288807 27009 ts_tablet_manager.cc:1962] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.314994 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet d27a3bd58866482f80fae7afe0ad48d7 with delete_type TABLET_DATA_DELETED (replaced by tablet caf030c329e64d208a3f507804edbd54) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:30.328596 26236 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 8496c1658a314fc0bbe1c57799f8087a
I20260928 20:02:30.229934 27010 tablet_replica.cc:333] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:30.237185 26912 tablet_bootstrap.cc:492] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:30.344841 26912 ts_tablet_manager.cc:1449] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.275s user 0.012s sys 0.000s
I20260928 20:02:30.344779 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_366a7f185d964b76bfac11395c9e3e0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:30.346738 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_366a7f185d964b76bfac11395c9e3e0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:30.253234 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.274823 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1bab40024f97a5ad5acf358e3c26" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.349993 26801 raft_consensus.cc:2468] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:30.314354 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:30.324940 26803 raft_consensus.cc:3060] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.351711 26594 leader_election.cc:304] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:30.352744 27110 raft_consensus.cc:2804] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:30.353048 27110 raft_consensus.cc:493] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:30.353338 27110 raft_consensus.cc:3060] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.362531 27110 raft_consensus.cc:515] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.366349 26916 tablet_bootstrap.cc:492] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.366992 26916 ts_tablet_manager.cc:1449] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.148s user 0.013s sys 0.004s
W20260928 20:02:30.367414 26595 leader_election.cc:343] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:30.371876 27110 leader_election.cc:290] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:30.374473 27011 ts_tablet_manager.cc:1975] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.374400 27110 raft_consensus.cc:493] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.376502 27110 raft_consensus.cc:515] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.379535 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet d374d592fda8402faac70a923049c9ad
I20260928 20:02:30.379791 27010 raft_consensus.cc:2243] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:30.380582 27010 raft_consensus.cc:2272] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.380896 26229 catalog_manager.cc:6934] ReplaceTablet: tablet d374d592fda8402faac70a923049c9ad deleted and replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:30.381207 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:30.383324 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:30.383697 27010 ts_tablet_manager.cc:1962] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.371364 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1bab40024f97a5ad5acf358e3c26" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:30.386050 26801 raft_consensus.cc:3060] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.391696 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abc6a2ae4984413be9ba769d42dc072" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:30.396221 26594 leader_election.cc:343] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.375203 27011 log.cc:1199] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/4aeb153250d848c8bdc02b917f6c11a0
I20260928 20:02:30.398881 27011 ts_tablet_manager.cc:1996] T 4aeb153250d848c8bdc02b917f6c11a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:30.401010 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 58) took 1542 ms. Trace:
I20260928 20:02:30.401301 27011 rpcz_store.cc:276] 0928 20:02:28.858768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.858922 (+ 154us) service_pool.cc:224] Handling call
0928 20:02:30.173008 (+1314086us) ts_tablet_manager.cc:1197] Deleting tablet 4aeb153250d848c8bdc02b917f6c11a0
0928 20:02:30.173067 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:30.251868 (+ 78801us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.374257 (+122389us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.400953 (+ 26696us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1313551}
I20260928 20:02:30.402581 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 4aeb153250d848c8bdc02b917f6c11a0 (table default.Table_47107cc2ebe04af38af59a3a81e8dc62 [id=0957feb93a5345938705f3b7a3ec8394]) successfully deleted
I20260928 20:02:30.372112 26916 raft_consensus.cc:359] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:30.386873 26450 leader_election.cc:343] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.404758 26450 leader_election.cc:304] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.404615 26916 raft_consensus.cc:385] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.405268 26916 raft_consensus.cc:740] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.406141 27160 raft_consensus.cc:2749] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:30.392856 26912 raft_consensus.cc:359] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.406796 26912 raft_consensus.cc:385] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.382253 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:30.407065 26912 raft_consensus.cc:740] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.372653 27162 consensus_queue.cc:1048] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260928 20:02:30.408093 26912 consensus_queue.cc:260] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.419605 27152 raft_consensus.cc:493] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.419858 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_2c0586b4eade4864849f11f68ed45467" } new_table_name: "default.Table_c3df2a4361cf4adbae1547673dacf161" modify_external_catalogs: true
I20260928 20:02:30.420125 27152 raft_consensus.cc:515] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.422463 27110 leader_election.cc:290] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.423731 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e264a6fddc5a48aa9d2746b30ae7aa07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:30.425547 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:30.425686 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:30.426445 26516 raft_consensus.cc:2468] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:30.427464 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 59) took 1525 ms. Trace:
I20260928 20:02:30.428246 26740 leader_election.cc:304] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:30.430469 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:30.432485 27152 leader_election.cc:290] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:30.427781 27011 rpcz_store.cc:276] 0928 20:02:28.902056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.903372 (+ 1316us) service_pool.cc:224] Handling call
0928 20:02:30.426999 (+1523627us) ts_tablet_manager.cc:1197] Deleting tablet d6c0cc7bd109493cacf990dd1e2728f0
0928 20:02:30.427063 (+ 64us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:30.427403 (+ 340us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1523079}
W20260928 20:02:30.437831 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet d6c0cc7bd109493cacf990dd1e2728f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6c0cc7bd109493cacf990dd1e2728f0 already in progress: creating tablet
I20260928 20:02:30.438786 27011 tablet_replica.cc:333] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:30.439479 27011 raft_consensus.cc:2243] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:30.440021 27011 raft_consensus.cc:2272] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.405917 26916 consensus_queue.cc:260] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.450601 27009 ts_tablet_manager.cc:1975] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.450955 27009 log.cc:1199] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/a5d73fef88894a51b9fa04cb70e29d43
I20260928 20:02:30.451354 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abc6a2ae4984413be9ba769d42dc072" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:30.451588 27009 ts_tablet_manager.cc:1996] T a5d73fef88894a51b9fa04cb70e29d43 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:30.452862 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet a5d73fef88894a51b9fa04cb70e29d43 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]) successfully deleted
I20260928 20:02:30.451948 26516 raft_consensus.cc:2468] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:30.457669 26595 leader_election.cc:304] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.458084 26913 tablet_bootstrap.cc:492] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:30.458226 27011 ts_tablet_manager.cc:1962] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.458493 26913 ts_tablet_manager.cc:1449] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.192s user 0.012s sys 0.008s
I20260928 20:02:30.460886 26913 raft_consensus.cc:359] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.461464 26913 raft_consensus.cc:385] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.461714 26913 raft_consensus.cc:740] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.451606 26916 ts_tablet_manager.cc:1480] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.084s user 0.005s sys 0.000s
I20260928 20:02:30.462708 27166 raft_consensus.cc:2804] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:30.463042 27166 raft_consensus.cc:493] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:30.463112 26916 tablet_bootstrap.cc:492] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.463333 27166 raft_consensus.cc:3060] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.449759 26801 raft_consensus.cc:2468] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:30.467067 26594 leader_election.cc:304] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:30.467339 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet d374d592fda8402faac70a923049c9ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d374d592fda8402faac70a923049c9ad already in progress: creating tablet
I20260928 20:02:30.468611 27110 raft_consensus.cc:2804] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:02:30.472116 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43961.6us
I20260928 20:02:30.473080 27053 raft_consensus.cc:2804] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:02:30.473409 27053 raft_consensus.cc:493] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:30.473788 27053 raft_consensus.cc:3060] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:30.477080 27166 raft_consensus.cc:515] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.485736 27053 raft_consensus.cc:515] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.489461 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:30.490031 26516 raft_consensus.cc:3060] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:30.491493 26916 tablet_bootstrap.cc:654] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.487710 27110 raft_consensus.cc:697] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:30.503489 27110 consensus_queue.cc:237] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.505023 27011 ts_tablet_manager.cc:1975] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:30.505424 27011 log.cc:1199] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/8a74c26724ae484a972944f96cc566c3
I20260928 20:02:30.499532 26913 consensus_queue.cc:260] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.509501 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abc6a2ae4984413be9ba769d42dc072" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:30.511299 26594 leader_election.cc:343] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.515937 26916 tablet_bootstrap.cc:492] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.516345 26916 ts_tablet_manager.cc:1449] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.053s user 0.011s sys 0.000s
I20260928 20:02:30.518937 26916 raft_consensus.cc:359] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.519549 26916 raft_consensus.cc:385] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.519783 26916 raft_consensus.cc:740] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.521461 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abc6a2ae4984413be9ba769d42dc072" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:30.522017 26514 raft_consensus.cc:3060] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.522805 26516 raft_consensus.cc:2468] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:02:30.523808 26515 raft_consensus.cc:1240] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Rejecting Update request from peer 92fd8074a7df4bba87a73c0d84ed00c8 for earlier term 1. Current term is 2. Ops: []
I20260928 20:02:30.525695 26740 leader_election.cc:304] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:30.526576 27152 raft_consensus.cc:2804] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:02:30.526345 26916 consensus_queue.cc:260] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.527124 27011 ts_tablet_manager.cc:1996] T 8a74c26724ae484a972944f96cc566c3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:30.527482 27152 raft_consensus.cc:697] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:30.528448 27152 consensus_queue.cc:237] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.529491 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 60) took 1539 ms. Trace:
I20260928 20:02:30.534337 26913 ts_tablet_manager.cc:1480] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.076s user 0.007s sys 0.000s
I20260928 20:02:30.533243 26514 raft_consensus.cc:2468] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:30.538537 26595 leader_election.cc:304] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.539678 27110 consensus_queue.cc:1059] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:30.540256 26913 tablet_bootstrap.cc:492] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:30.540618 27110 raft_consensus.cc:2804] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:30.541085 27110 raft_consensus.cc:697] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:30.541890 27110 consensus_queue.cc:237] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.543696 26916 ts_tablet_manager.cc:1480] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260928 20:02:30.546867 26916 tablet_bootstrap.cc:492] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.547678 27010 ts_tablet_manager.cc:1975] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.546903 27167 raft_consensus.cc:3055] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:02:30.548874 27167 raft_consensus.cc:740] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:30.549901 27167 consensus_queue.cc:260] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:30.551158 27167 raft_consensus.cc:3060] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:30.554221 27166 leader_election.cc:290] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.554998 27010 log.cc:1199] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b2e2b9af466b474bb4bda5d4b246aa45
I20260928 20:02:30.556753 27010 ts_tablet_manager.cc:1996] T b2e2b9af466b474bb4bda5d4b246aa45 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:30.529803 27011 rpcz_store.cc:276] 0928 20:02:28.989717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:28.989856 (+ 139us) service_pool.cc:224] Handling call
0928 20:02:30.438615 (+1448759us) ts_tablet_manager.cc:1197] Deleting tablet 8a74c26724ae484a972944f96cc566c3
0928 20:02:30.438677 (+ 62us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:30.475905 (+ 37228us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.504903 (+ 28998us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.529422 (+ 24519us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1435771}
I20260928 20:02:30.558974 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 8a74c26724ae484a972944f96cc566c3 (table default.Table_c3a7d9da79be4906b5e673b04b2b6b0a [id=c4c5b23cfb734682950f782df145fc06]) successfully deleted
I20260928 20:02:30.560002 27011 tablet_replica.cc:333] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:30.560727 27011 raft_consensus.cc:2243] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:30.561349 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet b2e2b9af466b474bb4bda5d4b246aa45 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]) successfully deleted
I20260928 20:02:30.561609 27011 raft_consensus.cc:2272] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:30.563364 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet a5d73fef88894a51b9fa04cb70e29d43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5d73fef88894a51b9fa04cb70e29d43 already in progress: creating tablet
I20260928 20:02:30.563527 27011 ts_tablet_manager.cc:1962] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.564491 27171 raft_consensus.cc:493] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.565166 27010 tablet_replica.cc:333] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:30.564908 27171 raft_consensus.cc:515] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.567328 26912 ts_tablet_manager.cc:1480] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.222s user 0.008s sys 0.006s
I20260928 20:02:30.568125 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e162b25e0db14a35bfe6657f620affdb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.568579 27171 leader_election.cc:290] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.568804 26804 raft_consensus.cc:2468] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:30.569672 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e162b25e0db14a35bfe6657f620affdb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:30.570140 26594 leader_election.cc:304] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:30.570277 26514 raft_consensus.cc:2468] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:30.571062 26912 tablet_bootstrap.cc:492] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:30.568110 27010 raft_consensus.cc:2243] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:30.572353 27010 raft_consensus.cc:2272] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.579181 26913 tablet_bootstrap.cc:654] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.581004 26916 tablet_bootstrap.cc:654] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.589362 27171 raft_consensus.cc:2804] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:30.589785 27171 raft_consensus.cc:493] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:30.590137 27171 raft_consensus.cc:3060] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.590294 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet 6abc6a2ae4984413be9ba769d42dc072 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:30.593168 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_75d3d3007f5b4c929142c1ec075e54f0" } modify_external_catalogs: true
I20260928 20:02:30.594446 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_75d3d3007f5b4c929142c1ec075e54f0" } modify_external_catalogs: true
I20260928 20:02:30.606181 26913 tablet_bootstrap.cc:492] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:30.606582 26913 ts_tablet_manager.cc:1449] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.071s user 0.013s sys 0.000s
I20260928 20:02:30.608772 26913 raft_consensus.cc:359] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.610692 27010 ts_tablet_manager.cc:1962] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:30.613026 27053 leader_election.cc:290] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:30.613615 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:30.619421 26912 tablet_bootstrap.cc:654] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.620786 26656 raft_consensus.cc:2410] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 20:02:30.627445 26916 tablet_bootstrap.cc:492] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.627853 26916 ts_tablet_manager.cc:1449] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.005s
I20260928 20:02:30.609356 26913 raft_consensus.cc:385] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.634159 26913 raft_consensus.cc:740] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.636107 26916 raft_consensus.cc:359] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.636742 26916 raft_consensus.cc:385] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.636978 26916 raft_consensus.cc:740] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.638022 26913 consensus_queue.cc:260] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.638357 26916 consensus_queue.cc:260] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.643112 26913 ts_tablet_manager.cc:1480] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.036s user 0.005s sys 0.000s
I20260928 20:02:30.644119 26913 tablet_bootstrap.cc:492] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:30.655822 26916 ts_tablet_manager.cc:1480] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.028s user 0.005s sys 0.001s
I20260928 20:02:30.656527 26236 master_service.cc:960] ReplaceTablet: received request to replace tablet d6c0cc7bd109493cacf990dd1e2728f0 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:30.659883 27011 ts_tablet_manager.cc:1975] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:30.660269 27011 log.cc:1199] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/30e47366cc02478290e02df5cb984691
I20260928 20:02:30.660323 27010 ts_tablet_manager.cc:1975] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.660673 27010 log.cc:1199] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:30.660955 27011 ts_tablet_manager.cc:1996] T 30e47366cc02478290e02df5cb984691 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:30.661202 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47bf3dd9ed054197b4208324938d96b0 consensus state has no leader
I20260928 20:02:30.661273 27010 ts_tablet_manager.cc:1996] T a4df1bab40024f97a5ad5acf358e3c26 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:30.662971 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 61) took 1363 ms. Trace:
I20260928 20:02:30.663309 27011 rpcz_store.cc:276] 0928 20:02:29.299307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:29.299423 (+ 116us) service_pool.cc:224] Handling call
0928 20:02:30.559806 (+1260383us) ts_tablet_manager.cc:1197] Deleting tablet 30e47366cc02478290e02df5cb984691
0928 20:02:30.559877 (+ 71us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:30.594888 (+ 35011us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.659764 (+ 64876us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:30.662909 (+ 3145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259832}
I20260928 20:02:30.664630 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 65) took 1137 ms. Trace:
I20260928 20:02:30.664947 27011 rpcz_store.cc:276] 0928 20:02:29.527649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:29.527870 (+ 221us) service_pool.cc:224] Handling call
0928 20:02:30.664272 (+1136402us) ts_tablet_manager.cc:1197] Deleting tablet 882d1d6246dd4b3a81df5c57976ac631
0928 20:02:30.664318 (+ 46us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:30.664579 (+ 261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1135548}
I20260928 20:02:30.665635 27171 raft_consensus.cc:515] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.669198 26913 tablet_bootstrap.cc:654] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.669013 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e162b25e0db14a35bfe6657f620affdb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:30.669582 26803 raft_consensus.cc:3060] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.664431 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 30e47366cc02478290e02df5cb984691 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]) successfully deleted
W20260928 20:02:30.670475 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 882d1d6246dd4b3a81df5c57976ac631 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 882d1d6246dd4b3a81df5c57976ac631 already in progress: creating tablet
I20260928 20:02:30.673902 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet a4df1bab40024f97a5ad5acf358e3c26 (table default.Table_560504da8c694a95a0b601d4f3998d96 [id=ee0ddf3f7b2c42bfb01a4a12edea45d0]) successfully deleted
I20260928 20:02:30.674335 26916 tablet_bootstrap.cc:492] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.676340 26803 raft_consensus.cc:2468] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:30.680199 26916 tablet_bootstrap.cc:654] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.681353 26594 leader_election.cc:304] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:30.682196 27110 raft_consensus.cc:2804] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:30.682652 27110 raft_consensus.cc:697] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:30.683482 27110 consensus_queue.cc:237] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.665942 27011 tablet_replica.cc:333] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:30.686724 27011 raft_consensus.cc:2243] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:30.687188 26229 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29a489266ffc47a498e8541408a1f6a2 consensus state has no leader
I20260928 20:02:30.687216 27011 raft_consensus.cc:2272] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:30.698153 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e162b25e0db14a35bfe6657f620affdb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:30.698756 26514 raft_consensus.cc:3060] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.698997 27011 ts_tablet_manager.cc:1962] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:30.675537 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet d374d592fda8402faac70a923049c9ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d374d592fda8402faac70a923049c9ad already in progress: creating tablet
W20260928 20:02:30.701805 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_9677ccc247274c458c2a6d666b0546f1 [id=474b74c08e6348da8e5de4405064735f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 47bf3dd9ed054197b4208324938d96b0 consensus state has no leader
I20260928 20:02:30.708683 26514 raft_consensus.cc:2468] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:30.709270 27171 leader_election.cc:290] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.718580 26916 tablet_bootstrap.cc:492] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.719012 26916 ts_tablet_manager.cc:1449] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.062s user 0.010s sys 0.000s
I20260928 20:02:30.721295 26916 raft_consensus.cc:359] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.734433 26916 raft_consensus.cc:385] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.734817 26916 raft_consensus.cc:740] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.736032 26912 tablet_bootstrap.cc:492] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:30.736943 26912 ts_tablet_manager.cc:1449] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.166s user 0.008s sys 0.003s
I20260928 20:02:30.739404 26912 raft_consensus.cc:359] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.740032 26912 raft_consensus.cc:385] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.740326 26912 raft_consensus.cc:740] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.742417 26916 consensus_queue.cc:260] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.744369 26913 tablet_bootstrap.cc:492] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:30.744783 26913 ts_tablet_manager.cc:1449] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.101s user 0.012s sys 0.009s
I20260928 20:02:30.746762 26912 consensus_queue.cc:260] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.749533 26916 ts_tablet_manager.cc:1480] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.030s user 0.005s sys 0.001s
I20260928 20:02:30.750382 26916 tablet_bootstrap.cc:492] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.750661 27110 raft_consensus.cc:493] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.751068 27110 raft_consensus.cc:515] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.753430 27110 leader_election.cc:290] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.754518 26912 ts_tablet_manager.cc:1480] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260928 20:02:30.755414 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c0cc7bd109493cacf990dd1e2728f0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:30.757207 26594 leader_election.cc:343] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.757934 26912 tablet_bootstrap.cc:492] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:30.758150 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c0cc7bd109493cacf990dd1e2728f0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:30.758726 26514 raft_consensus.cc:2468] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:30.759882 26595 leader_election.cc:304] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.761190 27110 raft_consensus.cc:2804] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:30.761569 27110 raft_consensus.cc:493] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:30.762293 27110 raft_consensus.cc:3060] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.747128 26913 raft_consensus.cc:359] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.764986 26913 raft_consensus.cc:385] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.765313 26913 raft_consensus.cc:740] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.766206 26913 consensus_queue.cc:260] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.770246 26916 tablet_bootstrap.cc:654] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.773779 27110 raft_consensus.cc:515] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.775743 26913 ts_tablet_manager.cc:1480] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260928 20:02:30.783344 26913 tablet_bootstrap.cc:492] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:30.785725 27011 ts_tablet_manager.cc:1975] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:30.786072 27011 log.cc:1199] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/57189d2450924921aecc1ee81c1cb952
I20260928 20:02:30.786747 27011 ts_tablet_manager.cc:1996] T 57189d2450924921aecc1ee81c1cb952 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:30.789266 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 57189d2450924921aecc1ee81c1cb952 (table default.Table_43952762d1e746599a2d65da7c07de79 [id=a6bf9e2083eb4fa7b7e44135ce5f7fdc]) successfully deleted
I20260928 20:02:30.791366 26913 tablet_bootstrap.cc:654] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.798858 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c0cc7bd109493cacf990dd1e2728f0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:30.800343 26594 leader_election.cc:343] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.800617 26913 tablet_bootstrap.cc:492] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:30.800993 26913 ts_tablet_manager.cc:1449] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.008s
W20260928 20:02:30.803416 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet cb970d91179e48cdbbb1e32a3ca3171c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb970d91179e48cdbbb1e32a3ca3171c already in progress: creating tablet
I20260928 20:02:30.804863 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f5ee7c6935014820b8c56e2f899c3df2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:30.805538 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c0cc7bd109493cacf990dd1e2728f0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:30.806042 26514 raft_consensus.cc:3060] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.806766 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_53b73d543aa74f4190223084e9c487af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:30.808398 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53b73d543aa74f4190223084e9c487af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:30.810586 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5ee7c6935014820b8c56e2f899c3df2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:30.811255 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet a5d73fef88894a51b9fa04cb70e29d43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5d73fef88894a51b9fa04cb70e29d43 already in progress: creating tablet
I20260928 20:02:30.813011 26514 raft_consensus.cc:2468] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:30.819797 26916 tablet_bootstrap.cc:492] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.820291 26916 ts_tablet_manager.cc:1449] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.070s user 0.005s sys 0.006s
I20260928 20:02:30.822742 26916 raft_consensus.cc:359] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.823360 26916 raft_consensus.cc:385] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.823616 26916 raft_consensus.cc:740] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.824407 26234 master_service.cc:960] ReplaceTablet: received request to replace tablet e162b25e0db14a35bfe6657f620affdb from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:30.814190 26595 leader_election.cc:304] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.827128 27171 raft_consensus.cc:2804] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:30.826943 26916 consensus_queue.cc:260] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.827566 27171 raft_consensus.cc:697] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:30.828310 27171 consensus_queue.cc:237] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.814574 27110 leader_election.cc:290] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.803370 26913 raft_consensus.cc:359] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.836933 26913 raft_consensus.cc:385] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.837590 26913 raft_consensus.cc:740] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.838609 26916 ts_tablet_manager.cc:1480] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260928 20:02:30.839035 26913 consensus_queue.cc:260] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.843642 26913 ts_tablet_manager.cc:1480] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.042s user 0.005s sys 0.000s
I20260928 20:02:30.849998 26912 tablet_bootstrap.cc:654] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.850293 26913 tablet_bootstrap.cc:492] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:30.858343 26916 tablet_bootstrap.cc:492] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.865574 26916 tablet_bootstrap.cc:654] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:30.875295 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet d27a3bd58866482f80fae7afe0ad48d7 because the tablet was not found. No further retry: Not found: Tablet not found: d27a3bd58866482f80fae7afe0ad48d7
I20260928 20:02:30.876405 26913 tablet_bootstrap.cc:654] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:30.876256 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 49266.3us
W20260928 20:02:30.877259 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet d374d592fda8402faac70a923049c9ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d374d592fda8402faac70a923049c9ad already in progress: creating tablet
I20260928 20:02:30.881110 26916 tablet_bootstrap.cc:492] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:30.881496 26916 ts_tablet_manager.cc:1449] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.006s
I20260928 20:02:30.883951 26916 raft_consensus.cc:359] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.884536 26916 raft_consensus.cc:385] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:30.884776 26916 raft_consensus.cc:740] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:30.885466 26916 consensus_queue.cc:260] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.886641 26778 tablet_service.cc:1511] Processing CreateTablet for tablet ab9f9f2f9b96435e983f1ee2679563ff (DEFAULT_TABLE table=default.Table_9a3c09ef67584c93a83248d42b2bf91d [id=42107b9751ab49cc85c2946d96002440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.888159 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9f9f2f9b96435e983f1ee2679563ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.892676 26636 tablet_service.cc:1511] Processing CreateTablet for tablet ab9f9f2f9b96435e983f1ee2679563ff (DEFAULT_TABLE table=default.Table_9a3c09ef67584c93a83248d42b2bf91d [id=42107b9751ab49cc85c2946d96002440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.896601 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7c544b3449427dab981465e2e08a38 (DEFAULT_TABLE table=default.Table_8b0494f6646c4da3a2555b1b10dfe6d9 [id=8bce5ded64774186a5e753c7037b977f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.898262 26916 ts_tablet_manager.cc:1480] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260928 20:02:30.900665 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7c544b3449427dab981465e2e08a38 (DEFAULT_TABLE table=default.Table_8b0494f6646c4da3a2555b1b10dfe6d9 [id=8bce5ded64774186a5e753c7037b977f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.904657 26782 tablet_service.cc:1511] Processing CreateTablet for tablet b059111d6383414890a28c2947934dd8 (DEFAULT_TABLE table=default.Table_f55cc836b1a4436baefce92d942dc0ba [id=adee36b5ad4b4575a43039f4666dbb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.907006 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9f9f2f9b96435e983f1ee2679563ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.910017 26916 tablet_bootstrap.cc:492] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:30.910384 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7c544b3449427dab981465e2e08a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.915701 26916 tablet_bootstrap.cc:654] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:30.916072 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7c544b3449427dab981465e2e08a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.926419 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b059111d6383414890a28c2947934dd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:30.933112 26125 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 51747.1us
I20260928 20:02:30.938057 27171 raft_consensus.cc:493] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.938560 27171 raft_consensus.cc:515] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.940603 27171 leader_election.cc:290] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:30.941702 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fb6f22905945578fa74b671d31c5f3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:30.942210 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fb6f22905945578fa74b671d31c5f3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.942349 26514 raft_consensus.cc:2468] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:30.943634 26595 leader_election.cc:304] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
W20260928 20:02:30.944376 26594 leader_election.cc:343] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.945212 27171 raft_consensus.cc:2804] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:30.945573 27171 raft_consensus.cc:493] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:30.945873 27171 raft_consensus.cc:3060] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.952595 27171 raft_consensus.cc:515] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.955621 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fb6f22905945578fa74b671d31c5f3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:30.966813 27171 leader_election.cc:290] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:30.966966 26594 leader_election.cc:343] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.968645 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fb6f22905945578fa74b671d31c5f3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:30.969175 26514 raft_consensus.cc:3060] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:30.974781 26493 tablet_service.cc:1511] Processing CreateTablet for tablet ab9f9f2f9b96435e983f1ee2679563ff (DEFAULT_TABLE table=default.Table_9a3c09ef67584c93a83248d42b2bf91d [id=42107b9751ab49cc85c2946d96002440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.975775 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9f9f2f9b96435e983f1ee2679563ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.977293 26514 raft_consensus.cc:2468] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:30.978477 26595 leader_election.cc:304] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.978861 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7c544b3449427dab981465e2e08a38 (DEFAULT_TABLE table=default.Table_8b0494f6646c4da3a2555b1b10dfe6d9 [id=8bce5ded64774186a5e753c7037b977f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:30.979602 27171 raft_consensus.cc:2804] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:30.979887 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7c544b3449427dab981465e2e08a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:30.981052 27171 raft_consensus.cc:697] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:30.983124 27171 consensus_queue.cc:237] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:30.985642 27160 raft_consensus.cc:493] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:30.986050 27160 raft_consensus.cc:515] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:30.987883 27160 leader_election.cc:290] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:30.989463 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:30.990677 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:30.994989 26450 leader_election.cc:343] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:30.995594 26450 leader_election.cc:343] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:30.995910 26450 leader_election.cc:304] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:30.998034 27160 raft_consensus.cc:2749] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:31.021332 26232 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet f2c365de7d204833aa9dfa4966f254cf
I20260928 20:02:31.023322 26232 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5c2de312e14245d48623ff64b5e0baa8" } new_table_name: "default.Table_b203e56277cd4bb183c04c5f2403777e" modify_external_catalogs: true
I20260928 20:02:31.028916 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2d9ca77e114c4d06bde1bcd862c8eccf (table default.Table_074d381c532c42e29a79dd9296e083a6 [id=bfbc8f3e5a924682a1dd0a5996898e28]). Expected version 1 got 0
I20260928 20:02:31.033013 27160 raft_consensus.cc:493] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.033454 27160 raft_consensus.cc:515] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.035272 27160 leader_election.cc:290] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:31.037670 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4f7ca1b194471bbad778ac4e89f6c7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:31.039022 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4f7ca1b194471bbad778ac4e89f6c7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:31.041141 26450 leader_election.cc:343] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:31.041733 26450 leader_election.cc:343] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.042053 26450 leader_election.cc:304] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:31.043141 27160 raft_consensus.cc:2749] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:31.048771 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 32) took 1603 ms (client timeout 1000 ms). Trace:
I20260928 20:02:31.051330 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:31.049208 26235 rpcz_store.cc:269] 0928 20:02:29.444989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:29.464549 (+ 19560us) service_pool.cc:224] Handling call
0928 20:02:29.591367 (+126818us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:31.048542 (+1457175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:30.223754 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:30.224183 (+ 429us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:30.224222 (+ 39us) write_op.cc:435] Acquired schema lock
0928 20:02:30.224245 (+ 23us) tablet.cc:662] Decoding operations
0928 20:02:30.233052 (+ 8807us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:30.233104 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:30.233128 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:30.233293 (+ 165us) tablet.cc:701] Row locks acquired
0928 20:02:30.233306 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:30.237466 (+ 4160us) write_op.cc:270] Start()
0928 20:02:30.237559 (+ 93us) write_op.cc:276] Timestamp: P: 1790625750237391 usec, L: 0
0928 20:02:30.237573 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:30.238051 (+ 478us) log.cc:844] Serialized 536 byte log entry
0928 20:02:30.260664 (+ 22613us) op_driver.cc:464] REPLICATION: finished
0928 20:02:30.260900 (+ 236us) write_op.cc:301] APPLY: starting
0928 20:02:30.260960 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:30.261054 (+ 94us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:30.261161 (+ 107us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:30.261316 (+ 155us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:30.261457 (+ 141us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:30.261506 (+ 49us) write_op.cc:312] APPLY: finished
0928 20:02:30.261672 (+ 166us) log.cc:844] Serialized 23 byte log entry
0928 20:02:30.261813 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:30.261873 (+ 60us) write_op.cc:454] Released schema lock
0928 20:02:30.261915 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":288380800,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":1226,"apply.run_wall_time_us":1227,"num_ops":1,"prepare.queue_time_us":162932,"prepare.run_cpu_time_us":2146,"prepare.run_wall_time_us":27991,"raft.queue_time_us":150,"raft.run_cpu_time_us":664,"raft.run_wall_time_us":1369,"replication_time_us":22988}]]}
I20260928 20:02:31.055325 27160 raft_consensus.cc:493] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.055940 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet 882d1d6246dd4b3a81df5c57976ac631 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:31.055820 27160 raft_consensus.cc:515] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:31.057535 27160 leader_election.cc:290] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:31.057850 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_786a5ea6a2f948a6ad4230ffaa356252" } new_table_name: "default.Table_0dfdabdeae0a4bf1ba4dd59d4bbc98ca" modify_external_catalogs: true
I20260928 20:02:31.059767 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:31.060935 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:31.063172 26450 leader_election.cc:343] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:31.063731 26450 leader_election.cc:343] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.064024 26450 leader_election.cc:304] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:31.063498 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8a6a3f3fccfe4781a4236ec23cd327ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:31.065160 27160 raft_consensus.cc:2749] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:31.065523 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.069226 27191 tablet_replica.cc:333] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:31.072292 27191 raft_consensus.cc:2243] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:31.074669 27191 raft_consensus.cc:2272] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.077531 27191 ts_tablet_manager.cc:1962] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:31.098388 26490 tablet_service.cc:1511] Processing CreateTablet for tablet b059111d6383414890a28c2947934dd8 (DEFAULT_TABLE table=default.Table_f55cc836b1a4436baefce92d942dc0ba [id=adee36b5ad4b4575a43039f4666dbb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.099511 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b059111d6383414890a28c2947934dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.101904 26495 tablet_service.cc:1511] Processing CreateTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 (DEFAULT_TABLE table=default.Table_786a5ea6a2f948a6ad4230ffaa356252 [id=11d2d52bae424e51b5379df798890e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.102990 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fd24cd5adf4774a13aeac30315f6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.103065 26633 tablet_service.cc:1511] Processing CreateTablet for tablet b059111d6383414890a28c2947934dd8 (DEFAULT_TABLE table=default.Table_f55cc836b1a4436baefce92d942dc0ba [id=adee36b5ad4b4575a43039f4666dbb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.104401 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b059111d6383414890a28c2947934dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.107614 26780 tablet_service.cc:1511] Processing CreateTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 (DEFAULT_TABLE table=default.Table_786a5ea6a2f948a6ad4230ffaa356252 [id=11d2d52bae424e51b5379df798890e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.109061 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fd24cd5adf4774a13aeac30315f6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.163498 26631 tablet_service.cc:1511] Processing CreateTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 (DEFAULT_TABLE table=default.Table_786a5ea6a2f948a6ad4230ffaa356252 [id=11d2d52bae424e51b5379df798890e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.164225 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 756342f2b9a245c89ad8dbc6089b71d7 (DEFAULT_TABLE table=default.Table_0c6396df18a447838b8edbf495c2f3dd [id=f004ce733e90484faa39955bca33a4fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.164731 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fd24cd5adf4774a13aeac30315f6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.165346 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756342f2b9a245c89ad8dbc6089b71d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.173687 27191 ts_tablet_manager.cc:1975] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:31.179943 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 756342f2b9a245c89ad8dbc6089b71d7 (DEFAULT_TABLE table=default.Table_0c6396df18a447838b8edbf495c2f3dd [id=f004ce733e90484faa39955bca33a4fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.180976 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756342f2b9a245c89ad8dbc6089b71d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.214046 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 502edf35a86646178cfc121519c85c53 (DEFAULT_TABLE table=default.Table_15ea4a6742b5444593f1f985deb10b73 [id=ec32368ba1694873892ec3f1a5140105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.219493 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502edf35a86646178cfc121519c85c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.233381 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ae88901a72984d6a8f4f4a4943fec19f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:31.235303 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae88901a72984d6a8f4f4a4943fec19f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.208784 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 502edf35a86646178cfc121519c85c53 (DEFAULT_TABLE table=default.Table_15ea4a6742b5444593f1f985deb10b73 [id=ec32368ba1694873892ec3f1a5140105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.214152 26494 tablet_service.cc:1511] Processing CreateTablet for tablet afceff93f6f9401f94bab3e376925d12 (DEFAULT_TABLE table=default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.240039 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afceff93f6f9401f94bab3e376925d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.241672 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:31.242815 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502edf35a86646178cfc121519c85c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.246322 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.246729 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 756342f2b9a245c89ad8dbc6089b71d7 (DEFAULT_TABLE table=default.Table_0c6396df18a447838b8edbf495c2f3dd [id=f004ce733e90484faa39955bca33a4fb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:31.248790 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet b087dcc9d5be4a9e89c35c359a18ca5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b087dcc9d5be4a9e89c35c359a18ca5c already in progress: creating tablet
I20260928 20:02:31.251657 26231 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_073d3a55143c4c448dce7157adc7abf3 [id=5556b2b20a4343c5b98fc7c73e2aebfd] alter complete (version 1)
I20260928 20:02:31.252683 26233 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_074d381c532c42e29a79dd9296e083a6 [id=bfbc8f3e5a924682a1dd0a5996898e28] alter complete (version 1)
W20260928 20:02:31.253165 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 29) took 902 ms (client timeout 1000 ms). Trace:
I20260928 20:02:31.258807 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.260779 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee464b814dbf4e4b89b2d1c019befac6) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:31.261886 26227 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 33) took 776 ms (client timeout 1000 ms). Trace:
W20260928 20:02:31.253448 26231 rpcz_store.cc:269] 0928 20:02:30.351201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:30.352243 (+ 1042us) service_pool.cc:224] Handling call
0928 20:02:31.253092 (+900849us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:31.133942 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:31.134384 (+ 442us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:31.134417 (+ 33us) write_op.cc:435] Acquired schema lock
0928 20:02:31.134436 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:31.134719 (+ 283us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:31.134765 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:31.134797 (+ 32us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:31.134956 (+ 159us) tablet.cc:701] Row locks acquired
0928 20:02:31.134975 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:31.135095 (+ 120us) write_op.cc:270] Start()
0928 20:02:31.135187 (+ 92us) write_op.cc:276] Timestamp: P: 1790625751135001 usec, L: 0
0928 20:02:31.135208 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:31.135630 (+ 422us) log.cc:844] Serialized 356 byte log entry
0928 20:02:31.249255 (+113625us) op_driver.cc:464] REPLICATION: finished
0928 20:02:31.249647 (+ 392us) write_op.cc:301] APPLY: starting
0928 20:02:31.249700 (+ 53us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:31.250513 (+ 813us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:31.250605 (+ 92us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:31.250786 (+ 181us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:31.250934 (+ 148us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:31.250975 (+ 41us) write_op.cc:312] APPLY: finished
0928 20:02:31.251146 (+ 171us) log.cc:844] Serialized 23 byte log entry
0928 20:02:31.251289 (+ 143us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:31.251347 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:31.251377 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":261,"num_ops":1,"prepare.queue_time_us":96106,"prepare.run_cpu_time_us":1863,"prepare.run_wall_time_us":2618,"replication_time_us":113961}]]}
I20260928 20:02:31.266244 27191 log.cc:1199] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:31.267437 27191 ts_tablet_manager.cc:1996] T 6abc6a2ae4984413be9ba769d42dc072 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
W20260928 20:02:31.262311 26227 rpcz_store.cc:269] 0928 20:02:30.485581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:30.587711 (+102130us) service_pool.cc:224] Handling call
0928 20:02:31.261730 (+674019us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
W20260928 20:02:31.272881 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 28) took 955 ms (client timeout 1000 ms). Trace:
I20260928 20:02:31.273777 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.274312 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.274726 27011 tablet_replica.cc:333] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:31.274286 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 57189d2450924921aecc1ee81c1cb952 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.275528 27011 raft_consensus.cc:2243] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:31.276296 27011 pending_rounds.cc:70] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:31.276532 27011 pending_rounds.cc:77] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403074073681920 op_type: NO_OP noop_request { }
I20260928 20:02:31.276929 27011 raft_consensus.cc:2889] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:31.277294 27011 raft_consensus.cc:2272] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.277798 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet e162b25e0db14a35bfe6657f620affdb
I20260928 20:02:31.279227 26234 catalog_manager.cc:6934] ReplaceTablet: tablet e162b25e0db14a35bfe6657f620affdb deleted and replaced by tablet e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:31.280396 27011 ts_tablet_manager.cc:1962] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:31.281152 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet e162b25e0db14a35bfe6657f620affdb with delete_type TABLET_DATA_DELETED (replaced by tablet e70df4ddf0f9430980c967d798ed6c50) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.281457 26633 tablet_service.cc:1511] Processing CreateTablet for tablet afceff93f6f9401f94bab3e376925d12 (DEFAULT_TABLE table=default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.282435 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.282660 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afceff93f6f9401f94bab3e376925d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.283546 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756342f2b9a245c89ad8dbc6089b71d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.287475 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c3df2a4361cf4adbae1547673dacf161" } modify_external_catalogs: true
I20260928 20:02:31.288095 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c3df2a4361cf4adbae1547673dacf161" } modify_external_catalogs: true
I20260928 20:02:31.294395 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet e162b25e0db14a35bfe6657f620affdb with delete_type TABLET_DATA_DELETED (replaced by tablet e70df4ddf0f9430980c967d798ed6c50) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.303431 26913 tablet_bootstrap.cc:492] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:31.303867 26913 ts_tablet_manager.cc:1449] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.456s user 0.036s sys 0.088s
I20260928 20:02:31.309988 26227 master_service.cc:960] ReplaceTablet: received request to replace tablet b22118c942324613837c489142d129fa from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:31.314075 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 39fb6f22905945578fa74b671d31c5f3 (table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]). Expected version 1 got 0
I20260928 20:02:31.316299 27171 raft_consensus.cc:493] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.316737 27171 raft_consensus.cc:515] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.326509 27171 leader_election.cc:290] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:31.328024 26639 tablet_service.cc:1511] Processing CreateTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 (DEFAULT_TABLE table=default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.328737 26913 raft_consensus.cc:359] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.329588 26913 raft_consensus.cc:385] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:31.338797 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 502edf35a86646178cfc121519c85c53 (DEFAULT_TABLE table=default.Table_15ea4a6742b5444593f1f985deb10b73 [id=ec32368ba1694873892ec3f1a5140105]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.340197 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502edf35a86646178cfc121519c85c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.331528 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac (DEFAULT_TABLE table=default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.345405 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:31.346170 26514 raft_consensus.cc:2468] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:31.347703 26595 leader_election.cc:304] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:31.348155 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac (DEFAULT_TABLE table=default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.348485 27171 raft_consensus.cc:2804] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:31.329873 26913 raft_consensus.cc:740] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:31.349110 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4ea23c18e04819b28d3428d584f3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.351498 27011 ts_tablet_manager.cc:1975] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:31.351454 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.357079 26912 tablet_bootstrap.cc:492] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:31.348809 27171 raft_consensus.cc:493] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:31.357474 26912 ts_tablet_manager.cc:1449] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.600s user 0.019s sys 0.001s
I20260928 20:02:31.357513 27171 raft_consensus.cc:3060] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:31.344434 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee464b814dbf4e4b89b2d1c019befac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.359752 26912 raft_consensus.cc:359] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.360788 26912 raft_consensus.cc:385] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:31.361056 26912 raft_consensus.cc:740] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:31.362298 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:31.363406 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 6abc6a2ae4984413be9ba769d42dc072 (table default.Table_1020721d72be4939981ee823fd491385 [id=595b27bd872444779dc921821e18648d]) successfully deleted
W20260928 20:02:31.363988 26594 leader_election.cc:343] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.364315 27191 tablet_replica.cc:333] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:31.365087 27191 raft_consensus.cc:2243] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:31.365015 27171 raft_consensus.cc:515] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.366241 27011 log.cc:1199] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:31.368461 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:31.369649 27011 ts_tablet_manager.cc:1996] T a4df1bab40024f97a5ad5acf358e3c26 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:31.369932 27171 leader_election.cc:290] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:31.361636 26912 consensus_queue.cc:260] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.373064 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:31.374400 26594 leader_election.cc:343] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.377126 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.367071 26913 consensus_queue.cc:260] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.381111 26913 ts_tablet_manager.cc:1480] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.077s user 0.006s sys 0.001s
I20260928 20:02:31.384624 26913 tablet_bootstrap.cc:492] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:31.388079 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.366447 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4ea23c18e04819b28d3428d584f3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.401216 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 4604b0cf7e56457086383c4314814b21 (DEFAULT_TABLE table=default.Table_8be4bac0846045f1b0438d588fe17c76 [id=b89fadac9a1245d9a401cab84a9d7c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.402339 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4604b0cf7e56457086383c4314814b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.398157 26912 ts_tablet_manager.cc:1480] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.040s user 0.008s sys 0.000s
W20260928 20:02:31.273331 26233 rpcz_store.cc:269] 0928 20:02:30.317567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:30.317728 (+ 161us) service_pool.cc:224] Handling call
0928 20:02:31.272826 (+955098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:31.136670 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:31.137025 (+ 355us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:31.137058 (+ 33us) write_op.cc:435] Acquired schema lock
0928 20:02:31.137072 (+ 14us) tablet.cc:662] Decoding operations
0928 20:02:31.137287 (+ 215us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:31.137321 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:31.137343 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:31.137465 (+ 122us) tablet.cc:701] Row locks acquired
0928 20:02:31.137479 (+ 14us) write_op.cc:260] PREPARE: finished
0928 20:02:31.137571 (+ 92us) write_op.cc:270] Start()
0928 20:02:31.137639 (+ 68us) write_op.cc:276] Timestamp: P: 1790625751137482 usec, L: 0
0928 20:02:31.137655 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:31.138058 (+ 403us) log.cc:844] Serialized 356 byte log entry
0928 20:02:31.249463 (+111405us) op_driver.cc:464] REPLICATION: finished
0928 20:02:31.250305 (+ 842us) write_op.cc:301] APPLY: starting
0928 20:02:31.250384 (+ 79us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:31.250512 (+ 128us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:31.250637 (+ 125us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:31.250904 (+ 267us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:31.251080 (+ 176us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:31.251145 (+ 65us) write_op.cc:312] APPLY: finished
0928 20:02:31.251361 (+ 216us) log.cc:844] Serialized 23 byte log entry
0928 20:02:31.251517 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:31.251587 (+ 70us) write_op.cc:454] Released schema lock
0928 20:02:31.251633 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":662,"apply.run_cpu_time_us":1563,"apply.run_wall_time_us":1563,"num_ops":1,"prepare.queue_time_us":93907,"prepare.run_cpu_time_us":1590,"prepare.run_wall_time_us":2581,"replication_time_us":111743}]]}
I20260928 20:02:31.409144 26912 tablet_bootstrap.cc:492] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:31.379284 26916 tablet_bootstrap.cc:492] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:31.410431 26916 ts_tablet_manager.cc:1449] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.501s user 0.098s sys 0.169s
I20260928 20:02:31.381464 26493 tablet_service.cc:1511] Processing CreateTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 (DEFAULT_TABLE table=default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.416074 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee464b814dbf4e4b89b2d1c019befac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.366071 27191 raft_consensus.cc:2272] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.415795 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a66ea6e7060e4febbaaf659c8b702e03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:31.424815 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a66ea6e7060e4febbaaf659c8b702e03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.425383 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 4604b0cf7e56457086383c4314814b21 (DEFAULT_TABLE table=default.Table_8be4bac0846045f1b0438d588fe17c76 [id=b89fadac9a1245d9a401cab84a9d7c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.426370 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4604b0cf7e56457086383c4314814b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.419227 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_9a00e08127ea41d988decb4e501ae54c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:31.429201 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:31.429437 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a00e08127ea41d988decb4e501ae54c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.433004 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.445530 27011 tablet_replica.cc:333] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:31.446415 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet a4df1bab40024f97a5ad5acf358e3c26 (table default.Table_560504da8c694a95a0b601d4f3998d96 [id=ee0ddf3f7b2c42bfb01a4a12edea45d0]) successfully deleted
I20260928 20:02:31.446797 27011 raft_consensus.cc:2243] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:31.447438 27011 pending_rounds.cc:70] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:31.447670 27011 pending_rounds.cc:77] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403074352795648 op_type: NO_OP noop_request { }
I20260928 20:02:31.448001 27011 raft_consensus.cc:2889] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:31.448307 27011 raft_consensus.cc:2272] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.451443 27011 ts_tablet_manager.cc:1962] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:31.451721 26913 tablet_bootstrap.cc:654] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:31.457657 27110 raft_consensus.cc:493] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.458142 27110 raft_consensus.cc:515] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.458863 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 0de800a9344d4507b7903d08fcf8e988 (DEFAULT_TABLE table=default.Table_666ecf839a52492eaf418528a9d9f2cb [id=638372cdd2524730881f90fe443bd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.459945 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de800a9344d4507b7903d08fcf8e988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.460183 27110 leader_election.cc:290] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:31.468145 26595 leader_election.cc:343] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.468626 26595 leader_election.cc:304] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:31.471602 27191 ts_tablet_manager.cc:1962] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:31.475349 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260928 20:02:31.482909 26232 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_15ea4a6742b5444593f1f985deb10b73" } new_table_name: "default.Table_d9dd76f902a14b1eb291e720ba17dd9a" modify_external_catalogs: true
W20260928 20:02:31.489425 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c0fd24cd5adf4774a13aeac30315f6f9 consensus state has no leader
I20260928 20:02:31.493669 26912 tablet_bootstrap.cc:654] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:31.499027 27110 raft_consensus.cc:2749] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:02:31.499647 27110 raft_consensus.cc:493] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.500020 27110 raft_consensus.cc:515] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.502386 27110 leader_election.cc:290] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:31.504504 26916 raft_consensus.cc:359] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:31.505121 26916 raft_consensus.cc:385] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:31.505378 26916 raft_consensus.cc:740] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:31.518275 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_911e0630d48c4bd7b8f844cee768908b" } modify_external_catalogs: true
I20260928 20:02:31.518949 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_911e0630d48c4bd7b8f844cee768908b" } modify_external_catalogs: true
I20260928 20:02:31.505913 26916 consensus_queue.cc:260] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:31.535737 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b22118c942324613837c489142d129fa
I20260928 20:02:31.537282 26227 catalog_manager.cc:6934] ReplaceTablet: tablet b22118c942324613837c489142d129fa deleted and replaced by tablet e2df3978e61a4847b85cd547e76e4e58
I20260928 20:02:31.540200 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 29a489266ffc47a498e8541408a1f6a2
I20260928 20:02:31.542520 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a489266ffc47a498e8541408a1f6a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.556845 27191 ts_tablet_manager.cc:1975] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 20:02:31.453001 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 106254us
I20260928 20:02:31.576953 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:31.576953 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet e162b25e0db14a35bfe6657f620affdb with delete_type TABLET_DATA_DELETED (replaced by tablet e70df4ddf0f9430980c967d798ed6c50) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:31.579223 26776 tablet_service.cc:1511] Processing CreateTablet for tablet afceff93f6f9401f94bab3e376925d12 (DEFAULT_TABLE table=default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.579500 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac (DEFAULT_TABLE table=default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.581638 26775 tablet_service.cc:1511] Processing CreateTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 (DEFAULT_TABLE table=default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.584177 26227 master_service.cc:960] ReplaceTablet: received request to replace tablet d938ea61370c493585d01a30e7381695 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:31.584976 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d73fef88894a51b9fa04cb70e29d43" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:31.586992 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:31.587822 26804 raft_consensus.cc:2468] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:02:31.589937 26594 leader_election.cc:343] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.590728 26594 leader_election.cc:304] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:31.593039 26232 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 502edf35a86646178cfc121519c85c53 consensus state has no leader
I20260928 20:02:31.593916 27171 raft_consensus.cc:2804] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:31.594352 27171 raft_consensus.cc:493] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:31.594709 27171 raft_consensus.cc:3060] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:31.600587 26781 consensus_meta.cc:287] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.631s user 0.010s sys 0.001s
I20260928 20:02:31.602370 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee464b814dbf4e4b89b2d1c019befac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.604687 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:31.604544 27171 raft_consensus.cc:515] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.606515 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet b22118c942324613837c489142d129fa with delete_type TABLET_DATA_DELETED (replaced by tablet e2df3978e61a4847b85cd547e76e4e58) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:31.631840 26595 leader_election.cc:343] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a5d73fef88894a51b9fa04cb70e29d43
I20260928 20:02:31.632501 26595 leader_election.cc:304] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:31.633481 27110 raft_consensus.cc:2749] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:31.636354 26229 catalog_manager.cc:5838] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:31.648527 27152 raft_consensus.cc:493] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.649175 27152 raft_consensus.cc:515] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.652529 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afceff93f6f9401f94bab3e376925d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.659116 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 39fb6f22905945578fa74b671d31c5f3 (table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]). Expected version 1 got 0
I20260928 20:02:31.669237 27215 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:31.673359 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.674686 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 4604b0cf7e56457086383c4314814b21 (DEFAULT_TABLE table=default.Table_8be4bac0846045f1b0438d588fe17c76 [id=b89fadac9a1245d9a401cab84a9d7c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.675504 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet b22118c942324613837c489142d129fa with delete_type TABLET_DATA_DELETED (replaced by tablet e2df3978e61a4847b85cd547e76e4e58) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:31.676882 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a489266ffc47a498e8541408a1f6a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:31.682906 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d4ea23c18e04819b28d3428d584f3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.588469 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet b22118c942324613837c489142d129fa with delete_type TABLET_DATA_DELETED (replaced by tablet e2df3978e61a4847b85cd547e76e4e58) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.588938 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a489266ffc47a498e8541408a1f6a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.589627 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 0de800a9344d4507b7903d08fcf8e988 (DEFAULT_TABLE table=default.Table_666ecf839a52492eaf418528a9d9f2cb [id=638372cdd2524730881f90fe443bd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.686334 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de800a9344d4507b7903d08fcf8e988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.598352 26916 ts_tablet_manager.cc:1480] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.188s user 0.006s sys 0.001s
I20260928 20:02:31.620136 26516 raft_consensus.cc:1275] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:02:31.622495 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:31.651518 27216 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:31.694940 26916 tablet_bootstrap.cc:492] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:31.695073 26515 raft_consensus.cc:2468] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:31.703624 26231 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_34bca48461484fc4a8c9fa9f70fa799f" } new_table_name: "default.Table_b83677aaa3e54ef3a20a07feca2869a9" modify_external_catalogs: true
I20260928 20:02:31.707126 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_60b73bf93b434a499c613715e7cd6464"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:31.708653 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60b73bf93b434a499c613715e7cd6464 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.710561 27191 log.cc:1199] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/882d1d6246dd4b3a81df5c57976ac631
I20260928 20:02:31.711261 27191 ts_tablet_manager.cc:1996] T 882d1d6246dd4b3a81df5c57976ac631 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:31.712076 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_bed2cb6494a544afb978a8521c702d03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:31.713732 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed2cb6494a544afb978a8521c702d03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.720464 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 0de800a9344d4507b7903d08fcf8e988 (DEFAULT_TABLE table=default.Table_666ecf839a52492eaf418528a9d9f2cb [id=638372cdd2524730881f90fe443bd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:31.727871 26913 tablet_bootstrap.cc:492] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:31.728461 26913 ts_tablet_manager.cc:1449] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.347s user 0.062s sys 0.077s
I20260928 20:02:31.730746 26913 raft_consensus.cc:359] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.731348 26913 raft_consensus.cc:385] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:31.731604 26913 raft_consensus.cc:740] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:31.732213 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet d938ea61370c493585d01a30e7381695
I20260928 20:02:31.732134 26913 consensus_queue.cc:260] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.733642 26227 catalog_manager.cc:6934] ReplaceTablet: tablet d938ea61370c493585d01a30e7381695 deleted and replaced by tablet 4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:31.733865 26913 ts_tablet_manager.cc:1480] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 20:02:31.735744 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet d938ea61370c493585d01a30e7381695 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d0308d824cf401c8cca0cf7a950fd53) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.740155 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_fa94560a66aa4d9891c359c5cc04bc63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:31.740355 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_1d2bed217f0242aabcfc3979c76a1757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:31.741671 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa94560a66aa4d9891c359c5cc04bc63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:31.742791 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d2bed217f0242aabcfc3979c76a1757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:31.744246 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_073d3a55143c4c448dce7157adc7abf3" } modify_external_catalogs: true
I20260928 20:02:31.749012 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_073d3a55143c4c448dce7157adc7abf3" } modify_external_catalogs: true
I20260928 20:02:31.651724 27152 leader_election.cc:290] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:31.759791 27210 tablet_replica.cc:333] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:31.760767 27210 raft_consensus.cc:2243] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:31.761155 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet d938ea61370c493585d01a30e7381695 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d0308d824cf401c8cca0cf7a950fd53) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:31.761269 27210 raft_consensus.cc:2272] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.765710 27213 consensus_queue.cc:1048] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:31.770092 27213 consensus_queue.cc:1048] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:31.774541 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a5d73fef88894a51b9fa04cb70e29d43 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a5d73fef88894a51b9fa04cb70e29d43 consensus state has no leader
I20260928 20:02:31.776526 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4604b0cf7e56457086383c4314814b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.784274 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:31.786386 26594 consensus_peers.cc:597] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:31.713707 27191 tablet_replica.cc:333] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:31.747680 27160 raft_consensus.cc:493] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.790874 27160 raft_consensus.cc:515] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:31.792718 27160 leader_election.cc:290] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:31.796236 27171 leader_election.cc:290] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:31.801525 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:31.802201 26516 raft_consensus.cc:3060] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:31.728792 26916 tablet_bootstrap.cc:654] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:31.811693 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:31.812428 26804 raft_consensus.cc:3060] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:31.814374 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d374d592fda8402faac70a923049c9ad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:31.815939 26450 leader_election.cc:343] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.836856 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:31.837491 26913 tablet_bootstrap.cc:492] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:31.837664 26658 raft_consensus.cc:2393] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:31.839655 26659 raft_consensus.cc:1275] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 20:02:31.839982 26659 pending_rounds.cc:85] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting all ops after (but not including) 0
I20260928 20:02:31.840246 26659 pending_rounds.cc:107] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 20:02:31.840489 26659 raft_consensus.cc:2889] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 20:02:31.842454 27210 ts_tablet_manager.cc:1962] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:31.844079 27011 ts_tablet_manager.cc:1975] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:31.844174 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d374d592fda8402faac70a923049c9ad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:31.844583 27011 log.cc:1199] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:31.845433 27011 ts_tablet_manager.cc:1996] T 6abc6a2ae4984413be9ba769d42dc072 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:31.714882 26448 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 47958.2us
W20260928 20:02:31.875434 26450 leader_election.cc:343] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.875849 26450 leader_election.cc:304] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:31.882836 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 882d1d6246dd4b3a81df5c57976ac631 (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]) successfully deleted
I20260928 20:02:31.890292 27160 raft_consensus.cc:2749] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:31.890996 26516 raft_consensus.cc:2468] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:31.891891 27191 raft_consensus.cc:2243] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:31.891767 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9a3c09ef67584c93a83248d42b2bf91d" } new_table_name: "default.Table_45db10c8c743416a901b9737ed72fb04" modify_external_catalogs: true
I20260928 20:02:31.892380 27011 tablet_replica.cc:333] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:31.892345 27191 raft_consensus.cc:2272] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.892777 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a489266ffc47a498e8541408a1f6a2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:31.893066 27011 raft_consensus.cc:2243] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:31.893476 26514 raft_consensus.cc:2393] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:31.893743 27011 pending_rounds.cc:70] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:31.893695 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 6abc6a2ae4984413be9ba769d42dc072 (table default.Table_1020721d72be4939981ee823fd491385 [id=595b27bd872444779dc921821e18648d]) successfully deleted
I20260928 20:02:31.893935 27011 pending_rounds.cc:77] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403074807894016 op_type: NO_OP noop_request { }
I20260928 20:02:31.894255 27011 raft_consensus.cc:2889] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260928 20:02:31.894403 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 57189d2450924921aecc1ee81c1cb952 because the tablet was not found. No further retry: Not found: Tablet not found: 57189d2450924921aecc1ee81c1cb952
I20260928 20:02:31.894565 27011 raft_consensus.cc:2272] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:31.896327 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet d938ea61370c493585d01a30e7381695 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d0308d824cf401c8cca0cf7a950fd53) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.897262 27191 ts_tablet_manager.cc:1962] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:31.903396 26595 leader_election.cc:304] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:31.904203 27171 raft_consensus.cc:2804] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:31.911494 27171 raft_consensus.cc:697] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:31.911756 26234 master_service.cc:960] ReplaceTablet: received request to replace tablet 29a489266ffc47a498e8541408a1f6a2 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:31.911742 27202 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:31.912158 27202 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:31.912328 27171 consensus_queue.cc:237] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.914521 27202 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:31.918462 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:31.920136 26450 leader_election.cc:343] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.930357 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de800a9344d4507b7903d08fcf8e988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:31.932606 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet ff4f7ca1b194471bbad778ac4e89f6c7
I20260928 20:02:31.935209 26912 tablet_bootstrap.cc:492] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:31.935726 26912 ts_tablet_manager.cc:1449] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.527s user 0.010s sys 0.028s
I20260928 20:02:31.937604 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:31.939865 26740 leader_election.cc:304] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:31.940830 27152 consensus_queue.cc:1048] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:31.942090 27152 consensus_queue.cc:1048] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:31.943964 26450 leader_election.cc:343] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:31.944337 26450 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:31.946064 27202 raft_consensus.cc:2749] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:31.943459 26912 raft_consensus.cc:359] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.947860 26912 raft_consensus.cc:385] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:02:31.947978 26594 consensus_peers.cc:597] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:31.948125 26912 raft_consensus.cc:740] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:31.948745 26912 consensus_queue.cc:260] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:31.955284 26912 ts_tablet_manager.cc:1480] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260928 20:02:31.956195 26912 tablet_bootstrap.cc:492] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:31.967032 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.967032 27191 ts_tablet_manager.cc:1975] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:31.974972 27191 log.cc:1199] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/d6c0cc7bd109493cacf990dd1e2728f0
I20260928 20:02:31.976104 27191 ts_tablet_manager.cc:1996] T d6c0cc7bd109493cacf990dd1e2728f0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:31.978076 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet d6c0cc7bd109493cacf990dd1e2728f0 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]) successfully deleted
I20260928 20:02:31.979954 27191 tablet_replica.cc:333] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:31.986954 27191 raft_consensus.cc:2243] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:31.991245 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:31.992668 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 56d16f263a4d439b98ea11156f4997fe
I20260928 20:02:31.994410 27191 pending_rounds.cc:70] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Trying to abort 1 pending ops.
I20260928 20:02:31.994668 27191 pending_rounds.cc:77] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403074807894016 op_type: NO_OP noop_request { }
I20260928 20:02:31.995636 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d16f263a4d439b98ea11156f4997fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:31.998800 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d16f263a4d439b98ea11156f4997fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:31.995045 27191 raft_consensus.cc:2889] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:31.999677 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:32.000303 27191 raft_consensus.cc:2272] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.004289 26912 tablet_bootstrap.cc:654] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.010241 26913 tablet_bootstrap.cc:654] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.019493 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:32.020706 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:32.029413 26916 tablet_bootstrap.cc:492] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:32.029848 26916 ts_tablet_manager.cc:1449] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.335s user 0.007s sys 0.004s
I20260928 20:02:32.032037 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet a4df1bab40024f97a5ad5acf358e3c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:28 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:32.034425 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee464b814dbf4e4b89b2d1c019befac6) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:32.045926 26595 consensus_peers.cc:597] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6c0cc7bd109493cacf990dd1e2728f0. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:32.046756 27191 ts_tablet_manager.cc:1962] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:32.051729 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab9f9f2f9b96435e983f1ee2679563ff consensus state has no leader
I20260928 20:02:32.052992 27011 ts_tablet_manager.cc:1962] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.059477 26913 tablet_bootstrap.cc:492] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:32.059926 26913 ts_tablet_manager.cc:1449] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.223s user 0.009s sys 0.003s
I20260928 20:02:32.062368 26913 raft_consensus.cc:359] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.065732 26913 raft_consensus.cc:385] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.069221 26916 raft_consensus.cc:359] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.070245 26913 raft_consensus.cc:740] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.070391 26916 raft_consensus.cc:385] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.070756 26916 raft_consensus.cc:740] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.071632 26916 consensus_queue.cc:260] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.071461 26913 consensus_queue.cc:260] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.074123 26916 ts_tablet_manager.cc:1480] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.004s sys 0.004s
I20260928 20:02:32.075660 26913 ts_tablet_manager.cc:1480] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260928 20:02:32.079550 26913 tablet_bootstrap.cc:492] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:32.097240 26916 tablet_bootstrap.cc:492] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:32.098322 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8e0787227c634ee9af63b3cb775c37bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:32.100656 27214 raft_consensus.cc:493] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.101111 27214 raft_consensus.cc:515] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.103372 27214 leader_election.cc:290] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.105008 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_495c2b52ba314f338d8f81d8bf071236"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:32.105858 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4f7ca1b194471bbad778ac4e89f6c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:32.106595 26515 raft_consensus.cc:2468] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:32.108086 26595 leader_election.cc:304] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:32.109524 27171 raft_consensus.cc:2804] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:32.109827 27171 raft_consensus.cc:493] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:32.110126 27171 raft_consensus.cc:3060] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:32.115156 27218 raft_consensus.cc:493] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.115665 27218 raft_consensus.cc:515] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.119884 27218 leader_election.cc:290] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:32.127660 27221 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:32.127532 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938ea61370c493585d01a30e7381695" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:32.129866 26450 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.137089 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_08b55d52f8a64fba90ccea539ecd0681" } modify_external_catalogs: true
I20260928 20:02:32.137662 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_08b55d52f8a64fba90ccea539ecd0681" } modify_external_catalogs: true
I20260928 20:02:32.148610 26916 tablet_bootstrap.cc:654] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:32.154240 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_495c2b52ba314f338d8f81d8bf071236 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:32.159125 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:32.160704 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:32.166254 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e0787227c634ee9af63b3cb775c37bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:32.177592 26912 tablet_bootstrap.cc:492] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:32.178007 26912 ts_tablet_manager.cc:1449] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.222s user 0.022s sys 0.059s
I20260928 20:02:32.120616 26804 raft_consensus.cc:2468] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:32.187234 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938ea61370c493585d01a30e7381695" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:32.183696 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 244021us
I20260928 20:02:32.187283 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4f7ca1b194471bbad778ac4e89f6c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:32.192503 26235 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet e2df3978e61a4847b85cd547e76e4e58
I20260928 20:02:32.183220 27152 raft_consensus.cc:2749] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:32.210873 26450 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.211298 26450 leader_election.cc:304] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:32.212339 26912 raft_consensus.cc:359] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.212980 26912 raft_consensus.cc:385] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.213234 26912 raft_consensus.cc:740] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.213831 26912 consensus_queue.cc:260] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.234556 26912 ts_tablet_manager.cc:1480] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.056s user 0.006s sys 0.000s
I20260928 20:02:32.237458 26912 tablet_bootstrap.cc:492] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:32.237834 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0f0ada7547004715aeb96e77c7a7f3ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:32.239461 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f0ada7547004715aeb96e77c7a7f3ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:32.134279 26913 tablet_bootstrap.cc:654] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.141105 27214 consensus_queue.cc:1048] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:32.155907 27011 ts_tablet_manager.cc:1975] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:32.242055 27171 raft_consensus.cc:515] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.245185 27011 log.cc:1199] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/e162b25e0db14a35bfe6657f620affdb
I20260928 20:02:32.245985 27011 ts_tablet_manager.cc:1996] T e162b25e0db14a35bfe6657f620affdb P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:32.247675 27171 leader_election.cc:290] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.248401 27011 tablet_replica.cc:333] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:32.249125 27011 raft_consensus.cc:2243] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:32.249682 26913 tablet_bootstrap.cc:492] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:32.249734 27011 pending_rounds.cc:70] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:32.164721 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:32.250157 26913 ts_tablet_manager.cc:1449] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.171s user 0.008s sys 0.004s
W20260928 20:02:32.209249 26594 leader_election.cc:343] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:32.251811 26594 consensus_peers.cc:597] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:32.252490 26913 raft_consensus.cc:359] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.253080 26913 raft_consensus.cc:385] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.253326 26913 raft_consensus.cc:740] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.254190 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4f7ca1b194471bbad778ac4e89f6c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:32.255542 26594 leader_election.cc:343] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.258195 27196 raft_consensus.cc:493] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.258337 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet e162b25e0db14a35bfe6657f620affdb (table default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]) successfully deleted
I20260928 20:02:32.258605 27196 raft_consensus.cc:515] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.260941 27196 leader_election.cc:290] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.261723 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9677ccc247274c458c2a6d666b0546f1" } new_table_name: "default.Table_e3405e57e5f24f9897ccba60b873c071" modify_external_catalogs: true
I20260928 20:02:32.216102 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d16f263a4d439b98ea11156f4997fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:32.262414 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d73fef88894a51b9fa04cb70e29d43" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:32.214759 27223 raft_consensus.cc:493] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.263003 26657 raft_consensus.cc:2468] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:32.264277 26739 leader_election.cc:304] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:32.265185 27196 raft_consensus.cc:2804] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:32.265611 27196 raft_consensus.cc:493] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:32.265983 27196 raft_consensus.cc:3060] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:32.249967 27011 pending_rounds.cc:77] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403080365072384 op_type: NO_OP noop_request { }
I20260928 20:02:32.266717 27011 raft_consensus.cc:2889] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:32.267074 27011 raft_consensus.cc:2272] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.263175 27223 raft_consensus.cc:515] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.271499 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa" } modify_external_catalogs: true
I20260928 20:02:32.272050 27223 leader_election.cc:290] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.272163 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa" } modify_external_catalogs: true
W20260928 20:02:32.274351 26739 leader_election.cc:343] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:32.253906 26913 consensus_queue.cc:260] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.285218 27218 raft_consensus.cc:2749] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:32.286674 26913 ts_tablet_manager.cc:1480] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.036s user 0.004s sys 0.002s
I20260928 20:02:32.288475 27210 ts_tablet_manager.cc:1975] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:32.288911 27210 log.cc:1199] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/e162b25e0db14a35bfe6657f620affdb
I20260928 20:02:32.289897 27210 ts_tablet_manager.cc:1996] T e162b25e0db14a35bfe6657f620affdb P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:32.290927 26913 tablet_bootstrap.cc:492] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:32.300738 27011 ts_tablet_manager.cc:1962] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.305622 27210 tablet_replica.cc:333] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:32.319973 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet e162b25e0db14a35bfe6657f620affdb (table default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]) successfully deleted
W20260928 20:02:32.320732 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet b087dcc9d5be4a9e89c35c359a18ca5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b087dcc9d5be4a9e89c35c359a18ca5c already in progress: creating tablet
I20260928 20:02:32.324633 27191 ts_tablet_manager.cc:1975] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:32.325119 27191 log.cc:1199] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/e162b25e0db14a35bfe6657f620affdb
I20260928 20:02:32.325953 27191 ts_tablet_manager.cc:1996] T e162b25e0db14a35bfe6657f620affdb P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:32.327481 26913 tablet_bootstrap.cc:654] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.328384 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 102) took 1047 ms. Trace:
I20260928 20:02:32.330075 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4f7ca1b194471bbad778ac4e89f6c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:32.335386 26512 raft_consensus.cc:3060] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:32.279002 26912 tablet_bootstrap.cc:654] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:32.319428 26740 leader_election.cc:343] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a5d73fef88894a51b9fa04cb70e29d43
W20260928 20:02:32.345517 26740 leader_election.cc:343] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:32.346225 26740 leader_election.cc:304] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:32.343864 26512 raft_consensus.cc:2468] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:32.347810 26595 leader_election.cc:304] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:32.348634 27171 raft_consensus.cc:2804] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:32.349077 27171 raft_consensus.cc:697] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:32.349857 27171 consensus_queue.cc:237] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.360731 27223 raft_consensus.cc:2749] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:32.348603 26912 tablet_bootstrap.cc:492] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:32.362810 26912 ts_tablet_manager.cc:1449] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.126s user 0.013s sys 0.000s
I20260928 20:02:32.366026 26912 raft_consensus.cc:359] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.363313 27191 rpcz_store.cc:276] 0928 20:02:31.280837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.280996 (+ 159us) service_pool.cc:224] Handling call
0928 20:02:31.979782 (+698786us) ts_tablet_manager.cc:1197] Deleting tablet e162b25e0db14a35bfe6657f620affdb
0928 20:02:31.979833 (+ 51us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.105378 (+125545us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.324487 (+219109us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.328305 (+ 3818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":698199}
I20260928 20:02:32.371348 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:32.377951 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet e162b25e0db14a35bfe6657f620affdb (table default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]) successfully deleted
I20260928 20:02:32.378505 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 99) took 1133 ms. Trace:
I20260928 20:02:32.378840 27191 rpcz_store.cc:276] 0928 20:02:31.244691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.282316 (+ 37625us) service_pool.cc:224] Handling call
0928 20:02:32.378098 (+1095782us) ts_tablet_manager.cc:1197] Deleting tablet b087dcc9d5be4a9e89c35c359a18ca5c
0928 20:02:32.378165 (+ 67us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.378438 (+ 273us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1095292}
I20260928 20:02:32.350272 27210 raft_consensus.cc:2243] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:32.382493 27210 raft_consensus.cc:2272] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.377249 26236 catalog_manager.cc:5838] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 1 to 2, leader changed from 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194) to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 2 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } }
W20260928 20:02:32.384265 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet b087dcc9d5be4a9e89c35c359a18ca5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b087dcc9d5be4a9e89c35c359a18ca5c already in progress: creating tablet
I20260928 20:02:32.384433 27210 ts_tablet_manager.cc:1962] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.391654 26912 raft_consensus.cc:385] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.391975 26912 raft_consensus.cc:740] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.392714 26490 tablet_service.cc:1511] Processing CreateTablet for tablet fa037333676c4dba93160c5e3337f891 (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.392640 26912 consensus_queue.cc:260] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.376883 27196 raft_consensus.cc:515] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.393822 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa037333676c4dba93160c5e3337f891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.396075 26916 tablet_bootstrap.cc:492] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:32.396492 26916 ts_tablet_manager.cc:1449] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.299s user 0.012s sys 0.006s
I20260928 20:02:32.393926 27191 tablet_replica.cc:333] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:32.398500 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d73fef88894a51b9fa04cb70e29d43" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:32.399077 26657 raft_consensus.cc:3060] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:32.405547 27196 leader_election.cc:290] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:32.410586 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47bf3dd9ed054197b4208324938d96b0 consensus state has no leader
I20260928 20:02:32.417209 26913 tablet_bootstrap.cc:492] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:32.417624 26913 ts_tablet_manager.cc:1449] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.127s user 0.009s sys 0.010s
I20260928 20:02:32.420302 26913 raft_consensus.cc:359] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:32.420658 26633 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:53864: Illegal state: replica 92fd8074a7df4bba87a73c0d84ed00c8 is not leader of this config: current role FOLLOWER
I20260928 20:02:32.420905 26913 raft_consensus.cc:385] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.421150 26913 raft_consensus.cc:740] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.421232 26631 tablet_service.cc:1511] Processing CreateTablet for tablet fa037333676c4dba93160c5e3337f891 (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.421520 26227 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0dfdabdeae0a4bf1ba4dd59d4bbc98ca" } modify_external_catalogs: true
I20260928 20:02:32.422160 26227 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0dfdabdeae0a4bf1ba4dd59d4bbc98ca" } modify_external_catalogs: true
I20260928 20:02:32.422817 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 (DEFAULT_TABLE table=default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.423959 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa037333676c4dba93160c5e3337f891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.426517 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e7228a68b84f2aab2bfa582fa25ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.430612 26916 raft_consensus.cc:359] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.431229 26916 raft_consensus.cc:385] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.431241 26657 raft_consensus.cc:2468] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:32.431452 26916 raft_consensus.cc:740] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.434207 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 (DEFAULT_TABLE table=default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.435201 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e7228a68b84f2aab2bfa582fa25ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.421711 26913 consensus_queue.cc:260] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:32.448022 26222 catalog_manager.cc:5142] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): alter failed for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_b83677aaa3e54ef3a20a07feca2869a9 [id=219bcf821c96465eb48c3199ea6f4237]): Illegal state: replica 92fd8074a7df4bba87a73c0d84ed00c8 is not leader of this config: current role FOLLOWER
I20260928 20:02:32.449326 26913 ts_tablet_manager.cc:1480] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.031s user 0.004s sys 0.004s
I20260928 20:02:32.450188 26913 tablet_bootstrap.cc:492] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:32.451570 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 1d016129c3a140518cf310089360c7b7 (DEFAULT_TABLE table=default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.452644 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d016129c3a140518cf310089360c7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.463830 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 1d016129c3a140518cf310089360c7b7 (DEFAULT_TABLE table=default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.464938 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d016129c3a140518cf310089360c7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.473096 26913 tablet_bootstrap.cc:654] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.432421 26739 leader_election.cc:304] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:32.478485 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46145.2us
I20260928 20:02:32.447520 27223 raft_consensus.cc:493] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.463011 26777 tablet_service.cc:1511] Processing CreateTablet for tablet fa037333676c4dba93160c5e3337f891 (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.479750 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa037333676c4dba93160c5e3337f891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.465449 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 (DEFAULT_TABLE table=default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.482962 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e7228a68b84f2aab2bfa582fa25ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.482755 26493 tablet_service.cc:1511] Processing CreateTablet for tablet edc62660134e45f8bc958e95f4e56906 (DEFAULT_TABLE table=default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 [id=41a61dca03a547108d47b214ba83b90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.483748 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc62660134e45f8bc958e95f4e56906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.467712 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 1d016129c3a140518cf310089360c7b7 (DEFAULT_TABLE table=default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.486888 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d016129c3a140518cf310089360c7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.493422 26636 tablet_service.cc:1511] Processing CreateTablet for tablet edc62660134e45f8bc958e95f4e56906 (DEFAULT_TABLE table=default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 [id=41a61dca03a547108d47b214ba83b90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.494678 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc62660134e45f8bc958e95f4e56906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.502277 27223 raft_consensus.cc:515] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.502956 27191 raft_consensus.cc:2243] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:32.504372 27238 raft_consensus.cc:2804] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:32.520789 27191 raft_consensus.cc:2272] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.530293 27238 raft_consensus.cc:697] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:32.532243 27238 consensus_queue.cc:237] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.534915 27191 ts_tablet_manager.cc:1962] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.505175 27223 leader_election.cc:290] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:32.536687 26740 leader_election.cc:343] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a5d73fef88894a51b9fa04cb70e29d43
W20260928 20:02:32.538874 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 70489.1us
I20260928 20:02:32.540860 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_de02ea49d88141cc8f34789367523d0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:32.474700 26912 ts_tablet_manager.cc:1480] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.111s user 0.005s sys 0.000s
I20260928 20:02:32.543447 26912 tablet_bootstrap.cc:492] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:32.543162 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_438a2bd078e04a3e87064ca81d283559"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:32.545084 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_438a2bd078e04a3e87064ca81d283559 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:32.547693 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de02ea49d88141cc8f34789367523d0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:32.529799 27237 log.cc:927] Time spent T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.163s user 0.000s sys 0.000s
I20260928 20:02:32.563704 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:32.564857 26740 leader_election.cc:343] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 57189d2450924921aecc1ee81c1cb952
W20260928 20:02:32.565779 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:32.572501 26783 tablet_service.cc:1511] Processing CreateTablet for tablet edc62660134e45f8bc958e95f4e56906 (DEFAULT_TABLE table=default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 [id=41a61dca03a547108d47b214ba83b90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.516176 26916 consensus_queue.cc:260] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.583460 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (DEFAULT_TABLE table=default.Table_366a7f185d964b76bfac11395c9e3e0c [id=ac9430174dcd4c03af6e216a86dc8497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.583446 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc62660134e45f8bc958e95f4e56906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.587276 26916 ts_tablet_manager.cc:1480] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.191s user 0.003s sys 0.002s
I20260928 20:02:32.587549 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d91ea748a94cb7a75cbbd2f39f49f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.588124 26916 tablet_bootstrap.cc:492] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:32.588634 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:32.590374 26230 catalog_manager.cc:6934] ReplaceTablet: tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 deleted and replaced by tablet a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:32.595773 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (DEFAULT_TABLE table=default.Table_366a7f185d964b76bfac11395c9e3e0c [id=ac9430174dcd4c03af6e216a86dc8497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.596906 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d91ea748a94cb7a75cbbd2f39f49f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.597913 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:32.615593 26912 tablet_bootstrap.cc:654] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.608062 27171 raft_consensus.cc:493] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.617959 27171 raft_consensus.cc:515] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.621264 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (DEFAULT_TABLE table=default.Table_366a7f185d964b76bfac11395c9e3e0c [id=ac9430174dcd4c03af6e216a86dc8497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.621646 27171 leader_election.cc:290] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.622329 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d91ea748a94cb7a75cbbd2f39f49f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.623080 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d374d592fda8402faac70a923049c9ad" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:32.623673 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 946f215581734bf591ab05502e5ff4a0 (DEFAULT_TABLE table=default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd [id=78b4f1c42b7347169b12fd63aad7323e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:32.624336 26595 leader_election.cc:343] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Illegal state: Tablet not RUNNING: STOPPED
I20260928 20:02:32.624585 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 946f215581734bf591ab05502e5ff4a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:32.629369 26631 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:53864: Illegal state: replica 92fd8074a7df4bba87a73c0d84ed00c8 is not leader of this config: current role FOLLOWER
I20260928 20:02:32.643740 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:32.647240 26490 tablet_service.cc:1511] Processing CreateTablet for tablet a9a8177684ed461cbc7bbc4aeb30873c (DEFAULT_TABLE table=default.Table_b624c955d67b4573ac8431cd87fffb48 [id=a6241269939c4539979d41f860203228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.648656 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a8177684ed461cbc7bbc4aeb30873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.653154 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 946f215581734bf591ab05502e5ff4a0 (DEFAULT_TABLE table=default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd [id=78b4f1c42b7347169b12fd63aad7323e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.654610 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 946f215581734bf591ab05502e5ff4a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:32.658458 26739 leader_election.cc:343] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 57189d2450924921aecc1ee81c1cb952
I20260928 20:02:32.659134 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:32.660770 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 946f215581734bf591ab05502e5ff4a0 (DEFAULT_TABLE table=default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd [id=78b4f1c42b7347169b12fd63aad7323e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.661787 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 946f215581734bf591ab05502e5ff4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.658902 26739 leader_election.cc:304] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:32.662892 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d374d592fda8402faac70a923049c9ad" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:32.663820 27196 raft_consensus.cc:2749] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:32.667169 27210 ts_tablet_manager.cc:1975] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 20:02:32.670550 26594 leader_election.cc:343] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.671020 26594 leader_election.cc:304] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:32.671769 27171 raft_consensus.cc:2749] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:32.675484 27210 log.cc:1199] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/29a489266ffc47a498e8541408a1f6a2
I20260928 20:02:32.676354 27210 ts_tablet_manager.cc:1996] T 29a489266ffc47a498e8541408a1f6a2 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:32.690891 27210 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 100) took 1019 ms. Trace:
I20260928 20:02:32.691331 27210 rpcz_store.cc:276] 0928 20:02:31.671713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.676225 (+ 4512us) service_pool.cc:224] Handling call
0928 20:02:32.305481 (+629256us) ts_tablet_manager.cc:1197] Deleting tablet 29a489266ffc47a498e8541408a1f6a2
0928 20:02:32.305520 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.563118 (+257598us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.667039 (+103921us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.690824 (+ 23785us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":628151}
I20260928 20:02:32.694017 26913 tablet_bootstrap.cc:492] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:32.696818 26913 ts_tablet_manager.cc:1449] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.247s user 0.054s sys 0.061s
I20260928 20:02:32.699150 26913 raft_consensus.cc:359] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.699736 26913 raft_consensus.cc:385] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.699990 26913 raft_consensus.cc:740] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.695165 27210 tablet_replica.cc:333] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:32.700623 26913 consensus_queue.cc:260] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.702076 27210 raft_consensus.cc:2243] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:32.703135 27210 raft_consensus.cc:2272] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.705261 27210 ts_tablet_manager.cc:1962] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.707358 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9513d351920c4195b6b8f30509cabfe2" } new_table_name: "default.Table_fbfbe10e93f741f486e85860be3887b9" modify_external_catalogs: true
I20260928 20:02:32.699880 27248 tablet.cc:1751] T 39fb6f22905945578fa74b671d31c5f3 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:32.714368 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 09bd74bc45d14e789567df6019f6d99b (DEFAULT_TABLE table=default.Table_94bb7f9333bc4698ad05e23d6003988a [id=3dab28923da541d880df28b2119b4de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.715480 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bd74bc45d14e789567df6019f6d99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.718479 26916 tablet_bootstrap.cc:654] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.735356 26913 ts_tablet_manager.cc:1480] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20260928 20:02:32.754581 27210 ts_tablet_manager.cc:1975] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:32.758829 27210 log.cc:1199] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/56d16f263a4d439b98ea11156f4997fe
I20260928 20:02:32.759907 27210 ts_tablet_manager.cc:1996] T 56d16f263a4d439b98ea11156f4997fe P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:32.762220 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_b83677aaa3e54ef3a20a07feca2869a9 [id=219bcf821c96465eb48c3199ea6f4237]). Expected version 1 got 0
I20260928 20:02:32.764151 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 39fb6f22905945578fa74b671d31c5f3 (table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]). Expected version 1 got 0
I20260928 20:02:32.764025 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc (DEFAULT_TABLE table=default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.765012 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cda7651d4cf4c7e82c7329735e6bdcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.768508 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_b83677aaa3e54ef3a20a07feca2869a9 [id=219bcf821c96465eb48c3199ea6f4237]). Expected version 1 got 0
I20260928 20:02:32.789381 26916 tablet_bootstrap.cc:492] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:32.789793 26916 ts_tablet_manager.cc:1449] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.202s user 0.010s sys 0.002s
I20260928 20:02:32.792124 26916 raft_consensus.cc:359] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:32.792734 26916 raft_consensus.cc:385] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.792984 26916 raft_consensus.cc:740] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.797575 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:32.800128 27191 ts_tablet_manager.cc:1975] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:32.800323 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:32.800537 27191 log.cc:1199] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/d374d592fda8402faac70a923049c9ad
I20260928 20:02:32.801221 27191 ts_tablet_manager.cc:1996] T d374d592fda8402faac70a923049c9ad P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:32.817515 26493 tablet_service.cc:1511] Processing CreateTablet for tablet c4de78b7781d43458cbf2d3e889357fc (DEFAULT_TABLE table=default.Table_7b71cef2215d4ba9a0d4cdb625664604 [id=f55e212e2f97427fba3f983fb0ff2cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.819242 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 104) took 1468 ms. Trace:
I20260928 20:02:32.821971 27191 rpcz_store.cc:276] 0928 20:02:31.350499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.351337 (+ 838us) service_pool.cc:224] Handling call
0928 20:02:32.393756 (+1042419us) ts_tablet_manager.cc:1197] Deleting tablet d374d592fda8402faac70a923049c9ad
0928 20:02:32.393804 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.741899 (+348095us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.800000 (+ 58101us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.819183 (+ 19183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105916,"tablet-delete.queue_time_us":1041909}
I20260928 20:02:32.823254 27191 tablet_replica.cc:333] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:32.824028 27191 raft_consensus.cc:2243] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:32.824441 27191 raft_consensus.cc:2272] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.825385 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet afceff93f6f9401f94bab3e376925d12
I20260928 20:02:32.825519 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet d374d592fda8402faac70a923049c9ad (table default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]) successfully deleted
I20260928 20:02:32.828027 27191 ts_tablet_manager.cc:1962] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.828758 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:32.829615 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4de78b7781d43458cbf2d3e889357fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.836282 26494 tablet_service.cc:1511] Processing CreateTablet for tablet e70df4ddf0f9430980c967d798ed6c50 (DEFAULT_TABLE table=default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.847476 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 8163815661694d70ba4c2e36a424eaa1 (DEFAULT_TABLE table=default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.848515 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8163815661694d70ba4c2e36a424eaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.848230 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7a89876f5095449caf48d4b9430b1037"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:32.850371 26916 consensus_queue.cc:260] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:32.853309 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8e0787227c634ee9af63b3cb775c37bc" } new_table_name: "default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27" modify_external_catalogs: true
W20260928 20:02:32.849845 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a89876f5095449caf48d4b9430b1037 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:32.861146 27214 raft_consensus.cc:493] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.861814 27214 raft_consensus.cc:515] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.864388 27214 leader_election.cc:290] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.865162 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:32.865440 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:32.866021 26516 raft_consensus.cc:2468] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:02:32.866760 26594 leader_election.cc:343] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.867340 26595 leader_election.cc:304] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:32.868432 27214 raft_consensus.cc:2804] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:32.868798 27214 raft_consensus.cc:493] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:32.869184 27214 raft_consensus.cc:3060] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:32.875193 27191 ts_tablet_manager.cc:1975] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:32.875595 27191 log.cc:1199] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b22118c942324613837c489142d129fa
I20260928 20:02:32.876493 27214 raft_consensus.cc:515] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.879315 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:32.880729 26594 leader_election.cc:343] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.882861 27191 ts_tablet_manager.cc:1996] T b22118c942324613837c489142d129fa P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:32.877791 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70df4ddf0f9430980c967d798ed6c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.892349 26234 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_b83677aaa3e54ef3a20a07feca2869a9 [id=219bcf821c96465eb48c3199ea6f4237]). Expected version 1 got 0
I20260928 20:02:32.894060 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 109) took 1305 ms. Trace:
I20260928 20:02:32.898726 27191 rpcz_store.cc:276] 0928 20:02:31.588263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.588352 (+ 89us) service_pool.cc:224] Handling call
0928 20:02:32.823101 (+1234749us) ts_tablet_manager.cc:1197] Deleting tablet b22118c942324613837c489142d129fa
0928 20:02:32.823147 (+ 46us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.844099 (+ 20952us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.875066 (+ 30967us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:32.893810 (+ 18744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5007,"tablet-delete.queue_time_us":1137896}
I20260928 20:02:32.900532 27191 tablet_replica.cc:333] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:32.900745 27246 tablet.cc:1751] T 39fb6f22905945578fa74b671d31c5f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:32.901578 27191 raft_consensus.cc:2243] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:32.902184 27191 raft_consensus.cc:2272] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:32.904218 27191 ts_tablet_manager.cc:1962] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:32.909966 26912 tablet_bootstrap.cc:492] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:32.910483 26912 ts_tablet_manager.cc:1449] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.367s user 0.019s sys 0.000s
I20260928 20:02:32.912681 26912 raft_consensus.cc:359] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:32.913290 26912 raft_consensus.cc:385] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:32.913547 26912 raft_consensus.cc:740] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:32.920746 26916 ts_tablet_manager.cc:1480] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.131s user 0.005s sys 0.000s
I20260928 20:02:32.921330 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_b203e56277cd4bb183c04c5f2403777e [id=75885afaa1e345bbbd03e28c895c79d5] alter complete (version 3)
I20260928 20:02:32.923949 26916 tablet_bootstrap.cc:492] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:32.927858 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 29a489266ffc47a498e8541408a1f6a2 (table default.Table_c3df2a4361cf4adbae1547673dacf161 [id=10827de24c9348b8a73fb743b32a9188]) successfully deleted
W20260928 20:02:32.928568 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet d938ea61370c493585d01a30e7381695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d938ea61370c493585d01a30e7381695 already in progress: creating tablet
W20260928 20:02:32.929077 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c23636443834932852f21092be1d1ac has no consensus state
I20260928 20:02:32.930469 26913 tablet_bootstrap.cc:492] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:32.937006 26913 tablet_bootstrap.cc:654] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:32.956846 26236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 30) took 1230 ms (client timeout 1000 ms). Trace:
W20260928 20:02:32.957278 26236 rpcz_store.cc:269] 0928 20:02:31.726007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.726179 (+ 172us) service_pool.cc:224] Handling call
0928 20:02:32.956781 (+1230602us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:32.600446 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:32.600951 (+ 505us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:32.600985 (+ 34us) write_op.cc:435] Acquired schema lock
0928 20:02:32.601006 (+ 21us) tablet.cc:662] Decoding operations
0928 20:02:32.601323 (+ 317us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:32.601377 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:32.601406 (+ 29us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:32.601588 (+ 182us) tablet.cc:701] Row locks acquired
0928 20:02:32.601607 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:32.601734 (+ 127us) write_op.cc:270] Start()
0928 20:02:32.601841 (+ 107us) write_op.cc:276] Timestamp: P: 1790625752601675 usec, L: 0
0928 20:02:32.601864 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:02:32.602509 (+ 645us) log.cc:844] Serialized 536 byte log entry
0928 20:02:32.750807 (+148298us) op_driver.cc:464] REPLICATION: finished
0928 20:02:32.751510 (+ 703us) write_op.cc:301] APPLY: starting
0928 20:02:32.751584 (+ 74us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:32.751682 (+ 98us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:32.751795 (+ 113us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:32.751982 (+ 187us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:32.752125 (+ 143us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:32.752179 (+ 54us) write_op.cc:312] APPLY: finished
0928 20:02:32.752364 (+ 185us) log.cc:844] Serialized 23 byte log entry
0928 20:02:32.752528 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:32.752602 (+ 74us) write_op.cc:454] Released schema lock
0928 20:02:32.752634 (+ 32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":535,"apply.run_cpu_time_us":1327,"apply.run_wall_time_us":1326,"num_ops":1,"prepare.queue_time_us":213004,"prepare.run_cpu_time_us":2475,"prepare.run_wall_time_us":106231,"raft.queue_time_us":11677,"raft.run_cpu_time_us":956,"raft.run_wall_time_us":2035,"replication_time_us":148834}]]}
W20260928 20:02:32.961077 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 4c23636443834932852f21092be1d1ac (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4c23636443834932852f21092be1d1ac has no consensus state
I20260928 20:02:32.967320 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_b83677aaa3e54ef3a20a07feca2869a9 [id=219bcf821c96465eb48c3199ea6f4237]). Expected version 1 got 0
I20260928 20:02:32.968158 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 03370aeac73549a195a16382aa6f9de3 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 2 got 0
I20260928 20:02:32.978693 26490 tablet_service.cc:1511] Processing CreateTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 (DEFAULT_TABLE table=default.Table_53b73d543aa74f4190223084e9c487af [id=2c0cba9356064ab29bd837a988ab4921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:32.979983 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa4f373a46de433eabd3b35b6ed3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:32.984606 27242 raft_consensus.cc:493] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:32.985044 27242 raft_consensus.cc:515] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:32.987067 27242 leader_election.cc:290] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:32.988765 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938ea61370c493585d01a30e7381695" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:32.989413 26515 raft_consensus.cc:2468] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:32.989552 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938ea61370c493585d01a30e7381695" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:32.991091 26595 leader_election.cc:304] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
W20260928 20:02:32.992046 26594 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:32.997172 26916 tablet_bootstrap.cc:654] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:32.999063 27242 raft_consensus.cc:2804] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:32.999457 27242 raft_consensus.cc:493] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:32.999805 27242 raft_consensus.cc:3060] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:33.012789 26495 tablet_service.cc:1511] Processing CreateTablet for tablet a0dd3080d50748d2ad79f472d3c17673 (DEFAULT_TABLE table=default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.013752 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dd3080d50748d2ad79f472d3c17673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.035075 27011 ts_tablet_manager.cc:1975] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:33.035553 27011 log.cc:1199] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/29a489266ffc47a498e8541408a1f6a2
I20260928 20:02:33.036418 27011 ts_tablet_manager.cc:1996] T 29a489266ffc47a498e8541408a1f6a2 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.038643 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 99) took 1497 ms. Trace:
I20260928 20:02:33.042793 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:33.043313 26515 raft_consensus.cc:3060] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:33.049798 26515 raft_consensus.cc:2468] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:33.050839 27191 ts_tablet_manager.cc:1975] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.051175 27191 log.cc:1199] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/29a489266ffc47a498e8541408a1f6a2
I20260928 20:02:33.051764 27191 ts_tablet_manager.cc:1996] T 29a489266ffc47a498e8541408a1f6a2 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:33.053485 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 110) took 1465 ms. Trace:
W20260928 20:02:33.059607 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 143554us
I20260928 20:02:33.063740 26912 consensus_queue.cc:260] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:33.053791 27191 rpcz_store.cc:276] 0928 20:02:31.588550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.588824 (+ 274us) service_pool.cc:224] Handling call
0928 20:02:32.900371 (+1311547us) ts_tablet_manager.cc:1197] Deleting tablet 29a489266ffc47a498e8541408a1f6a2
0928 20:02:32.900413 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.912010 (+ 11597us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.050725 (+138715us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.053430 (+ 2705us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1214973}
I20260928 20:02:33.067633 27191 tablet_replica.cc:333] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:32.929142 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet ff4f7ca1b194471bbad778ac4e89f6c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff4f7ca1b194471bbad778ac4e89f6c7 already in progress: creating tablet
I20260928 20:02:33.067806 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 29a489266ffc47a498e8541408a1f6a2 (table default.Table_c3df2a4361cf4adbae1547673dacf161 [id=10827de24c9348b8a73fb743b32a9188]) successfully deleted
W20260928 20:02:33.067984 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 138850us
I20260928 20:02:33.068499 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 56d16f263a4d439b98ea11156f4997fe (table default.Table_073d3a55143c4c448dce7157adc7abf3 [id=5556b2b20a4343c5b98fc7c73e2aebfd]) successfully deleted
W20260928 20:02:33.069044 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 already in progress: creating tablet
I20260928 20:02:33.074324 27191 raft_consensus.cc:2243] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.074790 27191 raft_consensus.cc:2272] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.076925 27191 ts_tablet_manager.cc:1962] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.079802 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec] alter complete (version 1)
I20260928 20:02:33.079857 26916 tablet_bootstrap.cc:492] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.080331 26916 ts_tablet_manager.cc:1449] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.159s user 0.006s sys 0.007s
W20260928 20:02:33.081130 26228 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 03370aeac73549a195a16382aa6f9de3 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 03370aeac73549a195a16382aa6f9de3 consensus state has no leader
I20260928 20:02:33.090786 26916 raft_consensus.cc:359] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.091601 26916 raft_consensus.cc:385] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.091900 26916 raft_consensus.cc:740] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.051013 26595 leader_election.cc:304] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:33.099278 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48353.9us
I20260928 20:02:33.101433 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc (DEFAULT_TABLE table=default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.092654 26916 consensus_queue.cc:260] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.102362 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cda7651d4cf4c7e82c7329735e6bdcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.106353 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.106506 26916 ts_tablet_manager.cc:1480] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20260928 20:02:33.107239 26916 tablet_bootstrap.cc:492] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.109251 26639 tablet_service.cc:1511] Processing CreateTablet for tablet c4de78b7781d43458cbf2d3e889357fc (DEFAULT_TABLE table=default.Table_7b71cef2215d4ba9a0d4cdb625664604 [id=f55e212e2f97427fba3f983fb0ff2cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.118788 26636 tablet_service.cc:1511] Processing CreateTablet for tablet a9a8177684ed461cbc7bbc4aeb30873c (DEFAULT_TABLE table=default.Table_b624c955d67b4573ac8431cd87fffb48 [id=a6241269939c4539979d41f860203228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.120406 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 09bd74bc45d14e789567df6019f6d99b (DEFAULT_TABLE table=default.Table_94bb7f9333bc4698ad05e23d6003988a [id=3dab28923da541d880df28b2119b4de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.055946 27214 leader_election.cc:290] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.057292 27261 raft_consensus.cc:493] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.121886 27214 raft_consensus.cc:2804] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:33.121554 27261 raft_consensus.cc:515] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.122375 27214 raft_consensus.cc:697] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:33.122874 26916 tablet_bootstrap.cc:654] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.123636 27214 consensus_queue.cc:237] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.124114 27261 leader_election.cc:290] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.128218 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4de78b7781d43458cbf2d3e889357fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.128273 27248 tablet.cc:1751] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:33.132840 27191 ts_tablet_manager.cc:1975] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.135020 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a8177684ed461cbc7bbc4aeb30873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.139794 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bd74bc45d14e789567df6019f6d99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.140161 26916 tablet_bootstrap.cc:492] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.140579 27191 log.cc:1199] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/d938ea61370c493585d01a30e7381695
I20260928 20:02:33.141928 27191 ts_tablet_manager.cc:1996] T d938ea61370c493585d01a30e7381695 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:33.143738 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 111) took 1260 ms. Trace:
I20260928 20:02:33.144101 27191 rpcz_store.cc:276] 0928 20:02:31.883444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.896149 (+ 12705us) service_pool.cc:224] Handling call
0928 20:02:33.067486 (+1171337us) ts_tablet_manager.cc:1197] Deleting tablet d938ea61370c493585d01a30e7381695
0928 20:02:33.067525 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.101365 (+ 33840us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.132724 (+ 31359us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.143682 (+ 10958us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1170621}
I20260928 20:02:33.141067 26916 ts_tablet_manager.cc:1449] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.006s
I20260928 20:02:33.145292 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet d938ea61370c493585d01a30e7381695 (table default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]) successfully deleted
I20260928 20:02:33.146509 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:33.147138 26516 raft_consensus.cc:2468] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:33.147717 26916 raft_consensus.cc:359] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:33.148372 26916 raft_consensus.cc:385] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.148343 26595 leader_election.cc:304] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:33.148643 26916 raft_consensus.cc:740] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.062721 27242 raft_consensus.cc:515] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.149155 27171 raft_consensus.cc:2804] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:33.149495 27171 raft_consensus.cc:493] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:33.149386 26916 consensus_queue.cc:260] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:33.149818 27171 raft_consensus.cc:3060] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:33.151473 26916 ts_tablet_manager.cc:1480] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:02:33.153007 27242 leader_election.cc:290] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.084285 26913 tablet_bootstrap.cc:492] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:33.153714 26913 ts_tablet_manager.cc:1449] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.223s user 0.010s sys 0.003s
I20260928 20:02:33.156767 26913 raft_consensus.cc:359] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.157449 26913 raft_consensus.cc:385] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.157707 26913 raft_consensus.cc:740] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.158253 27171 raft_consensus.cc:515] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.161158 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:33.161466 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:33.161679 26515 raft_consensus.cc:3060] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:33.163787 27191 tablet_replica.cc:333] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:33.164656 27191 raft_consensus.cc:2243] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.165099 27191 raft_consensus.cc:2272] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.165169 27268 tablet.cc:1751] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:33.166741 27191 ts_tablet_manager.cc:1962] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:33.167336 26595 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d938ea61370c493585d01a30e7381695
I20260928 20:02:33.168406 27011 rpcz_store.cc:276] 0928 20:02:31.541475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.542385 (+ 910us) service_pool.cc:224] Handling call
0928 20:02:32.248247 (+705862us) ts_tablet_manager.cc:1197] Deleting tablet 29a489266ffc47a498e8541408a1f6a2
0928 20:02:32.248291 (+ 44us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:32.483932 (+235641us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.034948 (+551016us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.038586 (+ 3638us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":705232}
I20260928 20:02:33.169777 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 98) took 1630 ms. Trace:
I20260928 20:02:33.170078 27011 rpcz_store.cc:276] 0928 20:02:31.539821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.606346 (+ 66525us) service_pool.cc:224] Handling call
0928 20:02:33.169463 (+1563117us) ts_tablet_manager.cc:1197] Deleting tablet b22118c942324613837c489142d129fa
0928 20:02:33.169508 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.169726 (+ 218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1558110}
I20260928 20:02:33.172127 26515 raft_consensus.cc:2468] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:33.173273 26595 leader_election.cc:304] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:33.180758 26912 ts_tablet_manager.cc:1480] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.270s user 0.005s sys 0.000s
I20260928 20:02:33.175040 27171 leader_election.cc:290] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.184079 27171 raft_consensus.cc:2804] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:33.184568 27171 raft_consensus.cc:697] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:33.163831 26916 tablet_bootstrap.cc:492] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.185902 27171 consensus_queue.cc:237] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.187428 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.199707 26635 tablet_service.cc:1511] Processing CreateTablet for tablet e70df4ddf0f9430980c967d798ed6c50 (DEFAULT_TABLE table=default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.200841 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70df4ddf0f9430980c967d798ed6c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.202663 26912 tablet_bootstrap.cc:492] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:33.206590 26594 consensus_peers.cc:597] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:33.207152 26916 tablet_bootstrap.cc:654] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.204614 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:33.208791 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:33.208884 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d938ea61370c493585d01a30e7381695" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:33.210561 26776 consensus_meta.cc:287] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.516s user 0.005s sys 0.002s
W20260928 20:02:33.213104 26594 leader_election.cc:343] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.216751 27191 ts_tablet_manager.cc:1975] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.217110 27191 log.cc:1199] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/ff4f7ca1b194471bbad778ac4e89f6c7
I20260928 20:02:33.217658 27238 raft_consensus.cc:493] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.218075 27238 raft_consensus.cc:515] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:33.214720 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 8163815661694d70ba4c2e36a424eaa1 (DEFAULT_TABLE table=default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.219930 27238 leader_election.cc:290] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.220651 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8163815661694d70ba4c2e36a424eaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.216626 26638 tablet_service.cc:1511] Processing CreateTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 (DEFAULT_TABLE table=default.Table_53b73d543aa74f4190223084e9c487af [id=2c0cba9356064ab29bd837a988ab4921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.223174 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa4f373a46de433eabd3b35b6ed3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.223686 27191 ts_tablet_manager.cc:1996] T ff4f7ca1b194471bbad778ac4e89f6c7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:33.217387 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 with delete_type TABLET_DATA_DELETED (replaced by tablet 8163815661694d70ba4c2e36a424eaa1) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.226665 26913 consensus_queue.cc:260] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.228171 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 112) took 1261 ms. Trace:
I20260928 20:02:33.228652 26913 ts_tablet_manager.cc:1480] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20260928 20:02:33.228464 27191 rpcz_store.cc:276] 0928 20:02:31.966661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.966873 (+ 212us) service_pool.cc:224] Handling call
0928 20:02:33.158580 (+1191707us) ts_tablet_manager.cc:1197] Deleting tablet ff4f7ca1b194471bbad778ac4e89f6c7
0928 20:02:33.163675 (+ 5095us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.198500 (+ 34825us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.216632 (+ 18132us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.228109 (+ 11477us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190992}
I20260928 20:02:33.229441 26913 tablet_bootstrap.cc:492] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:33.229262 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882d1d6246dd4b3a81df5c57976ac631" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:33.229512 27191 tablet_replica.cc:333] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:33.229784 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet ff4f7ca1b194471bbad778ac4e89f6c7 (table default.Table_911e0630d48c4bd7b8f844cee768908b [id=cf711236531a4f2e82a29a160baa3b03]) successfully deleted
I20260928 20:02:33.229923 26657 raft_consensus.cc:2393] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:33.230229 27191 raft_consensus.cc:2243] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.230700 27191 raft_consensus.cc:2272] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.232379 27191 ts_tablet_manager.cc:1962] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.235618 26912 tablet_bootstrap.cc:654] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:33.243310 26594 leader_election.cc:343] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:33.245743 26594 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.246176 26594 leader_election.cc:304] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:33.247016 27260 raft_consensus.cc:2749] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:02:33.217983 27011 tablet_replica.cc:333] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:02:33.219660 26595 consensus_peers.cc:597] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:33.248795 27011 raft_consensus.cc:2243] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.250593 27011 raft_consensus.cc:2272] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.252882 27011 ts_tablet_manager.cc:1962] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.270005 26234 master_service.cc:960] ReplaceTablet: received request to replace tablet fa037333676c4dba93160c5e3337f891 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:33.270799 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 29a489266ffc47a498e8541408a1f6a2 (table default.Table_c3df2a4361cf4adbae1547673dacf161 [id=10827de24c9348b8a73fb743b32a9188]) successfully deleted
I20260928 20:02:33.275309 26631 tablet_service.cc:1511] Processing CreateTablet for tablet a0dd3080d50748d2ad79f472d3c17673 (DEFAULT_TABLE table=default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.276304 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dd3080d50748d2ad79f472d3c17673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.281612 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:33.284885 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c (DEFAULT_TABLE table=default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab [id=80962b238d944b279991bb38e31ffddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.285846 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fb4e1fd0584a42a4de9eab14d5578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.292249 27011 ts_tablet_manager.cc:1975] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.297429 27191 ts_tablet_manager.cc:1975] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:33.297905 27011 log.cc:1199] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/d938ea61370c493585d01a30e7381695
I20260928 20:02:33.298647 27011 ts_tablet_manager.cc:1996] T d938ea61370c493585d01a30e7381695 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.299001 27191 log.cc:1199] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/56d16f263a4d439b98ea11156f4997fe
I20260928 20:02:33.299852 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 100) took 1564 ms. Trace:
I20260928 20:02:33.300652 27191 ts_tablet_manager.cc:1996] T 56d16f263a4d439b98ea11156f4997fe P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:33.301412 27191 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 113) took 1303 ms. Trace:
I20260928 20:02:33.301756 27011 rpcz_store.cc:276] 0928 20:02:31.735441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.735595 (+ 154us) service_pool.cc:224] Handling call
0928 20:02:33.217819 (+1482224us) ts_tablet_manager.cc:1197] Deleting tablet d938ea61370c493585d01a30e7381695
0928 20:02:33.217864 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.281606 (+ 63742us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.292138 (+ 10532us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.299802 (+ 7664us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1481619}
I20260928 20:02:33.302554 27191 rpcz_store.cc:276] 0928 20:02:31.998384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.998597 (+ 213us) service_pool.cc:224] Handling call
0928 20:02:33.229373 (+1230776us) ts_tablet_manager.cc:1197] Deleting tablet 56d16f263a4d439b98ea11156f4997fe
0928 20:02:33.229416 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.284280 (+ 54864us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.297302 (+ 13022us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.301348 (+ 4046us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1229932}
I20260928 20:02:33.303997 27011 tablet_replica.cc:333] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:33.304728 27011 raft_consensus.cc:2243] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.305845 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 56d16f263a4d439b98ea11156f4997fe (table default.Table_073d3a55143c4c448dce7157adc7abf3 [id=5556b2b20a4343c5b98fc7c73e2aebfd]) successfully deleted
W20260928 20:02:33.307613 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 already in progress: creating tablet
I20260928 20:02:33.308385 27011 raft_consensus.cc:2272] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:33.309612 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet c0fd24cd5adf4774a13aeac30315f6f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fd24cd5adf4774a13aeac30315f6f9 already in progress: creating tablet
W20260928 20:02:33.312150 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet afceff93f6f9401f94bab3e376925d12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afceff93f6f9401f94bab3e376925d12 already in progress: creating tablet
I20260928 20:02:33.312350 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_fbfbe10e93f741f486e85860be3887b9 [id=7eeccc44c73f46b88801b8107c5b1cc9] alter complete (version 1)
I20260928 20:02:33.312958 27191 tablet_replica.cc:333] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:33.313689 27191 raft_consensus.cc:2243] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.314249 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet fa037333676c4dba93160c5e3337f891
I20260928 20:02:33.314666 27191 raft_consensus.cc:2272] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.315542 26234 catalog_manager.cc:6934] ReplaceTablet: tablet fa037333676c4dba93160c5e3337f891 deleted and replaced by tablet 4b91a573103c4c2d995abde8db91b821
I20260928 20:02:33.315838 26913 tablet_bootstrap.cc:654] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.317370 27191 ts_tablet_manager.cc:1962] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.324290 27011 ts_tablet_manager.cc:1962] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.325990 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:33.332273 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_b83677aaa3e54ef3a20a07feca2869a9 [id=219bcf821c96465eb48c3199ea6f4237]). Expected version 1 got 0
I20260928 20:02:33.333056 26234 catalog_manager.cc:5838] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:33.338204 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5ee801a9354a858356fb4e055a1863 (DEFAULT_TABLE table=default.Table_de02ea49d88141cc8f34789367523d0f [id=45dc3f27b99844f68ac8ae0c288019e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.339293 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5ee801a9354a858356fb4e055a1863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.348358 26916 tablet_bootstrap.cc:492] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.348845 26916 ts_tablet_manager.cc:1449] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.188s user 0.022s sys 0.010s
I20260928 20:02:33.356503 27011 ts_tablet_manager.cc:1975] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:33.356768 27238 raft_consensus.cc:493] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.356840 27011 log.cc:1199] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/56d16f263a4d439b98ea11156f4997fe
I20260928 20:02:33.357208 27238 raft_consensus.cc:515] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:33.357651 27011 ts_tablet_manager.cc:1996] T 56d16f263a4d439b98ea11156f4997fe P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.359397 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet d938ea61370c493585d01a30e7381695 (table default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]) successfully deleted
I20260928 20:02:33.359468 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 102) took 1364 ms. Trace:
I20260928 20:02:33.359826 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c0cc7bd109493cacf990dd1e2728f0" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:33.359740 27011 rpcz_store.cc:276] 0928 20:02:31.995228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.995483 (+ 255us) service_pool.cc:224] Handling call
0928 20:02:33.303855 (+1308372us) ts_tablet_manager.cc:1197] Deleting tablet 56d16f263a4d439b98ea11156f4997fe
0928 20:02:33.303893 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.340985 (+ 37092us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.356378 (+ 15393us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.359415 (+ 3037us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1307774}
I20260928 20:02:33.361485 27238 leader_election.cc:290] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.361948 26916 raft_consensus.cc:359] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.362593 26916 raft_consensus.cc:385] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.362843 26916 raft_consensus.cc:740] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.363464 26916 consensus_queue.cc:260] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.364562 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c (DEFAULT_TABLE table=default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab [id=80962b238d944b279991bb38e31ffddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.365672 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fb4e1fd0584a42a4de9eab14d5578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.367816 26916 ts_tablet_manager.cc:1480] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.019s user 0.007s sys 0.003s
I20260928 20:02:33.369278 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.368616 26916 tablet_bootstrap.cc:492] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.371670 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:33.373095 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5ee801a9354a858356fb4e055a1863 (DEFAULT_TABLE table=default.Table_de02ea49d88141cc8f34789367523d0f [id=45dc3f27b99844f68ac8ae0c288019e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.373982 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5ee801a9354a858356fb4e055a1863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.376186 27011 tablet_replica.cc:333] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:33.376881 27011 raft_consensus.cc:2243] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
W20260928 20:02:33.377661 26228 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet caf030c329e64d208a3f507804edbd54 consensus state has no leader
I20260928 20:02:33.381166 27011 pending_rounds.cc:70] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:33.381384 27011 pending_rounds.cc:77] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403081636040704 op_type: NO_OP noop_request { }
I20260928 20:02:33.381690 27011 raft_consensus.cc:2889] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:33.381989 27011 raft_consensus.cc:2272] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.383278 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.383704 27011 ts_tablet_manager.cc:1962] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.386082 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:33.386840 26916 tablet_bootstrap.cc:654] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.391712 27191 ts_tablet_manager.cc:1975] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.392058 27191 log.cc:1199] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:33.392649 27191 ts_tablet_manager.cc:1996] T cb970d91179e48cdbbb1e32a3ca3171c P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:33.400413 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 09bd74bc45d14e789567df6019f6d99b (DEFAULT_TABLE table=default.Table_94bb7f9333bc4698ad05e23d6003988a [id=3dab28923da541d880df28b2119b4de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.401001 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc (DEFAULT_TABLE table=default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.401376 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bd74bc45d14e789567df6019f6d99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.401859 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cda7651d4cf4c7e82c7329735e6bdcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.402282 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.403571 26779 tablet_service.cc:1511] Processing CreateTablet for tablet e70df4ddf0f9430980c967d798ed6c50 (DEFAULT_TABLE table=default.Table_cad16d3252864a33acdd97cbb42fa80b [id=14b35dc03a724a6d9062137acac612cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.404524 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70df4ddf0f9430980c967d798ed6c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.405124 26912 tablet_bootstrap.cc:492] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:33.405509 26912 ts_tablet_manager.cc:1449] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.203s user 0.006s sys 0.004s
I20260928 20:02:33.406839 26777 tablet_service.cc:1511] Processing CreateTablet for tablet c4de78b7781d43458cbf2d3e889357fc (DEFAULT_TABLE table=default.Table_7b71cef2215d4ba9a0d4cdb625664604 [id=f55e212e2f97427fba3f983fb0ff2cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.407797 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4de78b7781d43458cbf2d3e889357fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.408234 26912 raft_consensus.cc:359] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:33.408859 26912 raft_consensus.cc:385] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.409085 26912 raft_consensus.cc:740] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.410337 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.411530 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 8163815661694d70ba4c2e36a424eaa1 (DEFAULT_TABLE table=default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.412488 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8163815661694d70ba4c2e36a424eaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.412348 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 (DEFAULT_TABLE table=default.Table_438a2bd078e04a3e87064ca81d283559 [id=e27528ba702740e7a7aaae54dc8503fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.413312 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018497a652234fbdb04cf6c034bcc5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.400413 26776 tablet_service.cc:1511] Processing CreateTablet for tablet a9a8177684ed461cbc7bbc4aeb30873c (DEFAULT_TABLE table=default.Table_b624c955d67b4573ac8431cd87fffb48 [id=a6241269939c4539979d41f860203228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.418445 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a8177684ed461cbc7bbc4aeb30873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.420495 26236 master_service.cc:960] ReplaceTablet: received request to replace tablet a0dd3080d50748d2ad79f472d3c17673 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:33.421396 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_53b73d543aa74f4190223084e9c487af" } modify_external_catalogs: true
I20260928 20:02:33.421847 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_53b73d543aa74f4190223084e9c487af" } modify_external_catalogs: true
I20260928 20:02:33.422187 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:33.422713 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_5a7c9be3acda4b98b0c4eeaf32e49179"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:33.423607 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:33.423992 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a7c9be3acda4b98b0c4eeaf32e49179 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:33.421334 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_bed2cb6494a544afb978a8521c702d03" } modify_external_catalogs: true
I20260928 20:02:33.425000 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_bed2cb6494a544afb978a8521c702d03" } modify_external_catalogs: true
I20260928 20:02:33.426241 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_5e0b70bfe04843ab9cfdb7a2dc3846f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:33.427567 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e0b70bfe04843ab9cfdb7a2dc3846f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:33.428764 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_366a7f185d964b76bfac11395c9e3e0c" } new_table_name: "default.Table_d9d394d2c0e641a98b38ba0ac3678399" modify_external_catalogs: true
I20260928 20:02:33.429060 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e8c7c9bf121c488eb28e0006cf46469c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:33.430394 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8c7c9bf121c488eb28e0006cf46469c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:33.434470 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b83677aaa3e54ef3a20a07feca2869a9" } new_table_name: "default.Table_f49f112093074642a3c3e1c6aed06c49" modify_external_catalogs: true
I20260928 20:02:33.435673 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 56d16f263a4d439b98ea11156f4997fe (table default.Table_073d3a55143c4c448dce7157adc7abf3 [id=5556b2b20a4343c5b98fc7c73e2aebfd]) successfully deleted
I20260928 20:02:33.451354 26228 catalog_manager.cc:5838] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:33.457321 27011 ts_tablet_manager.cc:1975] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:33.457664 27011 log.cc:1199] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/ff4f7ca1b194471bbad778ac4e89f6c7
I20260928 20:02:33.455791 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet cb970d91179e48cdbbb1e32a3ca3171c (table default.Table_e37f5f95bc984b27b7fb29e83e336618 [id=cc2e9040c8104d3195750b14c727965d]) successfully deleted
W20260928 20:02:33.467386 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet fa037333676c4dba93160c5e3337f891 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa037333676c4dba93160c5e3337f891 already in progress: creating tablet
I20260928 20:02:33.468801 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:33.469877 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 (DEFAULT_TABLE table=default.Table_438a2bd078e04a3e87064ca81d283559 [id=e27528ba702740e7a7aaae54dc8503fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.474273 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018497a652234fbdb04cf6c034bcc5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.470157 27011 ts_tablet_manager.cc:1996] T ff4f7ca1b194471bbad778ac4e89f6c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.477007 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 101) took 1542 ms. Trace:
I20260928 20:02:33.477347 27011 rpcz_store.cc:276] 0928 20:02:31.934261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:31.999496 (+ 65235us) service_pool.cc:224] Handling call
0928 20:02:33.376046 (+1376550us) ts_tablet_manager.cc:1197] Deleting tablet ff4f7ca1b194471bbad778ac4e89f6c7
0928 20:02:33.376086 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.393902 (+ 17816us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.457205 (+ 63303us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.476940 (+ 19735us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375824}
I20260928 20:02:33.479426 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet ff4f7ca1b194471bbad778ac4e89f6c7 (table default.Table_911e0630d48c4bd7b8f844cee768908b [id=cf711236531a4f2e82a29a160baa3b03]) successfully deleted
I20260928 20:02:33.484597 26916 tablet_bootstrap.cc:492] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.485026 26916 ts_tablet_manager.cc:1449] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.021s
I20260928 20:02:33.487820 26916 raft_consensus.cc:359] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.488466 26916 raft_consensus.cc:385] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.488718 26916 raft_consensus.cc:740] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.489600 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 103) took 1470 ms. Trace:
I20260928 20:02:33.490159 27011 rpcz_store.cc:276] 0928 20:02:32.019164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:32.019348 (+ 184us) service_pool.cc:224] Handling call
0928 20:02:33.489323 (+1469975us) ts_tablet_manager.cc:1197] Deleting tablet 6abc6a2ae4984413be9ba769d42dc072
0928 20:02:33.489365 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.489540 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1469304}
I20260928 20:02:33.491267 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 104) took 1459 ms. Trace:
W20260928 20:02:33.491720 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 6abc6a2ae4984413be9ba769d42dc072 because the tablet was not found. No further retry: Not found: Tablet not found: 6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:33.491607 27011 rpcz_store.cc:276] 0928 20:02:32.031659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:32.031850 (+ 191us) service_pool.cc:224] Handling call
0928 20:02:33.491056 (+1459206us) ts_tablet_manager.cc:1197] Deleting tablet a4df1bab40024f97a5ad5acf358e3c26
0928 20:02:33.491093 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.491221 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1458380}
I20260928 20:02:33.492640 27011 tablet_replica.cc:333] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:02:33.492877 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet a4df1bab40024f97a5ad5acf358e3c26 because the tablet was not found. No further retry: Not found: Tablet not found: a4df1bab40024f97a5ad5acf358e3c26
I20260928 20:02:33.493489 26916 consensus_queue.cc:260] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.494361 27011 raft_consensus.cc:2243] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:33.495249 27011 pending_rounds.cc:70] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:33.505257 26916 ts_tablet_manager.cc:1480] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20260928 20:02:33.505620 27011 pending_rounds.cc:77] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403075404144640 op_type: NO_OP noop_request { }
I20260928 20:02:33.506011 27011 raft_consensus.cc:2889] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:33.506959 27011 raft_consensus.cc:2272] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.506520 27265 raft_consensus.cc:493] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.507380 27265 raft_consensus.cc:515] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:33.509171 27265 leader_election.cc:290] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:33.511452 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:33.511029 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03370aeac73549a195a16382aa6f9de3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:33.515436 26450 leader_election.cc:343] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.515874 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:33.517417 27011 ts_tablet_manager.cc:1962] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:33.517350 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet b0655fc043b9468ea51ce5ae983e8f06 because the tablet was not found. No further retry: Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:33.517814 26916 tablet_bootstrap.cc:492] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.517712 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.525178 26916 tablet_bootstrap.cc:654] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.542464 27271 consensus_queue.cc:1048] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:33.562330 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03370aeac73549a195a16382aa6f9de3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:33.590394 27051 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:02:33.589866 26450 leader_election.cc:343] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.591166 26450 leader_election.cc:304] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:33.591427 27051 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:02:33.592270 27051 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260928 20:02:33.592439 27265 raft_consensus.cc:2749] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:33.595533 27283 tablet.cc:1751] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:33.600590 26784 tablet_service.cc:1511] Processing CreateTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 (DEFAULT_TABLE table=default.Table_53b73d543aa74f4190223084e9c487af [id=2c0cba9356064ab29bd837a988ab4921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.601193 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet e162b25e0db14a35bfe6657f620affdb with delete_type TABLET_DATA_DELETED (replaced by tablet e70df4ddf0f9430980c967d798ed6c50) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.604527 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa4f373a46de433eabd3b35b6ed3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.601564 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 57189d2450924921aecc1ee81c1cb952 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.601645 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet 6abc6a2ae4984413be9ba769d42dc072 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c365de7d204833aa9dfa4966f254cf) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.604842 26232 master_service.cc:960] ReplaceTablet: received request to replace tablet 03370aeac73549a195a16382aa6f9de3 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:33.602133 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a489266ffc47a498e8541408a1f6a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.605540 27279 tablet_replica.cc:333] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:33.606269 27279 raft_consensus.cc:2243] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.606690 27279 raft_consensus.cc:2272] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.608381 27279 ts_tablet_manager.cc:1962] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.602808 26775 tablet_service.cc:1511] Processing CreateTablet for tablet a0dd3080d50748d2ad79f472d3c17673 (DEFAULT_TABLE table=default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.615491 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0dd3080d50748d2ad79f472d3c17673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.616565 26913 tablet_bootstrap.cc:492] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:33.616961 26913 ts_tablet_manager.cc:1449] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.388s user 0.006s sys 0.002s
I20260928 20:02:33.624756 26916 tablet_bootstrap.cc:492] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.625176 26916 ts_tablet_manager.cc:1449] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.113s user 0.007s sys 0.002s
I20260928 20:02:33.627501 26916 raft_consensus.cc:359] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.628125 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b (DEFAULT_TABLE table=default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.629046 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0216c99dfd8f498595f3f7dbadf8a79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.628324 26916 raft_consensus.cc:385] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.629778 26916 raft_consensus.cc:740] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.630507 26916 consensus_queue.cc:260] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.630752 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b (DEFAULT_TABLE table=default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.631579 27011 ts_tablet_manager.cc:1975] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:33.631716 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0216c99dfd8f498595f3f7dbadf8a79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.631910 27011 log.cc:1199] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/d6c0cc7bd109493cacf990dd1e2728f0
I20260928 20:02:33.631790 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 882d1d6246dd4b3a81df5c57976ac631 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d4ea23c18e04819b28d3428d584f3ac) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.632577 27011 ts_tablet_manager.cc:1996] T d6c0cc7bd109493cacf990dd1e2728f0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.632576 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c (DEFAULT_TABLE table=default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab [id=80962b238d944b279991bb38e31ffddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.633579 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fb4e1fd0584a42a4de9eab14d5578c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.634037 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d73fef88894a51b9fa04cb70e29d43 with delete_type TABLET_DATA_DELETED (replaced by tablet 8163815661694d70ba4c2e36a424eaa1) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.654009 26916 ts_tablet_manager.cc:1480] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260928 20:02:33.661286 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:33.662395 27191 tablet_replica.cc:333] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:33.663180 27191 raft_consensus.cc:2243] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.663599 27191 raft_consensus.cc:2272] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.665028 27191 ts_tablet_manager.cc:1962] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.666826 26913 raft_consensus.cc:359] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.667434 26913 raft_consensus.cc:385] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.667665 26913 raft_consensus.cc:740] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.687402 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.688059 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 8f5ee801a9354a858356fb4e055a1863 (DEFAULT_TABLE table=default.Table_de02ea49d88141cc8f34789367523d0f [id=45dc3f27b99844f68ac8ae0c288019e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.689302 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f5ee801a9354a858356fb4e055a1863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.691574 26913 consensus_queue.cc:260] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.701581 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet a0dd3080d50748d2ad79f472d3c17673
W20260928 20:02:33.703531 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34d91ea748a94cb7a75cbbd2f39f49f6 consensus state has no leader
I20260928 20:02:33.705729 26236 catalog_manager.cc:6934] ReplaceTablet: tablet a0dd3080d50748d2ad79f472d3c17673 deleted and replaced by tablet 775b9a076bf048bea39423d3554babf7
I20260928 20:02:33.706566 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.708827 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 105) took 1674 ms. Trace:
I20260928 20:02:33.709632 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 2d90ce97d3db4bff8b2eea71c530c351 (DEFAULT_TABLE table=default.Table_495c2b52ba314f338d8f81d8bf071236 [id=0c98275433a24292b35617002df2cf6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.709231 27011 rpcz_store.cc:276] 0928 20:02:32.034173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:32.034289 (+ 116us) service_pool.cc:224] Handling call
0928 20:02:33.492515 (+1458226us) ts_tablet_manager.cc:1197] Deleting tablet d6c0cc7bd109493cacf990dd1e2728f0
0928 20:02:33.492548 (+ 33us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.590032 (+ 97484us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.631468 (+ 41436us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.708754 (+ 77286us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1457651}
I20260928 20:02:33.709820 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 2d90ce97d3db4bff8b2eea71c530c351 (DEFAULT_TABLE table=default.Table_495c2b52ba314f338d8f81d8bf071236 [id=0c98275433a24292b35617002df2cf6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.710767 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d90ce97d3db4bff8b2eea71c530c351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.710767 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d90ce97d3db4bff8b2eea71c530c351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.710879 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet d6c0cc7bd109493cacf990dd1e2728f0 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]) successfully deleted
I20260928 20:02:33.723446 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 (DEFAULT_TABLE table=default.Table_438a2bd078e04a3e87064ca81d283559 [id=e27528ba702740e7a7aaae54dc8503fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.724496 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018497a652234fbdb04cf6c034bcc5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.726467 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:33.726651 27011 tablet_replica.cc:333] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:33.735110 26912 consensus_queue.cc:260] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:33.736279 26916 tablet_bootstrap.cc:492] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.737123 26912 ts_tablet_manager.cc:1480] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.331s user 0.002s sys 0.005s
I20260928 20:02:33.742051 26916 tablet_bootstrap.cc:654] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.743207 27011 raft_consensus.cc:2243] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.743754 27011 raft_consensus.cc:2272] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.743897 26913 ts_tablet_manager.cc:1480] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.127s user 0.007s sys 0.000s
I20260928 20:02:33.745388 26913 tablet_bootstrap.cc:492] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:33.745536 27011 ts_tablet_manager.cc:1962] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.750581 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_438a2bd078e04a3e87064ca81d283559" } modify_external_catalogs: true
I20260928 20:02:33.751192 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_438a2bd078e04a3e87064ca81d283559" } modify_external_catalogs: true
I20260928 20:02:33.754249 27191 ts_tablet_manager.cc:1975] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.754608 27191 log.cc:1199] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:33.755208 27191 ts_tablet_manager.cc:1996] T b087dcc9d5be4a9e89c35c359a18ca5c P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:33.766194 27279 ts_tablet_manager.cc:1975] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.766399 27171 raft_consensus.cc:493] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.766585 27279 log.cc:1199] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/57189d2450924921aecc1ee81c1cb952
I20260928 20:02:33.766832 27171 raft_consensus.cc:515] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.767251 27279 ts_tablet_manager.cc:1996] T 57189d2450924921aecc1ee81c1cb952 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:33.768805 27171 leader_election.cc:290] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:33.771361 26595 leader_election.cc:343] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:33.778606 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet b087dcc9d5be4a9e89c35c359a18ca5c (table default.Table_75d3d3007f5b4c929142c1ec075e54f0 [id=3ceaf958c5e445639a07fa279736ee9d]) successfully deleted
I20260928 20:02:33.779366 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.779534 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b (DEFAULT_TABLE table=default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.781266 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.781324 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 2d90ce97d3db4bff8b2eea71c530c351 (DEFAULT_TABLE table=default.Table_495c2b52ba314f338d8f81d8bf071236 [id=0c98275433a24292b35617002df2cf6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.782547 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 2728c9979bb647a5a8f0a902c299e53d (DEFAULT_TABLE table=default.Table_60b73bf93b434a499c613715e7cd6464 [id=42c910625bf147a08dd2e86593dee01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.785830 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 2728c9979bb647a5a8f0a902c299e53d (DEFAULT_TABLE table=default.Table_60b73bf93b434a499c613715e7cd6464 [id=42c910625bf147a08dd2e86593dee01a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:33.786262 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet a0dd3080d50748d2ad79f472d3c17673 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dd3080d50748d2ad79f472d3c17673 already in progress: creating tablet
W20260928 20:02:33.786407 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet afceff93f6f9401f94bab3e376925d12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afceff93f6f9401f94bab3e376925d12 already in progress: creating tablet
I20260928 20:02:33.787115 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2728c9979bb647a5a8f0a902c299e53d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:33.787258 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet c0fd24cd5adf4774a13aeac30315f6f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fd24cd5adf4774a13aeac30315f6f9 already in progress: creating tablet
I20260928 20:02:33.789361 26916 tablet_bootstrap.cc:492] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.789740 26916 ts_tablet_manager.cc:1449] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.054s user 0.009s sys 0.000s
I20260928 20:02:33.792802 26916 raft_consensus.cc:359] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.793372 26916 raft_consensus.cc:385] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.793612 26916 raft_consensus.cc:740] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.794198 26916 consensus_queue.cc:260] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.797454 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb970d91179e48cdbbb1e32a3ca3171c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:33.799089 26594 leader_election.cc:343] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.799501 26594 leader_election.cc:304] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:33.801276 26912 tablet_bootstrap.cc:492] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:33.803066 27171 raft_consensus.cc:2749] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:33.805019 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d90ce97d3db4bff8b2eea71c530c351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.807600 26916 ts_tablet_manager.cc:1480] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260928 20:02:33.808373 26916 tablet_bootstrap.cc:492] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.810917 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2728c9979bb647a5a8f0a902c299e53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.812785 27279 tablet_replica.cc:333] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:33.813570 27279 raft_consensus.cc:2243] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.814008 27279 raft_consensus.cc:2272] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.815362 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0216c99dfd8f498595f3f7dbadf8a79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.823760 27279 ts_tablet_manager.cc:1962] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.826076 27011 ts_tablet_manager.cc:1975] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.828332 27011 log.cc:1199] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/882d1d6246dd4b3a81df5c57976ac631
I20260928 20:02:33.830734 27265 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.831173 27265 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.832958 27265 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:33.835276 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:33.836545 26450 leader_election.cc:343] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.837496 27285 raft_consensus.cc:493] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.837754 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:33.838904 26450 leader_election.cc:343] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.839228 26450 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:33.840147 27265 raft_consensus.cc:2749] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:33.841028 27011 ts_tablet_manager.cc:1996] T 882d1d6246dd4b3a81df5c57976ac631 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.846067 26916 tablet_bootstrap.cc:654] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.846629 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 106) took 1682 ms. Trace:
I20260928 20:02:33.846992 27011 rpcz_store.cc:276] 0928 20:02:32.164290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:32.164492 (+ 202us) service_pool.cc:224] Handling call
0928 20:02:33.726439 (+1561947us) ts_tablet_manager.cc:1197] Deleting tablet 882d1d6246dd4b3a81df5c57976ac631
0928 20:02:33.726501 (+ 62us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.780880 (+ 54379us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.825961 (+ 45081us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:33.846567 (+ 20606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14918,"tablet-delete.queue_time_us":1476042}
I20260928 20:02:33.850466 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:33.850971 27011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 115) took 1207 ms. Trace:
I20260928 20:02:33.837991 27285 raft_consensus.cc:515] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:33.851255 27011 rpcz_store.cc:276] 0928 20:02:32.643477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:32.643605 (+ 128us) service_pool.cc:224] Handling call
0928 20:02:33.850651 (+1207046us) ts_tablet_manager.cc:1197] Deleting tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24
0928 20:02:33.850688 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:33.850920 (+ 232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1206408}
I20260928 20:02:33.853812 27285 leader_election.cc:290] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:33.854295 26739 leader_election.cc:343] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: ff4f7ca1b194471bbad778ac4e89f6c7
I20260928 20:02:33.855720 27011 tablet_replica.cc:333] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:33.856349 27011 raft_consensus.cc:2243] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.856792 27011 raft_consensus.cc:2272] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.857961 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 2728c9979bb647a5a8f0a902c299e53d (DEFAULT_TABLE table=default.Table_60b73bf93b434a499c613715e7cd6464 [id=42c910625bf147a08dd2e86593dee01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.859037 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2728c9979bb647a5a8f0a902c299e53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.861537 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:33.862913 26916 tablet_bootstrap.cc:492] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.863300 26916 ts_tablet_manager.cc:1449] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.007s
W20260928 20:02:33.863375 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:33.865577 26916 raft_consensus.cc:359] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.866174 26916 raft_consensus.cc:385] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.866418 26916 raft_consensus.cc:740] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.867043 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b203e56277cd4bb183c04c5f2403777e" } new_table_name: "default.Table_a15b3b57a6fb4ad2a7092839d92714b0" modify_external_catalogs: true
I20260928 20:02:33.867153 26916 consensus_queue.cc:260] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:33.870539 26740 leader_election.cc:343] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d6c0cc7bd109493cacf990dd1e2728f0
I20260928 20:02:33.871030 26740 leader_election.cc:304] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:33.871847 27272 raft_consensus.cc:2749] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:33.861145 27011 ts_tablet_manager.cc:1962] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.877873 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:33.878576 27279 ts_tablet_manager.cc:1975] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.879544 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:33.879624 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet c0fd24cd5adf4774a13aeac30315f6f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fd24cd5adf4774a13aeac30315f6f9 already in progress: creating tablet
W20260928 20:02:33.881034 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet aa4f373a46de433eabd3b35b6ed3d1e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa4f373a46de433eabd3b35b6ed3d1e3 already in progress: creating tablet
I20260928 20:02:33.882447 27279 log.cc:1199] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/6abc6a2ae4984413be9ba769d42dc072
I20260928 20:02:33.882551 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.882699 26916 ts_tablet_manager.cc:1480] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260928 20:02:33.883574 26916 tablet_bootstrap.cc:492] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.884217 27279 ts_tablet_manager.cc:1996] T 6abc6a2ae4984413be9ba769d42dc072 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:33.895022 27279 tablet_replica.cc:333] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:33.895162 27171 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.895670 27171 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.896060 27279 raft_consensus.cc:2243] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.896661 27279 raft_consensus.cc:2272] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.897819 27171 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:33.899405 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:33.900022 26515 raft_consensus.cc:2468] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:33.900228 27279 ts_tablet_manager.cc:1962] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.901362 26595 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:33.901711 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:33.902594 27171 raft_consensus.cc:2804] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:33.903030 27171 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 20:02:33.903136 26594 leader_election.cc:343] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.903481 27171 raft_consensus.cc:3060] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:33.910571 26740 consensus_peers.cc:597] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5d73fef88894a51b9fa04cb70e29d43. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:33.911149 26740 leader_election.cc:343] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 882d1d6246dd4b3a81df5c57976ac631
I20260928 20:02:33.911514 26740 leader_election.cc:304] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:33.912084 26740 raft_consensus.cc:2686] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 20:02:33.912760 26740 leader_election.cc:343] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ff4f7ca1b194471bbad778ac4e89f6c7
I20260928 20:02:33.913136 26740 leader_election.cc:304] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:33.914825 26912 tablet_bootstrap.cc:654] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.919499 26916 tablet_bootstrap.cc:654] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:33.924535 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet e162b25e0db14a35bfe6657f620affdb because the tablet was not found. No further retry: Not found: Tablet not found: e162b25e0db14a35bfe6657f620affdb
I20260928 20:02:33.924777 27011 ts_tablet_manager.cc:1975] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:33.925290 27011 log.cc:1199] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/a5d73fef88894a51b9fa04cb70e29d43
I20260928 20:02:33.925632 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 57189d2450924921aecc1ee81c1cb952 (table default.Table_43952762d1e746599a2d65da7c07de79 [id=a6bf9e2083eb4fa7b7e44135ce5f7fdc]) successfully deleted
I20260928 20:02:33.926136 27011 ts_tablet_manager.cc:1996] T a5d73fef88894a51b9fa04cb70e29d43 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:33.930830 27279 ts_tablet_manager.cc:1975] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:33.931692 27011 tablet_replica.cc:333] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:33.932353 27011 raft_consensus.cc:2243] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:33.932787 27011 raft_consensus.cc:2272] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.831662 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:33.935494 27171 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.940572 26916 tablet_bootstrap.cc:492] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:33.940937 26916 ts_tablet_manager.cc:1449] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.000s
I20260928 20:02:33.938318 27272 raft_consensus.cc:2749] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:33.942310 27279 log.cc:1199] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/882d1d6246dd4b3a81df5c57976ac631
I20260928 20:02:33.943014 27279 ts_tablet_manager.cc:1996] T 882d1d6246dd4b3a81df5c57976ac631 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:33.943755 26916 raft_consensus.cc:359] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.944356 26916 raft_consensus.cc:385] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:33.944617 26916 raft_consensus.cc:740] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:33.945526 27279 tablet_replica.cc:333] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:33.945216 26916 consensus_queue.cc:260] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.946060 27265 raft_consensus.cc:493] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.946586 27279 raft_consensus.cc:2243] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:33.946511 27265 raft_consensus.cc:515] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.947494 27279 raft_consensus.cc:2272] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:33.948383 27265 leader_election.cc:290] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:33.952235 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:33.955061 26450 leader_election.cc:343] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:33.956694 27279 ts_tablet_manager.cc:1962] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.957326 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 (DEFAULT_TABLE table=default.Table_a66ea6e7060e4febbaaf659c8b702e03 [id=23d8489ab3c9424ba65aa2299ec32809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:33.958547 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38abbc891d9c4268820cb0faba3d08b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:33.962782 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.964427 26916 ts_tablet_manager.cc:1480] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.023s user 0.006s sys 0.006s
I20260928 20:02:33.967510 26916 tablet_bootstrap.cc:492] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:33.972487 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c0cc7bd109493cacf990dd1e2728f0 with delete_type TABLET_DATA_DELETED (replaced by tablet ee464b814dbf4e4b89b2d1c019befac6) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:33.973075 26916 tablet_bootstrap.cc:654] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:33.977909 27294 raft_consensus.cc:493] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:33.978343 27294 raft_consensus.cc:515] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:33.980527 27294 leader_election.cc:290] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:33.981158 27283 tablet.cc:1751] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:33.983714 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd70ba6c0f1b43fcaa37bce4bf87a5e6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:33.985164 26450 leader_election.cc:343] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:33.986686 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet caf030c329e64d208a3f507804edbd54 consensus state has no leader
I20260928 20:02:33.999881 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_f49f112093074642a3c3e1c6aed06c49 [id=219bcf821c96465eb48c3199ea6f4237]). Expected version 2 got 0
I20260928 20:02:33.999778 27297 tablet.cc:1751] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:34.007836 27279 ts_tablet_manager.cc:1975] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:34.018329 27279 log.cc:1199] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/a5d73fef88894a51b9fa04cb70e29d43
I20260928 20:02:34.019511 27279 ts_tablet_manager.cc:1996] T a5d73fef88894a51b9fa04cb70e29d43 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:34.031808 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 03370aeac73549a195a16382aa6f9de3
I20260928 20:02:34.033174 26232 catalog_manager.cc:6934] ReplaceTablet: tablet 03370aeac73549a195a16382aa6f9de3 deleted and replaced by tablet 718a2abfe21b4a2986b77e14e4e52152
I20260928 20:02:34.039059 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 882d1d6246dd4b3a81df5c57976ac631 (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]) successfully deleted
W20260928 20:02:34.040462 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 already in progress: creating tablet
W20260928 20:02:34.041894 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet c0fd24cd5adf4774a13aeac30315f6f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0fd24cd5adf4774a13aeac30315f6f9 already in progress: creating tablet
I20260928 20:02:33.954357 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:33.955931 27011 ts_tablet_manager.cc:1962] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:33.986891 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd70ba6c0f1b43fcaa37bce4bf87a5e6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:34.055241 27171 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:34.055784 26912 tablet_bootstrap.cc:492] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:34.056047 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:34.057911 26594 leader_election.cc:343] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.002739 27268 tablet.cc:1751] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 20:02:34.058535 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260928 20:02:34.012248 27214 consensus_queue.cc:1048] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:34.061466 27283 tablet.cc:1746] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Skipping requested alter to schema version 1, tablet already version 2
I20260928 20:02:34.071403 27011 ts_tablet_manager.cc:1975] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.056246 26912 ts_tablet_manager.cc:1449] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.255s user 0.011s sys 0.004s
I20260928 20:02:34.074040 26913 tablet_bootstrap.cc:654] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.074342 27011 log.cc:1199] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/d374d592fda8402faac70a923049c9ad
I20260928 20:02:34.076135 26912 raft_consensus.cc:359] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.037690 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 03370aeac73549a195a16382aa6f9de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 718a2abfe21b4a2986b77e14e4e52152) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:34.075297 27011 ts_tablet_manager.cc:1996] T d374d592fda8402faac70a923049c9ad P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:34.076756 26912 raft_consensus.cc:385] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:02:34.052141 26450 leader_election.cc:343] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.077014 26912 raft_consensus.cc:740] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.077082 26450 leader_election.cc:304] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.077771 27294 raft_consensus.cc:2749] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:34.078802 26450 leader_election.cc:343] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.079157 26450 leader_election.cc:304] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.065557 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:34.079753 27294 raft_consensus.cc:2749] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.080565 27191 tablet_replica.cc:333] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:34.081229 27191 raft_consensus.cc:2243] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.081616 27191 raft_consensus.cc:2272] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.083777 27191 ts_tablet_manager.cc:1962] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.091286 26912 consensus_queue.cc:260] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.093510 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:34.101029 27279 tablet_replica.cc:333] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:34.101863 27279 raft_consensus.cc:2243] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.108405 27279 raft_consensus.cc:2272] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.110363 27279 ts_tablet_manager.cc:1962] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.114117 27214 consensus_queue.cc:1048] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:34.115275 26912 ts_tablet_manager.cc:1480] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.041s user 0.004s sys 0.000s
I20260928 20:02:34.118701 27268 tablet.cc:1746] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Skipping requested alter to schema version 1, tablet already version 2
I20260928 20:02:34.126250 27294 raft_consensus.cc:493] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.130386 27011 tablet_replica.cc:333] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:02:34.127701 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet afceff93f6f9401f94bab3e376925d12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afceff93f6f9401f94bab3e376925d12 already in progress: creating tablet
I20260928 20:02:34.131060 27011 raft_consensus.cc:2243] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.131469 27011 raft_consensus.cc:2272] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.133049 27011 ts_tablet_manager.cc:1962] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.133924 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 4c23636443834932852f21092be1d1ac (DEFAULT_TABLE table=default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.134294 26912 tablet_bootstrap.cc:492] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:34.135059 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23636443834932852f21092be1d1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.135980 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet a5d73fef88894a51b9fa04cb70e29d43 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]) successfully deleted
I20260928 20:02:34.139861 27191 ts_tablet_manager.cc:1975] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.140195 27191 log.cc:1199] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:34.140782 27191 ts_tablet_manager.cc:1996] T c0fd24cd5adf4774a13aeac30315f6f9 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:34.149003 27191 tablet_replica.cc:333] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:34.126732 27294 raft_consensus.cc:515] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:34.152210 27191 raft_consensus.cc:2243] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.152629 27191 raft_consensus.cc:2272] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.157109 27191 ts_tablet_manager.cc:1962] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.142046 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet c0fd24cd5adf4774a13aeac30315f6f9 (table default.Table_0dfdabdeae0a4bf1ba4dd59d4bbc98ca [id=11d2d52bae424e51b5379df798890e4f]) successfully deleted
I20260928 20:02:34.160094 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 018497a652234fbdb04cf6c034bcc5d3
W20260928 20:02:34.169998 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet fa037333676c4dba93160c5e3337f891 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa037333676c4dba93160c5e3337f891 already in progress: creating tablet
I20260928 20:02:34.170532 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 596a5540716441c49ec8185c8dc6a80c (DEFAULT_TABLE table=default.Table_1d2bed217f0242aabcfc3979c76a1757 [id=a763bf903e6146868af5e380c2a9df4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.171489 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:34.177724 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596a5540716441c49ec8185c8dc6a80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.178339 26912 tablet_bootstrap.cc:654] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.181591 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet d374d592fda8402faac70a923049c9ad (table default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]) successfully deleted
W20260928 20:02:34.182386 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet b0655fc043b9468ea51ce5ae983e8f06 because the tablet was not found. No further retry: Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
W20260928 20:02:34.182973 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet a0dd3080d50748d2ad79f472d3c17673 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dd3080d50748d2ad79f472d3c17673 already in progress: creating tablet
W20260928 20:02:34.183542 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet aa4f373a46de433eabd3b35b6ed3d1e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa4f373a46de433eabd3b35b6ed3d1e3 already in progress: creating tablet
I20260928 20:02:34.163494 26515 raft_consensus.cc:3060] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:34.185599 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet ff4f7ca1b194471bbad778ac4e89f6c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:31 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:34.185451 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 (DEFAULT_TABLE table=default.Table_a66ea6e7060e4febbaaf659c8b702e03 [id=23d8489ab3c9424ba65aa2299ec32809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.186818 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38abbc891d9c4268820cb0faba3d08b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.196519 26913 tablet_bootstrap.cc:492] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:34.197019 26913 ts_tablet_manager.cc:1449] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.452s user 0.009s sys 0.001s
I20260928 20:02:34.200100 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:34.200649 27294 leader_election.cc:290] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:34.201215 26913 raft_consensus.cc:359] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:34.205574 26450 leader_election.cc:343] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.243903 26234 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_f49f112093074642a3c3e1c6aed06c49 [id=219bcf821c96465eb48c3199ea6f4237] alter complete (version 2)
I20260928 20:02:34.251616 27191 ts_tablet_manager.cc:1975] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.251879 26515 raft_consensus.cc:2468] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:34.253968 27297 tablet.cc:1746] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Skipping requested alter to schema version 1, tablet already version 2
I20260928 20:02:34.266460 26916 tablet_bootstrap.cc:492] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.266911 26916 ts_tablet_manager.cc:1449] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.302s user 0.037s sys 0.058s
I20260928 20:02:34.269261 26916 raft_consensus.cc:359] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.269933 26916 raft_consensus.cc:385] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.270212 26916 raft_consensus.cc:740] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.270886 26916 consensus_queue.cc:260] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.274297 26916 ts_tablet_manager.cc:1480] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260928 20:02:34.280484 26916 tablet_bootstrap.cc:492] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.289983 26916 tablet_bootstrap.cc:654] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.252017 27191 log.cc:1199] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/03370aeac73549a195a16382aa6f9de3
I20260928 20:02:34.295001 27191 ts_tablet_manager.cc:1996] T 03370aeac73549a195a16382aa6f9de3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:34.297587 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 03370aeac73549a195a16382aa6f9de3 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]) successfully deleted
I20260928 20:02:34.305114 26492 tablet_service.cc:1511] Processing CreateTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 (DEFAULT_TABLE table=default.Table_bed2cb6494a544afb978a8521c702d03 [id=d8c4eedc317c4c5c8a008ab4ee6d94b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.306129 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0655fc043b9468ea51ce5ae983e8f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.309597 26916 tablet_bootstrap.cc:492] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.309979 26916 ts_tablet_manager.cc:1449] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.030s user 0.015s sys 0.000s
I20260928 20:02:34.310513 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:34.312805 26916 raft_consensus.cc:359] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:34.313150 26450 leader_election.cc:343] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.313459 26916 raft_consensus.cc:385] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.313536 26450 leader_election.cc:304] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.313800 26916 raft_consensus.cc:740] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.314242 27294 raft_consensus.cc:2749] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.314437 26916 consensus_queue.cc:260] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:34.315297 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 018497a652234fbdb04cf6c034bcc5d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018497a652234fbdb04cf6c034bcc5d3 already in progress: creating tablet
I20260928 20:02:34.316530 26916 ts_tablet_manager.cc:1480] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260928 20:02:34.322399 27279 ts_tablet_manager.cc:1975] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.326916 26916 tablet_bootstrap.cc:492] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.326192 27272 raft_consensus.cc:493] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.329247 27272 raft_consensus.cc:515] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.331295 27272 leader_election.cc:290] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:34.333123 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fb6f22905945578fa74b671d31c5f3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:34.337404 27279 log.cc:1199] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/d6c0cc7bd109493cacf990dd1e2728f0
I20260928 20:02:34.338348 27279 ts_tablet_manager.cc:1996] T d6c0cc7bd109493cacf990dd1e2728f0 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:34.339507 26916 tablet_bootstrap.cc:654] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.345821 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 03370aeac73549a195a16382aa6f9de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 718a2abfe21b4a2986b77e14e4e52152) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:34.350637 27279 tablet_replica.cc:333] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:34.351521 27279 raft_consensus.cc:2243] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.352036 27279 raft_consensus.cc:2272] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.354297 27279 ts_tablet_manager.cc:1962] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.360728 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 4c23636443834932852f21092be1d1ac (DEFAULT_TABLE table=default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.361701 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23636443834932852f21092be1d1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.374004 26916 tablet_bootstrap.cc:492] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.374411 26916 ts_tablet_manager.cc:1449] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.010s
I20260928 20:02:34.376531 26916 raft_consensus.cc:359] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.377123 26916 raft_consensus.cc:385] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.377053 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 39fb6f22905945578fa74b671d31c5f3 (table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]). Expected version 1 got 0
I20260928 20:02:34.377506 26916 raft_consensus.cc:740] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.378095 26916 consensus_queue.cc:260] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.388801 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 596a5540716441c49ec8185c8dc6a80c (DEFAULT_TABLE table=default.Table_1d2bed217f0242aabcfc3979c76a1757 [id=a763bf903e6146868af5e380c2a9df4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.390038 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596a5540716441c49ec8185c8dc6a80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.392211 26916 ts_tablet_manager.cc:1480] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260928 20:02:34.393078 26916 tablet_bootstrap.cc:492] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.398443 26916 tablet_bootstrap.cc:654] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.404578 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:34.405268 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:34.212121 27011 ts_tablet_manager.cc:1975] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.408314 27011 log.cc:1199] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:34.408947 27011 ts_tablet_manager.cc:1996] T cb970d91179e48cdbbb1e32a3ca3171c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:34.409780 27294 raft_consensus.cc:493] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.410221 27294 raft_consensus.cc:515] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.253034 26595 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:34.411330 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 158371us
I20260928 20:02:34.412099 27294 leader_election.cc:290] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:34.323825 26594 consensus_peers.cc:597] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:34.413805 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 90101.3us
I20260928 20:02:34.414742 27171 raft_consensus.cc:2804] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:34.415486 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 03370aeac73549a195a16382aa6f9de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 718a2abfe21b4a2986b77e14e4e52152) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:34.416518 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 (DEFAULT_TABLE table=default.Table_a66ea6e7060e4febbaaf659c8b702e03 [id=23d8489ab3c9424ba65aa2299ec32809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.417452 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38abbc891d9c4268820cb0faba3d08b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.418216 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:34.419847 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:34.420228 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 4c23636443834932852f21092be1d1ac (DEFAULT_TABLE table=default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.421427 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23636443834932852f21092be1d1ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:34.422199 26450 leader_election.cc:343] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.335426 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fb6f22905945578fa74b671d31c5f3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:34.422747 26450 leader_election.cc:343] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.423033 26450 leader_election.cc:304] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.424108 27294 raft_consensus.cc:2749] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.429067 26916 tablet_bootstrap.cc:492] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.429574 26916 ts_tablet_manager.cc:1449] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.001s
I20260928 20:02:34.433478 26739 leader_election.cc:304] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:34.437021 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:34.437665 27191 tablet_replica.cc:333] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:34.437438 26916 raft_consensus.cc:359] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.438074 26916 raft_consensus.cc:385] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.438341 26916 raft_consensus.cc:740] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.438465 27191 raft_consensus.cc:2243] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.438896 27191 raft_consensus.cc:2272] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.439133 26916 consensus_queue.cc:260] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.441016 27191 ts_tablet_manager.cc:1962] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.441114 27272 raft_consensus.cc:2749] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.441537 27279 ts_tablet_manager.cc:1975] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.442601 27279 log.cc:1199] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/ff4f7ca1b194471bbad778ac4e89f6c7
I20260928 20:02:34.447724 26916 ts_tablet_manager.cc:1480] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.000s sys 0.004s
I20260928 20:02:34.448549 26916 tablet_bootstrap.cc:492] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.459781 27279 ts_tablet_manager.cc:1996] T ff4f7ca1b194471bbad778ac4e89f6c7 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:34.461862 27294 raft_consensus.cc:493] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.462303 27294 raft_consensus.cc:515] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.462882 27191 ts_tablet_manager.cc:1975] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.463209 27191 log.cc:1199] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/afceff93f6f9401f94bab3e376925d12
I20260928 20:02:34.463804 27191 ts_tablet_manager.cc:1996] T afceff93f6f9401f94bab3e376925d12 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:34.464257 27294 leader_election.cc:290] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:34.465792 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:34.465817 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:34.466614 26916 tablet_bootstrap.cc:654] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:34.467186 26450 leader_election.cc:343] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:34.468151 26450 leader_election.cc:343] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.468501 26450 leader_election.cc:304] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.469538 27294 raft_consensus.cc:2749] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.470633 27294 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.471072 27294 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.474058 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:34.475353 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:34.475956 26450 leader_election.cc:343] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:34.476677 26450 leader_election.cc:343] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.476706 27294 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:34.477105 26913 raft_consensus.cc:385] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.477175 26450 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.477397 26913 raft_consensus.cc:740] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.477847 27294 raft_consensus.cc:2749] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.478307 26913 consensus_queue.cc:260] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.479506 26912 tablet_bootstrap.cc:492] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:34.480010 26912 ts_tablet_manager.cc:1449] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.352s user 0.019s sys 0.013s
I20260928 20:02:34.480695 26916 tablet_bootstrap.cc:492] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.483289 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet afceff93f6f9401f94bab3e376925d12 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]) successfully deleted
I20260928 20:02:34.486351 26916 ts_tablet_manager.cc:1449] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.005s
I20260928 20:02:34.486601 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet 2eec17e7fb1949289d428d6dc0721de3 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:34.488426 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 6abc6a2ae4984413be9ba769d42dc072 (table default.Table_1020721d72be4939981ee823fd491385 [id=595b27bd872444779dc921821e18648d]) successfully deleted
I20260928 20:02:34.489065 26916 raft_consensus.cc:359] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.489679 26916 raft_consensus.cc:385] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.489923 26916 raft_consensus.cc:740] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.494901 26916 consensus_queue.cc:260] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.498955 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 596a5540716441c49ec8185c8dc6a80c (DEFAULT_TABLE table=default.Table_1d2bed217f0242aabcfc3979c76a1757 [id=a763bf903e6146868af5e380c2a9df4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.499981 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596a5540716441c49ec8185c8dc6a80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.502076 26916 ts_tablet_manager.cc:1480] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260928 20:02:34.502955 26916 tablet_bootstrap.cc:492] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.513917 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 (DEFAULT_TABLE table=default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.514891 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0308d824cf401c8cca0cf7a950fd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.515811 26916 tablet_bootstrap.cc:654] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.538817 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8fbaf845832a4eb58670a1c3a9953c39" } modify_external_catalogs: true
I20260928 20:02:34.539373 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8fbaf845832a4eb58670a1c3a9953c39" } modify_external_catalogs: true
I20260928 20:02:34.541923 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_63e2c04c6cdc43a8a911b566a6ec7a78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:34.543541 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
W20260928 20:02:34.543749 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:34.544211 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:34.548079 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5a7c9be3acda4b98b0c4eeaf32e49179" } new_table_name: "default.Table_de419094fd8a4aa5b9ff973562f7f89b" modify_external_catalogs: true
I20260928 20:02:34.553412 26916 tablet_bootstrap.cc:492] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.553835 26916 ts_tablet_manager.cc:1449] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.004s
W20260928 20:02:34.554358 26228 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5d4ea23c18e04819b28d3428d584f3ac consensus state has no leader
I20260928 20:02:34.554246 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_26449cfa6e994b6e85217f102a4d138c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:34.555919 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26449cfa6e994b6e85217f102a4d138c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:34.556459 26916 raft_consensus.cc:359] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.557124 26916 raft_consensus.cc:385] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.557370 26916 raft_consensus.cc:740] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.558126 26916 consensus_queue.cc:260] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.560611 26916 ts_tablet_manager.cc:1480] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260928 20:02:34.561463 26916 tablet_bootstrap.cc:492] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.568138 26916 tablet_bootstrap.cc:654] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.571626 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_039c27c2317f4d218f78454b1adcde10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:34.573124 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_039c27c2317f4d218f78454b1adcde10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:34.587953 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:34.588619 27191 tablet_replica.cc:333] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:34.589334 27191 raft_consensus.cc:2243] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.589737 27191 raft_consensus.cc:2272] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.591682 27191 ts_tablet_manager.cc:1962] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.601794 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (DEFAULT_TABLE table=default.Table_7a89876f5095449caf48d4b9430b1037 [id=4714dc67744c4ef2817fc28b16820547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.602807 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674eef4920f94d4f88aa5dc3a0b362d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.615159 27191 ts_tablet_manager.cc:1975] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:34.620741 27191 log.cc:1199] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:34.624184 26916 tablet_bootstrap.cc:492] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.624574 26916 ts_tablet_manager.cc:1449] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.063s user 0.019s sys 0.011s
I20260928 20:02:34.625537 27191 ts_tablet_manager.cc:1996] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:34.626849 26916 raft_consensus.cc:359] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.627453 26916 raft_consensus.cc:385] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.627849 26916 raft_consensus.cc:740] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.628603 26916 consensus_queue.cc:260] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:34.630784 26916 ts_tablet_manager.cc:1480] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260928 20:02:34.633692 26916 tablet_bootstrap.cc:492] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.639612 26916 tablet_bootstrap.cc:654] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.643158 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
W20260928 20:02:34.644800 27051 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:02:34.645237 27051 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:02:34.645728 27051 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:02:34.645731 26227 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ee464b814dbf4e4b89b2d1c019befac6 consensus state has no leader
W20260928 20:02:34.646178 27051 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:02:34.647897 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:34.656293 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:34.713706 26912 raft_consensus.cc:359] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.718581 26912 raft_consensus.cc:385] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.718905 26912 raft_consensus.cc:740] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.729918 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]) successfully deleted
I20260928 20:02:34.744728 26912 consensus_queue.cc:260] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:34.766526 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 29a489266ffc47a498e8541408a1f6a2 because the tablet was not found. No further retry: Not found: Tablet not found: 29a489266ffc47a498e8541408a1f6a2
I20260928 20:02:34.766618 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0a362efb68408d8dce96dce0130035 (DEFAULT_TABLE table=default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 [id=62b393e94fb74eb6a1103662c6a672c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.767618 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0a362efb68408d8dce96dce0130035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.767813 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 882d1d6246dd4b3a81df5c57976ac631 (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]) successfully deleted
I20260928 20:02:34.769158 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet a5d73fef88894a51b9fa04cb70e29d43 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]) successfully deleted
W20260928 20:02:34.769733 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet fa037333676c4dba93160c5e3337f891 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa037333676c4dba93160c5e3337f891 already in progress: creating tablet
I20260928 20:02:34.778014 27314 raft_consensus.cc:493] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.778523 27314 raft_consensus.cc:515] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.780418 27314 leader_election.cc:290] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:34.782960 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:34.788163 26595 leader_election.cc:343] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:34.797847 26912 ts_tablet_manager.cc:1480] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.318s user 0.006s sys 0.000s
W20260928 20:02:34.829489 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1284d1f7fa774033b90133447627df4f has no consensus state
I20260928 20:02:34.831017 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 2eec17e7fb1949289d428d6dc0721de3
I20260928 20:02:34.832288 26235 catalog_manager.cc:6934] ReplaceTablet: tablet 2eec17e7fb1949289d428d6dc0721de3 deleted and replaced by tablet 29dd1355039e4bca952f13a9d174813e
W20260928 20:02:34.848107 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 433702us
W20260928 20:02:34.849398 26594 consensus_peers.cc:597] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:34.855927 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b087dcc9d5be4a9e89c35c359a18ca5c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:34.857823 26594 leader_election.cc:343] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.858757 26594 leader_election.cc:304] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.859968 27313 raft_consensus.cc:2749] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.860877 26916 tablet_bootstrap.cc:492] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.861317 26916 ts_tablet_manager.cc:1449] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.228s user 0.058s sys 0.132s
I20260928 20:02:34.866487 26916 raft_consensus.cc:359] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.867102 26916 raft_consensus.cc:385] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:34.867340 26916 raft_consensus.cc:740] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:34.867964 26916 consensus_queue.cc:260] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.869854 26916 ts_tablet_manager.cc:1480] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260928 20:02:34.872977 27265 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:34.873435 27265 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.875131 27265 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:34.875787 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:34.876257 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:34.880154 26450 leader_election.cc:343] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.796406 27171 raft_consensus.cc:697] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
W20260928 20:02:34.880726 26450 leader_election.cc:343] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:34.881036 26450 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:34.881150 27171 consensus_queue.cc:237] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.881939 27265 raft_consensus.cc:2749] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:34.883069 26913 ts_tablet_manager.cc:1480] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.686s user 0.006s sys 0.003s
W20260928 20:02:34.883327 26913 ts_tablet_manager.cc:1513] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Tablet startup took 686ms
W20260928 20:02:34.883577 26913 ts_tablet_manager.cc:1515] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Trace:
0928 20:02:29.810051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:29.810220 (+ 169us) service_pool.cc:224] Handling call
0928 20:02:29.811816 (+ 1596us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:29.811920 (+ 104us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:29.910290 (+ 98370us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:29.925409 (+ 15119us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:29.925797 (+ 388us) inbound_call.cc:177] Queueing success response
0928 20:02:33.745064 (+3819267us) ts_tablet_manager.cc:1425] Bootstrapping tablet
0928 20:02:34.197318 (+452254us) ts_tablet_manager.cc:1481] Starting tablet replica
0928 20:02:34.197824 (+ 506us) tablet_replica.cc:261] Starting instrumentation
0928 20:02:34.198395 (+ 571us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":297870,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"tablet-open.queue_time_us":3819336,"thread_start_us":316861,"threads_started":1}
I20260928 20:02:34.887902 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:34.889832 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 2eec17e7fb1949289d428d6dc0721de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 29dd1355039e4bca952f13a9d174813e) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:34.894696 26912 tablet_bootstrap.cc:492] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:34.896847 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:34.898505 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet b0655fc043b9468ea51ce5ae983e8f06 because the tablet was not found. No further retry: Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
W20260928 20:02:34.899135 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet a0dd3080d50748d2ad79f472d3c17673 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0dd3080d50748d2ad79f472d3c17673 already in progress: creating tablet
W20260928 20:02:34.899705 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet aa4f373a46de433eabd3b35b6ed3d1e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa4f373a46de433eabd3b35b6ed3d1e3 already in progress: creating tablet
I20260928 20:02:34.900389 26916 tablet_bootstrap.cc:492] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:34.900487 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet d6c0cc7bd109493cacf990dd1e2728f0 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]) successfully deleted
I20260928 20:02:34.901031 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet ff4f7ca1b194471bbad778ac4e89f6c7 (table default.Table_911e0630d48c4bd7b8f844cee768908b [id=cf711236531a4f2e82a29a160baa3b03]) successfully deleted
W20260928 20:02:34.901577 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 03370aeac73549a195a16382aa6f9de3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03370aeac73549a195a16382aa6f9de3 already in progress: creating tablet
I20260928 20:02:34.904953 27191 tablet_replica.cc:333] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:34.905655 27191 raft_consensus.cc:2243] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:34.906289 26916 tablet_bootstrap.cc:654] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:34.906425 27191 raft_consensus.cc:2272] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.908056 27191 ts_tablet_manager.cc:1962] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.912429 26912 tablet_bootstrap.cc:654] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:34.914500 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 018497a652234fbdb04cf6c034bcc5d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018497a652234fbdb04cf6c034bcc5d3 already in progress: creating tablet
I20260928 20:02:34.926252 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 (DEFAULT_TABLE table=default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.927877 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0308d824cf401c8cca0cf7a950fd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.930299 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (DEFAULT_TABLE table=default.Table_7a89876f5095449caf48d4b9430b1037 [id=4714dc67744c4ef2817fc28b16820547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.931216 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674eef4920f94d4f88aa5dc3a0b362d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.937727 26493 tablet_service.cc:1511] Processing CreateTablet for tablet a86e8a782b3e46d09a45bbb7025546af (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.938771 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86e8a782b3e46d09a45bbb7025546af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.941682 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 7242f71b93914dbeadb60617b3f2be3b (DEFAULT_TABLE table=default.Table_fa94560a66aa4d9891c359c5cc04bc63 [id=2485719e5396434d9b630e1667695c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.942654 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7242f71b93914dbeadb60617b3f2be3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.942884 26635 tablet_service.cc:1511] Processing CreateTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 (DEFAULT_TABLE table=default.Table_bed2cb6494a544afb978a8521c702d03 [id=d8c4eedc317c4c5c8a008ab4ee6d94b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.943977 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0655fc043b9468ea51ce5ae983e8f06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:34.947914 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43665us
I20260928 20:02:34.949869 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 (DEFAULT_TABLE table=default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.949950 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (DEFAULT_TABLE table=default.Table_7a89876f5095449caf48d4b9430b1037 [id=4714dc67744c4ef2817fc28b16820547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.951077 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0308d824cf401c8cca0cf7a950fd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.951560 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674eef4920f94d4f88aa5dc3a0b362d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:34.956346 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 2eec17e7fb1949289d428d6dc0721de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 29dd1355039e4bca952f13a9d174813e) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:34.957093 27011 tablet_replica.cc:333] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:34.957827 27011 raft_consensus.cc:2243] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:34.958393 27011 raft_consensus.cc:2272] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:34.958529 26800 raft_consensus.cc:3060] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:34.960254 27011 ts_tablet_manager.cc:1962] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:34.969277 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:34.974040 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet cb970d91179e48cdbbb1e32a3ca3171c (table default.Table_e37f5f95bc984b27b7fb29e83e336618 [id=cc2e9040c8104d3195750b14c727965d]) successfully deleted
I20260928 20:02:34.977286 27011 ts_tablet_manager.cc:1975] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:34.977056 26774 tablet_service.cc:1511] Processing CreateTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 (DEFAULT_TABLE table=default.Table_bed2cb6494a544afb978a8521c702d03 [id=d8c4eedc317c4c5c8a008ab4ee6d94b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:34.977684 27011 log.cc:1199] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/2eec17e7fb1949289d428d6dc0721de3
I20260928 20:02:34.978425 27011 ts_tablet_manager.cc:1996] T 2eec17e7fb1949289d428d6dc0721de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:34.885557 26913 tablet_bootstrap.cc:492] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:34.986883 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 03370aeac73549a195a16382aa6f9de3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03370aeac73549a195a16382aa6f9de3 already in progress: creating tablet
W20260928 20:02:34.992216 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 018497a652234fbdb04cf6c034bcc5d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018497a652234fbdb04cf6c034bcc5d3 already in progress: creating tablet
I20260928 20:02:34.994676 26916 tablet_bootstrap.cc:492] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:34.995179 26916 ts_tablet_manager.cc:1449] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.095s user 0.021s sys 0.015s
I20260928 20:02:34.997624 26916 raft_consensus.cc:359] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:34.978276 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0655fc043b9468ea51ce5ae983e8f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.003064 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 2eec17e7fb1949289d428d6dc0721de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 29dd1355039e4bca952f13a9d174813e) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:35.014642 26916 raft_consensus.cc:385] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.014756 26234 catalog_manager.cc:5838] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:35.016283 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:35.018247 26916 raft_consensus.cc:740] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.018883 26916 consensus_queue.cc:260] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:35.031685 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1284d1f7fa774033b90133447627df4f (table default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1284d1f7fa774033b90133447627df4f has no consensus state
I20260928 20:02:35.037338 27051 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.129.212:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.25.129.254:42899,127.25.129.253:32923,127.25.129.252:44461
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.129.252:44461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.129.252
--webserver_port=43621
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 3abfc3e270b48c5a2e69ad8b9aebc64e2a8e2644
build type FASTDEBUG
built by None at 28 Sep 2026 19:43:22 UTC on e7f111948823
build id 14046
TSAN enabled
I20260928 20:02:34.999882 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]) successfully deleted
W20260928 20:02:35.041883 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8163815661694d70ba4c2e36a424eaa1 already in progress: creating tablet
I20260928 20:02:35.042182 26493 tablet_service.cc:1511] Processing CreateTablet for tablet c6544b7b405c4831900f37e052892409 (DEFAULT_TABLE table=default.Table_9a00e08127ea41d988decb4e501ae54c [id=4ef471359f6a44ec8e83d75b99cf05c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.043169 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6544b7b405c4831900f37e052892409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.043772 26231 master_service.cc:960] ReplaceTablet: received request to replace tablet 8163815661694d70ba4c2e36a424eaa1 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:35.045073 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1d2bed217f0242aabcfc3979c76a1757" } modify_external_catalogs: true
I20260928 20:02:35.045600 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1d2bed217f0242aabcfc3979c76a1757" } modify_external_catalogs: true
I20260928 20:02:35.048209 26631 tablet_service.cc:1511] Processing CreateTablet for tablet a86e8a782b3e46d09a45bbb7025546af (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.048902 26913 tablet_bootstrap.cc:654] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.049199 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86e8a782b3e46d09a45bbb7025546af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.055397 26916 ts_tablet_manager.cc:1480] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.060s user 0.006s sys 0.000s
I20260928 20:02:35.056547 26916 tablet_bootstrap.cc:492] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:35.056481 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0a362efb68408d8dce96dce0130035 (DEFAULT_TABLE table=default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 [id=62b393e94fb74eb6a1103662c6a672c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.065312 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0a362efb68408d8dce96dce0130035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.067864 27191 ts_tablet_manager.cc:1975] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:35.068217 27191 log.cc:1199] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/2eec17e7fb1949289d428d6dc0721de3
I20260928 20:02:35.068876 27191 ts_tablet_manager.cc:1996] T 2eec17e7fb1949289d428d6dc0721de3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:35.075929 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 7242f71b93914dbeadb60617b3f2be3b (DEFAULT_TABLE table=default.Table_fa94560a66aa4d9891c359c5cc04bc63 [id=2485719e5396434d9b630e1667695c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.076632 26638 tablet_service.cc:1511] Processing CreateTablet for tablet c6544b7b405c4831900f37e052892409 (DEFAULT_TABLE table=default.Table_9a00e08127ea41d988decb4e501ae54c [id=4ef471359f6a44ec8e83d75b99cf05c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.077050 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7242f71b93914dbeadb60617b3f2be3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.077548 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6544b7b405c4831900f37e052892409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.095075 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:35.098484 27279 tablet_replica.cc:333] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:35.099996 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0a362efb68408d8dce96dce0130035 (DEFAULT_TABLE table=default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 [id=62b393e94fb74eb6a1103662c6a672c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.101171 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0a362efb68408d8dce96dce0130035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.104533 26779 tablet_service.cc:1511] Processing CreateTablet for tablet a86e8a782b3e46d09a45bbb7025546af (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.105516 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86e8a782b3e46d09a45bbb7025546af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.106434 27279 raft_consensus.cc:2243] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:35.106938 27279 raft_consensus.cc:2272] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.108763 27279 ts_tablet_manager.cc:1962] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:35.112589 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:35.114403 27051 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:02:35.114549 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:35.115648 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]) successfully deleted
I20260928 20:02:35.116817 27051 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260928 20:02:35.116883 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260928 20:02:35.122447 26912 tablet_bootstrap.cc:492] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:35.123098 26912 ts_tablet_manager.cc:1449] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.229s user 0.033s sys 0.019s
I20260928 20:02:35.127377 26913 tablet_bootstrap.cc:492] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:35.127836 26913 ts_tablet_manager.cc:1449] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.242s user 0.005s sys 0.007s
I20260928 20:02:35.130529 26912 raft_consensus.cc:359] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.131520 26912 raft_consensus.cc:385] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.131953 26912 raft_consensus.cc:740] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.132992 26912 consensus_queue.cc:260] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.151180 27265 raft_consensus.cc:493] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.152213 26913 raft_consensus.cc:359] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.152832 26913 raft_consensus.cc:385] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.153061 26913 raft_consensus.cc:740] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.161034 26913 consensus_queue.cc:260] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.133313 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 7242f71b93914dbeadb60617b3f2be3b (DEFAULT_TABLE table=default.Table_fa94560a66aa4d9891c359c5cc04bc63 [id=2485719e5396434d9b630e1667695c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.154626 26775 tablet_service.cc:1511] Processing CreateTablet for tablet c6544b7b405c4831900f37e052892409 (DEFAULT_TABLE table=default.Table_9a00e08127ea41d988decb4e501ae54c [id=4ef471359f6a44ec8e83d75b99cf05c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.177631 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_cad16d3252864a33acdd97cbb42fa80b" } new_table_name: "default.Table_060bc0393e4d45c2a1ef08a71894f56d" modify_external_catalogs: true
I20260928 20:02:35.178350 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:35.178339 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0294151911f849d7b4ddb3ae1f8abf01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:35.178701 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:35.179323 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_66b4fb7dfd10446d99fa01b7f3b019ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:35.179733 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0294151911f849d7b4ddb3ae1f8abf01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.180305 26913 ts_tablet_manager.cc:1480] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.052s user 0.004s sys 0.002s
W20260928 20:02:35.180691 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66b4fb7dfd10446d99fa01b7f3b019ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.181591 27011 tablet_replica.cc:333] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:35.183131 27011 raft_consensus.cc:2243] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:35.183614 27011 raft_consensus.cc:2272] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.184701 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2a5441b3341b4a598fabc7fadafde28a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:35.185485 27011 ts_tablet_manager.cc:1962] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:35.186236 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a5441b3341b4a598fabc7fadafde28a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.186550 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_94bb7f9333bc4698ad05e23d6003988a" } new_table_name: "default.Table_b59a850776244e54842b25bbddc43283" modify_external_catalogs: true
I20260928 20:02:35.190588 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet b22118c942324613837c489142d129fa with delete_type TABLET_DATA_DELETED (replaced by tablet e2df3978e61a4847b85cd547e76e4e58) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:35.191802 26227 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_60b73bf93b434a499c613715e7cd6464" } modify_external_catalogs: true
I20260928 20:02:35.192346 26227 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_60b73bf93b434a499c613715e7cd6464" } modify_external_catalogs: true
I20260928 20:02:35.165834 27318 raft_consensus.cc:493] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.195243 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7242f71b93914dbeadb60617b3f2be3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.198467 26913 tablet_bootstrap.cc:492] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:35.203217 27318 raft_consensus.cc:515] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.205130 27318 leader_election.cc:290] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:35.205500 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:35.206696 26804 raft_consensus.cc:3060] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:35.215060 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6544b7b405c4831900f37e052892409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.217377 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:35.225422 27011 ts_tablet_manager.cc:1975] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 20:02:35.244906 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8163815661694d70ba4c2e36a424eaa1 already in progress: creating tablet
W20260928 20:02:35.247071 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e70df4ddf0f9430980c967d798ed6c50 consensus state has no leader
I20260928 20:02:35.247524 26916 tablet_bootstrap.cc:654] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.254011 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:35.151683 27265 raft_consensus.cc:515] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:35.260094 27265 leader_election.cc:290] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:35.264195 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 596a5540716441c49ec8185c8dc6a80c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596a5540716441c49ec8185c8dc6a80c already in progress: creating tablet
I20260928 20:02:35.265992 26740 leader_election.cc:304] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:35.266826 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:35.268391 26450 leader_election.cc:343] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.269192 26912 ts_tablet_manager.cc:1480] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.146s user 0.004s sys 0.005s
I20260928 20:02:35.277566 27265 raft_consensus.cc:493] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.278045 27265 raft_consensus.cc:515] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.280553 27265 leader_election.cc:290] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:35.285552 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d7d359f62a71495f99580370aacdbff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:35.287267 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7d359f62a71495f99580370aacdbff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.301123 26802 raft_consensus.cc:3060] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:35.292363 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4604b0cf7e56457086383c4314814b21" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:35.311964 26450 leader_election.cc:343] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.313779 27279 ts_tablet_manager.cc:1975] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260928 20:02:35.320696 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09bd74bc45d14e789567df6019f6d99b consensus state has no leader
I20260928 20:02:35.320787 26912 tablet_bootstrap.cc:492] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:35.334261 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45780.1us
I20260928 20:02:35.335532 26916 tablet_bootstrap.cc:492] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:35.335952 26916 ts_tablet_manager.cc:1449] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.280s user 0.023s sys 0.002s
I20260928 20:02:35.338780 26916 raft_consensus.cc:359] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:35.338850 27340 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 20:02:35.339442 26916 raft_consensus.cc:385] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.339700 26916 raft_consensus.cc:740] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.340337 26916 consensus_queue.cc:260] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:35.343690 27335 tablet.cc:1751] T 39fb6f22905945578fa74b671d31c5f3 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:35.358134 26916 ts_tablet_manager.cc:1480] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260928 20:02:35.359400 26916 tablet_bootstrap.cc:492] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:35.369510 27279 log.cc:1199] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/2eec17e7fb1949289d428d6dc0721de3
I20260928 20:02:35.370313 27279 ts_tablet_manager.cc:1996] T 2eec17e7fb1949289d428d6dc0721de3 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:35.378261 27011 log.cc:1199] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:35.262830 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:35.378888 27011 ts_tablet_manager.cc:1996] T b087dcc9d5be4a9e89c35c359a18ca5c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:35.282688 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4604b0cf7e56457086383c4314814b21" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:35.380149 26450 leader_election.cc:343] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.380511 26450 leader_election.cc:304] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:35.381275 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet b087dcc9d5be4a9e89c35c359a18ca5c (table default.Table_75d3d3007f5b4c929142c1ec075e54f0 [id=3ceaf958c5e445639a07fa279736ee9d]) successfully deleted
I20260928 20:02:35.329591 26913 tablet_bootstrap.cc:654] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.373700 27339 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 20:02:35.391848 26233 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 39fb6f22905945578fa74b671d31c5f3 (table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]). Expected version 1 got 0
W20260928 20:02:35.392442 26450 leader_election.cc:343] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.392802 26450 leader_election.cc:304] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:35.392532 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd" } modify_external_catalogs: true
I20260928 20:02:35.393316 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd" } modify_external_catalogs: true
I20260928 20:02:35.393543 27265 raft_consensus.cc:2749] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:35.394493 27265 raft_consensus.cc:2749] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:35.403820 27344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:35.406970 26916 tablet_bootstrap.cc:654] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.410166 26912 tablet_bootstrap.cc:654] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.415118 26913 tablet_bootstrap.cc:492] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:35.415548 26913 ts_tablet_manager.cc:1449] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.217s user 0.005s sys 0.004s
W20260928 20:02:35.422415 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 596a5540716441c49ec8185c8dc6a80c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596a5540716441c49ec8185c8dc6a80c already in progress: creating tablet
I20260928 20:02:35.423280 27011 tablet_replica.cc:333] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:35.423949 27011 raft_consensus.cc:2243] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:35.426237 26233 master_service.cc:960] ReplaceTablet: received request to replace tablet 93fb4e1fd0584a42a4de9eab14d5578c from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:35.424376 27011 raft_consensus.cc:2272] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.429920 27011 ts_tablet_manager.cc:1962] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:35.441401 26913 raft_consensus.cc:359] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.442235 26913 raft_consensus.cc:385] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.442480 26913 raft_consensus.cc:740] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.443094 27346 raft_consensus.cc:493] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.443539 27346 raft_consensus.cc:515] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.445627 27346 leader_election.cc:290] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:35.447786 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:35.455956 26450 leader_election.cc:343] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.458330 26232 master_service.cc:960] ReplaceTablet: received request to replace tablet f9b18984d23e43f39fb68864b42a4edf from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:35.459206 26913 consensus_queue.cc:260] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.493000 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet f9b18984d23e43f39fb68864b42a4edf
I20260928 20:02:35.493345 26913 ts_tablet_manager.cc:1480] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.078s user 0.007s sys 0.000s
I20260928 20:02:35.500705 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e2c97e1d3b2546f68c665d8cfaa60c67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:35.503854 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_82491753b5fc4f5290c7b0ffaef58075"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:35.506747 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_26449cfa6e994b6e85217f102a4d138c" } new_table_name: "default.Table_c94837fc38444486aa0a38bb0653aab2" modify_external_catalogs: true
I20260928 20:02:35.520493 26913 tablet_bootstrap.cc:492] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:35.525228 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 2eec17e7fb1949289d428d6dc0721de3 (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]) successfully deleted
I20260928 20:02:35.533849 27011 ts_tablet_manager.cc:1975] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:35.535768 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:35.537245 26450 leader_election.cc:343] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.537634 26450 leader_election.cc:304] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:35.538626 27346 raft_consensus.cc:2749] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:35.552769 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8163815661694d70ba4c2e36a424eaa1 already in progress: creating tablet
W20260928 20:02:35.553452 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 596a5540716441c49ec8185c8dc6a80c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596a5540716441c49ec8185c8dc6a80c already in progress: creating tablet
I20260928 20:02:35.562758 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_654238d4e0904888886070248583950a" } new_table_name: "default.Table_d6cb9e0f31344046bf6b277b4387032b" modify_external_catalogs: true
I20260928 20:02:35.572860 27318 raft_consensus.cc:2749] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:35.577438 27011 log.cc:1199] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/b22118c942324613837c489142d129fa
I20260928 20:02:35.578150 27011 ts_tablet_manager.cc:1996] T b22118c942324613837c489142d129fa P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:35.580435 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet b22118c942324613837c489142d129fa (table default.Table_08b55d52f8a64fba90ccea539ecd0681 [id=21db6c1a209b49f9b0ea4f7dd7373814]) successfully deleted
I20260928 20:02:35.554780 26913 tablet_bootstrap.cc:654] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:35.557577 26125 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 114224us
I20260928 20:02:35.597337 26913 tablet_bootstrap.cc:492] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:35.598192 26913 ts_tablet_manager.cc:1449] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.104s user 0.011s sys 0.002s
I20260928 20:02:35.604734 26913 raft_consensus.cc:359] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:35.605358 26913 raft_consensus.cc:385] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.605583 26913 raft_consensus.cc:740] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.613161 27341 tablet.cc:1751] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 20:02:35.618943 26235 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_a15b3b57a6fb4ad2a7092839d92714b0 [id=75885afaa1e345bbbd03e28c895c79d5] alter complete (version 4)
I20260928 20:02:35.627022 26913 consensus_queue.cc:260] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:35.631645 26912 tablet_bootstrap.cc:492] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:35.632126 26912 ts_tablet_manager.cc:1449] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.359s user 0.009s sys 0.014s
I20260928 20:02:35.636188 26913 ts_tablet_manager.cc:1480] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.038s user 0.004s sys 0.001s
I20260928 20:02:35.638934 26913 tablet_bootstrap.cc:492] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:35.650218 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:35.654450 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82491753b5fc4f5290c7b0ffaef58075 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.660226 26232 catalog_manager.cc:6934] ReplaceTablet: tablet f9b18984d23e43f39fb68864b42a4edf deleted and replaced by tablet bea088286327486f929e5591b2809cd9
I20260928 20:02:35.661787 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b18984d23e43f39fb68864b42a4edf with delete_type TABLET_DATA_DELETED (replaced by tablet bea088286327486f929e5591b2809cd9) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:35.662354 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b18984d23e43f39fb68864b42a4edf with delete_type TABLET_DATA_DELETED (replaced by tablet bea088286327486f929e5591b2809cd9) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:35.662582 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b18984d23e43f39fb68864b42a4edf with delete_type TABLET_DATA_DELETED (replaced by tablet bea088286327486f929e5591b2809cd9) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:35.663045 27191 tablet_replica.cc:333] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:35.663260 27279 tablet_replica.cc:333] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:35.663754 27191 raft_consensus.cc:2243] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:35.663918 27279 raft_consensus.cc:2243] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:35.664223 27191 raft_consensus.cc:2272] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.664346 27279 raft_consensus.cc:2272] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.666162 27011 tablet_replica.cc:333] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:35.666649 27191 ts_tablet_manager.cc:1962] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:35.666833 27011 raft_consensus.cc:2243] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:35.667598 27011 raft_consensus.cc:2272] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.669962 27011 ts_tablet_manager.cc:1962] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:35.681005 27279 ts_tablet_manager.cc:1962] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:35.681643 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3e2de7890874892be6ae5a2008d8a12 has no consensus state
I20260928 20:02:35.687937 27191 ts_tablet_manager.cc:1975] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:02:35.688329 27191 log.cc:1199] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/f9b18984d23e43f39fb68864b42a4edf
I20260928 20:02:35.689059 27191 ts_tablet_manager.cc:1996] T f9b18984d23e43f39fb68864b42a4edf P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:35.688838 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_07b83969683b44e6a8cfc75d770cd0be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:35.690502 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07b83969683b44e6a8cfc75d770cd0be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.640602 26912 raft_consensus.cc:359] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.696219 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_a15b3b57a6fb4ad2a7092839d92714b0 [id=75885afaa1e345bbbd03e28c895c79d5]) successfully deleted
I20260928 20:02:35.696352 26912 raft_consensus.cc:385] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.696614 26912 raft_consensus.cc:740] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.697216 26912 consensus_queue.cc:260] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.703109 26916 tablet_bootstrap.cc:492] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:35.706423 26916 ts_tablet_manager.cc:1449] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.347s user 0.021s sys 0.015s
I20260928 20:02:35.708830 26916 raft_consensus.cc:359] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:35.709463 26916 raft_consensus.cc:385] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.709704 26916 raft_consensus.cc:740] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.719606 27171 raft_consensus.cc:493] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.720018 27171 raft_consensus.cc:515] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.724709 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd70ba6c0f1b43fcaa37bce4bf87a5e6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:35.728366 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd70ba6c0f1b43fcaa37bce4bf87a5e6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:35.728989 26516 raft_consensus.cc:2468] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:35.732357 26595 leader_election.cc:304] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:35.733228 27313 raft_consensus.cc:2804] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:35.733551 27313 raft_consensus.cc:493] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:35.733837 27313 raft_consensus.cc:3060] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:35.739415 26594 consensus_peers.cc:597] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:35.740149 26594 leader_election.cc:343] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.721868 27171 leader_election.cc:290] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:35.741129 26912 ts_tablet_manager.cc:1480] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.109s user 0.004s sys 0.002s
I20260928 20:02:35.743831 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_101a375ee5e84e1aa7e611fc10883e70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:35.750874 26912 tablet_bootstrap.cc:492] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:35.719159 26913 tablet_bootstrap.cc:654] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.748190 27313 raft_consensus.cc:515] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.756786 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd70ba6c0f1b43fcaa37bce4bf87a5e6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:35.758271 26594 leader_election.cc:343] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:35.769589 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_101a375ee5e84e1aa7e611fc10883e70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:35.773084 26229 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d5ed5998a6194061839143c4adf4d3d4 (table default.Table_d6cb9e0f31344046bf6b277b4387032b [id=911769c45f044f3b8772d685b79d2e30]). Expected version 1 got 0
I20260928 20:02:35.773202 26916 consensus_queue.cc:260] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:35.778005 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet b22118c942324613837c489142d129fa with delete_type TABLET_DATA_DELETED (replaced by tablet e2df3978e61a4847b85cd547e76e4e58) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:35.782069 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd70ba6c0f1b43fcaa37bce4bf87a5e6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:35.782642 26516 raft_consensus.cc:3060] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:35.788488 26516 raft_consensus.cc:2468] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:35.789537 26595 leader_election.cc:304] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:35.790429 27171 raft_consensus.cc:2804] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:35.806352 27313 leader_election.cc:290] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:35.826184 27346 raft_consensus.cc:493] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.826650 27346 raft_consensus.cc:515] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.831342 27346 leader_election.cc:290] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:35.831359 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:35.833727 26450 leader_election.cc:343] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.832844 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:35.842773 26450 leader_election.cc:343] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.843151 26450 leader_election.cc:304] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:35.843773 27346 raft_consensus.cc:2749] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:35.844580 26912 tablet_bootstrap.cc:654] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.845356 26916 ts_tablet_manager.cc:1480] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.139s user 0.004s sys 0.002s
I20260928 20:02:35.846206 27171 raft_consensus.cc:697] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:35.847020 27171 consensus_queue.cc:237] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.848974 26913 tablet_bootstrap.cc:492] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:35.854038 27279 ts_tablet_manager.cc:1975] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:02:35.854478 27279 log.cc:1199] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/f9b18984d23e43f39fb68864b42a4edf
I20260928 20:02:35.855230 27279 ts_tablet_manager.cc:1996] T f9b18984d23e43f39fb68864b42a4edf P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:35.857856 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_a15b3b57a6fb4ad2a7092839d92714b0 [id=75885afaa1e345bbbd03e28c895c79d5]) successfully deleted
I20260928 20:02:35.858469 26913 ts_tablet_manager.cc:1449] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.220s user 0.009s sys 0.001s
I20260928 20:02:35.858989 27279 tablet_replica.cc:333] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:35.861231 26913 raft_consensus.cc:359] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.853708 27011 ts_tablet_manager.cc:1975] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:02:35.862349 27011 log.cc:1199] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/f9b18984d23e43f39fb68864b42a4edf
I20260928 20:02:35.863062 27011 ts_tablet_manager.cc:1996] T f9b18984d23e43f39fb68864b42a4edf P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:35.861914 26913 raft_consensus.cc:385] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.865224 26913 raft_consensus.cc:740] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.865968 26913 consensus_queue.cc:260] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.867929 26913 ts_tablet_manager.cc:1480] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260928 20:02:35.868009 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet f9b18984d23e43f39fb68864b42a4edf (table default.Table_a15b3b57a6fb4ad2a7092839d92714b0 [id=75885afaa1e345bbbd03e28c895c79d5]) successfully deleted
I20260928 20:02:35.868793 26913 tablet_bootstrap.cc:492] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:35.869498 26916 tablet_bootstrap.cc:492] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:35.876726 27313 raft_consensus.cc:493] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:35.877287 27313 raft_consensus.cc:515] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:35.877919 26913 tablet_bootstrap.cc:654] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:35.886610 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0294151911f849d7b4ddb3ae1f8abf01" } new_table_name: "default.Table_e078e9ee7df74c4da5e5073aac7da2f0" modify_external_catalogs: true
I20260928 20:02:35.880584 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:35.891324 26594 leader_election.cc:343] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:35.881024 27313 leader_election.cc:290] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:35.898731 27279 raft_consensus.cc:2243] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:35.899432 27279 raft_consensus.cc:2272] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:35.918542 27339 tablet.cc:1751] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:35.928442 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bba200d6ef33438187dd643fe3ded009 has no consensus state
I20260928 20:02:35.922060 27341 tablet.cc:1751] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:35.951618 26912 tablet_bootstrap.cc:492] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:35.952032 26912 ts_tablet_manager.cc:1449] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.201s user 0.008s sys 0.007s
W20260928 20:02:35.955005 27343 raft_consensus.cc:670] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260928 20:02:35.954909 26912 raft_consensus.cc:359] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.955545 26912 raft_consensus.cc:385] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:35.955780 26912 raft_consensus.cc:740] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:35.956291 26912 consensus_queue.cc:260] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:35.958020 26912 ts_tablet_manager.cc:1480] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260928 20:02:35.958818 26912 tablet_bootstrap.cc:492] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:35.965662 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 1edf314241784091a603907a43429b28 (DEFAULT_TABLE table=default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 [id=b39c31256b914e41bdb078ad90d6506b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.966750 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edf314241784091a603907a43429b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.972549 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a66ea6e7060e4febbaaf659c8b702e03" } new_table_name: "default.Table_3caa6aa87b0d4322b7aa92ef4e177f09" modify_external_catalogs: true
I20260928 20:02:35.985502 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 1edf314241784091a603907a43429b28 (DEFAULT_TABLE table=default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 [id=b39c31256b914e41bdb078ad90d6506b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.986997 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edf314241784091a603907a43429b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.989760 26775 tablet_service.cc:1511] Processing CreateTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 (DEFAULT_TABLE table=default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 [id=899ddfb9d42b4edab7acc6c374382cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:35.990845 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c267b42754dbca8eb5ebec2d66a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:35.994746 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:35.996328 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:35.997854 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:35.998662 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:36.000273 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:36.001721 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:36.002594 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2728c9979bb647a5a8f0a902c299e53d already in progress: creating tablet
W20260928 20:02:36.003422 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 946f215581734bf591ab05502e5ff4a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946f215581734bf591ab05502e5ff4a0 already in progress: creating tablet
I20260928 20:02:36.010825 26631 tablet_service.cc:1511] Processing CreateTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 (DEFAULT_TABLE table=default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 [id=899ddfb9d42b4edab7acc6c374382cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.011868 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c267b42754dbca8eb5ebec2d66a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.034088 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 534674440ee649e4afbc87b3cce5c43e (DEFAULT_TABLE table=default.Table_e8c7c9bf121c488eb28e0006cf46469c [id=d258873b4bfc4dd188356430c116e0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.035269 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534674440ee649e4afbc87b3cce5c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.040436 26913 tablet_bootstrap.cc:492] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:36.040872 26913 ts_tablet_manager.cc:1449] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.172s user 0.032s sys 0.043s
W20260928 20:02:36.040813 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bba200d6ef33438187dd643fe3ded009 has no consensus state
I20260928 20:02:36.043361 26913 raft_consensus.cc:359] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:36.044101 26913 raft_consensus.cc:385] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.044387 26913 raft_consensus.cc:740] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.045130 26913 consensus_queue.cc:260] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:36.047001 26913 ts_tablet_manager.cc:1480] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:02:36.048195 26913 tablet_bootstrap.cc:492] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:36.054349 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ff6225f056a84389992b4f66f946fb3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:36.054582 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6053fca76433492abb383b4740be7bc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:36.055699 26913 tablet_bootstrap.cc:654] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:36.055923 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff6225f056a84389992b4f66f946fb3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:36.056151 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6053fca76433492abb383b4740be7bc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.062245 26236 catalog_manager.cc:5838] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:36.064137 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:36.065042 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:36.066821 26913 tablet_bootstrap.cc:492] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:36.067243 26913 ts_tablet_manager.cc:1449] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20260928 20:02:36.021798 27279 ts_tablet_manager.cc:1962] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:36.031072 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 534674440ee649e4afbc87b3cce5c43e (DEFAULT_TABLE table=default.Table_e8c7c9bf121c488eb28e0006cf46469c [id=d258873b4bfc4dd188356430c116e0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.068387 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534674440ee649e4afbc87b3cce5c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.069176 26912 tablet_bootstrap.cc:654] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.069787 26913 raft_consensus.cc:359] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.070572 26913 raft_consensus.cc:385] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.070866 26913 raft_consensus.cc:740] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.071586 26913 consensus_queue.cc:260] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.074767 26913 ts_tablet_manager.cc:1480] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260928 20:02:36.075608 26913 tablet_bootstrap.cc:492] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:36.080140 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ba39b68fc8f040688126ae288d501ac3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:36.081655 26913 tablet_bootstrap.cc:654] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:36.081720 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba39b68fc8f040688126ae288d501ac3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.088428 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:36.089674 26233 catalog_manager.cc:6934] ReplaceTablet: tablet 93fb4e1fd0584a42a4de9eab14d5578c deleted and replaced by tablet b94aed8337bb4b20b7977e91640c6710
I20260928 20:02:36.091362 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:36.092751 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38abbc891d9c4268820cb0faba3d08b5 consensus state has no leader
I20260928 20:02:36.093734 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:36.098335 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 93fb4e1fd0584a42a4de9eab14d5578c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93fb4e1fd0584a42a4de9eab14d5578c already in progress: creating tablet
I20260928 20:02:36.101818 26913 tablet_bootstrap.cc:492] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:36.102378 26913 ts_tablet_manager.cc:1449] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.009s
I20260928 20:02:36.105244 26913 raft_consensus.cc:359] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.105902 26913 raft_consensus.cc:385] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.106272 26913 raft_consensus.cc:740] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.106913 26913 consensus_queue.cc:260] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.109648 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6ec1e12c8d3f4b0495f644ddc8ba7ad9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.111120 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ec1e12c8d3f4b0495f644ddc8ba7ad9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.115775 26913 ts_tablet_manager.cc:1480] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.013s user 0.000s sys 0.005s
I20260928 20:02:36.115672 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 4b91a573103c4c2d995abde8db91b821 (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.116641 26913 tablet_bootstrap.cc:492] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:36.116726 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b91a573103c4c2d995abde8db91b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.120602 26784 tablet_service.cc:1511] Processing CreateTablet for tablet db5f5f16f2d7457799e1b96a293695f4 (DEFAULT_TABLE table=default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a [id=fd3816a55b234cad88a421587951bb94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.121565 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5f5f16f2d7457799e1b96a293695f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.123294 26913 tablet_bootstrap.cc:654] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.127089 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 4b91a573103c4c2d995abde8db91b821 (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.128508 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b91a573103c4c2d995abde8db91b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.136583 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b624c955d67b4573ac8431cd87fffb48" } new_table_name: "default.Table_77549b4ee8db495692f2cc830dc826b2" modify_external_catalogs: true
I20260928 20:02:36.147116 26631 tablet_service.cc:1511] Processing CreateTablet for tablet db5f5f16f2d7457799e1b96a293695f4 (DEFAULT_TABLE table=default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a [id=fd3816a55b234cad88a421587951bb94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.148226 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5f5f16f2d7457799e1b96a293695f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.152104 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 1284d1f7fa774033b90133447627df4f (DEFAULT_TABLE table=default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.168543 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 718a2abfe21b4a2986b77e14e4e52152 (DEFAULT_TABLE table=default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.169833 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718a2abfe21b4a2986b77e14e4e52152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.172808 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 718a2abfe21b4a2986b77e14e4e52152 (DEFAULT_TABLE table=default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.175061 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718a2abfe21b4a2986b77e14e4e52152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.183497 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 1284d1f7fa774033b90133447627df4f (DEFAULT_TABLE table=default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.185065 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1284d1f7fa774033b90133447627df4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.194134 26489 tablet_service.cc:1511] Processing CreateTablet for tablet db5f5f16f2d7457799e1b96a293695f4 (DEFAULT_TABLE table=default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a [id=fd3816a55b234cad88a421587951bb94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.195777 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5f5f16f2d7457799e1b96a293695f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.201663 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a15b3b57a6fb4ad2a7092839d92714b0" } modify_external_catalogs: true
I20260928 20:02:36.202209 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a15b3b57a6fb4ad2a7092839d92714b0" } modify_external_catalogs: true
I20260928 20:02:36.203959 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 1edf314241784091a603907a43429b28 (DEFAULT_TABLE table=default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 [id=b39c31256b914e41bdb078ad90d6506b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.205310 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1edf314241784091a603907a43429b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.207193 26486 tablet_service.cc:1511] Processing CreateTablet for tablet d3e2de7890874892be6ae5a2008d8a12 (DEFAULT_TABLE table=default.Table_c94837fc38444486aa0a38bb0653aab2 [id=06e70e3562fa4d06ac62f31df801e152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.207808 26636 tablet_service.cc:1511] Processing CreateTablet for tablet d3e2de7890874892be6ae5a2008d8a12 (DEFAULT_TABLE table=default.Table_c94837fc38444486aa0a38bb0653aab2 [id=06e70e3562fa4d06ac62f31df801e152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.208247 26486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e2de7890874892be6ae5a2008d8a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.208791 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e2de7890874892be6ae5a2008d8a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.212843 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 8a616a7dbd8e4a99bc133f2bd61a4808 (DEFAULT_TABLE table=default.Table_039c27c2317f4d218f78454b1adcde10 [id=30d0193942bb4680bd08e5ed6064b8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.213865 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a616a7dbd8e4a99bc133f2bd61a4808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.214349 26230 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_d6cb9e0f31344046bf6b277b4387032b [id=911769c45f044f3b8772d685b79d2e30] alter complete (version 1)
I20260928 20:02:36.232820 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 534674440ee649e4afbc87b3cce5c43e (DEFAULT_TABLE table=default.Table_e8c7c9bf121c488eb28e0006cf46469c [id=d258873b4bfc4dd188356430c116e0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.233947 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534674440ee649e4afbc87b3cce5c43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.242436 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:36.243472 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:36.244706 26494 tablet_service.cc:1511] Processing CreateTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 (DEFAULT_TABLE table=default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 [id=899ddfb9d42b4edab7acc6c374382cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.245695 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c267b42754dbca8eb5ebec2d66a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.255973 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:36.256597 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 1284d1f7fa774033b90133447627df4f (DEFAULT_TABLE table=default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.258065 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 4b91a573103c4c2d995abde8db91b821 (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.259253 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b91a573103c4c2d995abde8db91b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.269932 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 8a616a7dbd8e4a99bc133f2bd61a4808 (DEFAULT_TABLE table=default.Table_039c27c2317f4d218f78454b1adcde10 [id=30d0193942bb4680bd08e5ed6064b8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.271402 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a616a7dbd8e4a99bc133f2bd61a4808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.274636 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 29dd1355039e4bca952f13a9d174813e (DEFAULT_TABLE table=default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.275606 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29dd1355039e4bca952f13a9d174813e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:36.278666 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9a8177684ed461cbc7bbc4aeb30873c consensus state has no leader
I20260928 20:02:36.279330 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8be4bac0846045f1b0438d588fe17c76" } modify_external_catalogs: true
I20260928 20:02:36.279812 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8be4bac0846045f1b0438d588fe17c76" } modify_external_catalogs: true
I20260928 20:02:36.285948 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:36.302726 26231 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet bea088286327486f929e5591b2809cd9
I20260928 20:02:36.309769 26232 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_074d381c532c42e29a79dd9296e083a6" } new_table_name: "default.Table_402a55b920da45e884c1b48742a7e424" modify_external_catalogs: true
I20260928 20:02:36.311870 27376 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.316327 27376 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:36.317253 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:36.323119 26513 raft_consensus.cc:2468] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:36.326057 27376 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:36.337333 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 775b9a076bf048bea39423d3554babf7 (DEFAULT_TABLE table=default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.338469 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775b9a076bf048bea39423d3554babf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.351421 26485 tablet_service.cc:1511] Processing CreateTablet for tablet ef3e590ceb1345da99e67e5fa627fa9f (DEFAULT_TABLE table=default.Table_5e0b70bfe04843ab9cfdb7a2dc3846f5 [id=25d5fa0c93cd4ccb8df95b79e830743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.352599 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3e590ceb1345da99e67e5fa627fa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.358502 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4604b0cf7e56457086383c4314814b21
I20260928 20:02:36.361020 26484 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:36.377771 26916 tablet_bootstrap.cc:700] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent opening tablet: real 0.483s user 0.001s sys 0.000s
I20260928 20:02:36.378854 26916 tablet_bootstrap.cc:654] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.391497 27191 tablet_replica.cc:333] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:36.318602 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 29dd1355039e4bca952f13a9d174813e (DEFAULT_TABLE table=default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.393569 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29dd1355039e4bca952f13a9d174813e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:36.395200 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 946f215581734bf591ab05502e5ff4a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946f215581734bf591ab05502e5ff4a0 already in progress: creating tablet
W20260928 20:02:36.395901 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2728c9979bb647a5a8f0a902c299e53d already in progress: creating tablet
W20260928 20:02:36.396426 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 93fb4e1fd0584a42a4de9eab14d5578c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93fb4e1fd0584a42a4de9eab14d5578c already in progress: creating tablet
I20260928 20:02:36.339757 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 775b9a076bf048bea39423d3554babf7 (DEFAULT_TABLE table=default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.399014 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775b9a076bf048bea39423d3554babf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.342036 27359 consensus_queue.cc:1048] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:36.343071 26595 leader_election.cc:304] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.343955 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:36.404083 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 61096.7us
W20260928 20:02:36.404807 26450 leader_election.cc:343] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.405787 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:36.406298 26639 tablet_service.cc:1511] Processing CreateTablet for tablet ef3e590ceb1345da99e67e5fa627fa9f (DEFAULT_TABLE table=default.Table_5e0b70bfe04843ab9cfdb7a2dc3846f5 [id=25d5fa0c93cd4ccb8df95b79e830743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.407234 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3e590ceb1345da99e67e5fa627fa9f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:36.408968 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4604b0cf7e56457086383c4314814b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4604b0cf7e56457086383c4314814b21 already in progress: creating tablet
I20260928 20:02:36.413767 27359 raft_consensus.cc:2804] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:36.414183 27359 raft_consensus.cc:493] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:36.414567 27359 raft_consensus.cc:3060] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:36.419890 27313 raft_consensus.cc:493] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.420421 27313 raft_consensus.cc:515] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.422832 27313 leader_election.cc:290] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:36.426469 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:36.427124 26513 raft_consensus.cc:2468] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:36.429006 26595 leader_election.cc:304] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:36.429867 27313 raft_consensus.cc:2804] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:36.430238 27313 raft_consensus.cc:493] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:36.430549 27313 raft_consensus.cc:3060] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:36.447037 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1284d1f7fa774033b90133447627df4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.452064 26916 tablet_bootstrap.cc:492] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:36.452510 26916 ts_tablet_manager.cc:1449] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.583s user 0.018s sys 0.002s
I20260928 20:02:36.191568 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 718a2abfe21b4a2986b77e14e4e52152 (DEFAULT_TABLE table=default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.192723 26912 tablet_bootstrap.cc:492] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:36.207113 26774 tablet_service.cc:1511] Processing CreateTablet for tablet d3e2de7890874892be6ae5a2008d8a12 (DEFAULT_TABLE table=default.Table_c94837fc38444486aa0a38bb0653aab2 [id=06e70e3562fa4d06ac62f31df801e152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.209771 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 8a616a7dbd8e4a99bc133f2bd61a4808 (DEFAULT_TABLE table=default.Table_039c27c2317f4d218f78454b1adcde10 [id=30d0193942bb4680bd08e5ed6064b8ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.460100 26912 ts_tablet_manager.cc:1449] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.501s user 0.010s sys 0.004s
I20260928 20:02:36.460547 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718a2abfe21b4a2986b77e14e4e52152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.461630 27191 raft_consensus.cc:2243] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:36.329950 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 29dd1355039e4bca952f13a9d174813e (DEFAULT_TABLE table=default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.462080 27191 raft_consensus.cc:2272] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:36.343293 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 775b9a076bf048bea39423d3554babf7 (DEFAULT_TABLE table=default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.343786 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:36.346655 26782 tablet_service.cc:1511] Processing CreateTablet for tablet ef3e590ceb1345da99e67e5fa627fa9f (DEFAULT_TABLE table=default.Table_5e0b70bfe04843ab9cfdb7a2dc3846f5 [id=25d5fa0c93cd4ccb8df95b79e830743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:36.360092 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:36.423422 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:36.234423 27343 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.463910 27191 ts_tablet_manager.cc:1962] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:36.464344 26450 leader_election.cc:343] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.464244 27343 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.464720 26450 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.465550 27346 raft_consensus.cc:2749] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:36.466176 27343 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:36.466442 26912 raft_consensus.cc:359] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.466863 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a616a7dbd8e4a99bc133f2bd61a4808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.467031 26912 raft_consensus.cc:385] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.467276 26912 raft_consensus.cc:740] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.468197 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29dd1355039e4bca952f13a9d174813e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:36.468750 26594 leader_election.cc:343] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.468809 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:36.469846 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:36.470585 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775b9a076bf048bea39423d3554babf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.471205 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e2de7890874892be6ae5a2008d8a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.471545 26912 consensus_queue.cc:260] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.472112 26739 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:36.473357 26912 ts_tablet_manager.cc:1480] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260928 20:02:36.473850 27318 raft_consensus.cc:2749] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:36.474658 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3e590ceb1345da99e67e5fa627fa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.512676 26912 tablet_bootstrap.cc:492] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:36.534555 27313 raft_consensus.cc:515] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.535879 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1284d1f7fa774033b90133447627df4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:36.536624 27313 leader_election.cc:290] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:36.539175 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:36.540568 26594 leader_election.cc:343] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.541847 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:36.542353 26516 raft_consensus.cc:3060] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:36.547070 26912 tablet_bootstrap.cc:654] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.548298 26516 raft_consensus.cc:2468] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:36.549950 26595 leader_election.cc:304] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.552176 26916 raft_consensus.cc:359] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:36.553015 26916 raft_consensus.cc:385] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.553313 26916 raft_consensus.cc:740] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.564617 27384 raft_consensus.cc:2804] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:36.568615 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4000858d14c54415a5908450db7f35bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.570221 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4000858d14c54415a5908450db7f35bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.573745 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_495c2b52ba314f338d8f81d8bf071236" } new_table_name: "default.Table_d91523ef25e54050a873a70bbc0c787a" modify_external_catalogs: true
I20260928 20:02:36.573885 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ddbef16a957543e9a5d66e47979c16be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.575309 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddbef16a957543e9a5d66e47979c16be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.578416 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0f2425b8a3f44839afa3d4dd8d45b246"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.579764 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f2425b8a3f44839afa3d4dd8d45b246 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.580608 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba39b68fc8f040688126ae288d501ac3" } modify_external_catalogs: true
I20260928 20:02:36.581333 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_9383c6792e2d433ab615717932fa897e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.582777 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9383c6792e2d433ab615717932fa897e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.597553 27346 raft_consensus.cc:493] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.598037 27346 raft_consensus.cc:515] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:36.600742 27346 leader_election.cc:290] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:36.601410 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:36.603184 26450 leader_election.cc:343] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.534528 27359 raft_consensus.cc:515] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:36.615746 27191 ts_tablet_manager.cc:1975] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:36.616248 27191 log.cc:1199] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4604b0cf7e56457086383c4314814b21
I20260928 20:02:36.617270 27191 ts_tablet_manager.cc:1996] T 4604b0cf7e56457086383c4314814b21 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:36.618606 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 4604b0cf7e56457086383c4314814b21 (table default.Table_8be4bac0846045f1b0438d588fe17c76 [id=b89fadac9a1245d9a401cab84a9d7c90]) successfully deleted
I20260928 20:02:36.625929 27384 raft_consensus.cc:697] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:36.630383 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ba39b68fc8f040688126ae288d501ac3" } modify_external_catalogs: true
W20260928 20:02:36.631529 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d90ce97d3db4bff8b2eea71c530c351 consensus state has no leader
I20260928 20:02:36.634145 26916 consensus_queue.cc:260] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:36.634944 27346 raft_consensus.cc:493] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.634797 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:36.635341 27346 raft_consensus.cc:515] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:36.639719 27346 leader_election.cc:290] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:36.640702 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet d938ea61370c493585d01a30e7381695 with delete_type TABLET_DATA_DELETED (replaced by tablet 4d0308d824cf401c8cca0cf7a950fd53) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:36.641391 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:36.643249 26450 leader_election.cc:343] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.645953 27279 ts_tablet_manager.cc:1975] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:36.650908 26916 ts_tablet_manager.cc:1480] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.198s user 0.006s sys 0.001s
I20260928 20:02:36.629078 27384 consensus_queue.cc:237] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.675917 27359 leader_election.cc:290] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:36.680519 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:36.681594 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:36.682068 26450 leader_election.cc:343] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.682559 26450 leader_election.cc:304] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.683334 27265 raft_consensus.cc:2749] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:36.700994 26450 leader_election.cc:343] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.701396 26450 leader_election.cc:304] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.701474 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9a00e08127ea41d988decb4e501ae54c" } modify_external_catalogs: true
I20260928 20:02:36.702004 27265 raft_consensus.cc:2749] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:36.701984 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9a00e08127ea41d988decb4e501ae54c" } modify_external_catalogs: true
W20260928 20:02:36.702508 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 131117us
I20260928 20:02:36.707582 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet 03370aeac73549a195a16382aa6f9de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 718a2abfe21b4a2986b77e14e4e52152) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:36.708472 27011 tablet_replica.cc:333] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:36.709290 27011 raft_consensus.cc:2243] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:36.709777 27011 raft_consensus.cc:2272] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:36.711689 27011 ts_tablet_manager.cc:1962] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:36.713701 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:36.714066 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:36.714624 26515 raft_consensus.cc:3060] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:36.736713 26916 tablet_bootstrap.cc:492] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:36.732583 27393 tablet.cc:1751] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:36.753829 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:36.756505 26231 catalog_manager.cc:5838] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:36.757838 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:36.652534 26803 raft_consensus.cc:3060] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:36.655606 26912 tablet_bootstrap.cc:492] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:36.767872 26912 ts_tablet_manager.cc:1449] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.255s user 0.008s sys 0.002s
I20260928 20:02:36.674954 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:36.770236 26912 raft_consensus.cc:359] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.770843 26912 raft_consensus.cc:385] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.781548 26515 raft_consensus.cc:2468] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:36.771077 26912 raft_consensus.cc:740] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.787539 26912 consensus_queue.cc:260] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:36.788091 26594 leader_election.cc:343] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.756950 27011 ts_tablet_manager.cc:1975] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:36.790174 27011 log.cc:1199] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/03370aeac73549a195a16382aa6f9de3
I20260928 20:02:36.791254 27387 raft_consensus.cc:493] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.791761 27387 raft_consensus.cc:515] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.793787 27387 leader_election.cc:290] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:36.794642 27011 ts_tablet_manager.cc:1996] T 03370aeac73549a195a16382aa6f9de3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:36.794867 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet c6544b7b405c4831900f37e052892409
I20260928 20:02:36.795619 26595 leader_election.cc:304] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.796581 27384 raft_consensus.cc:2804] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:36.797003 27384 raft_consensus.cc:697] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:36.797745 27384 consensus_queue.cc:237] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:36.803386 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:36.803458 26488 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:36.809581 26595 leader_election.cc:343] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:36.810480 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fd24cd5adf4774a13aeac30315f6f9" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:36.811460 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet c6544b7b405c4831900f37e052892409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6544b7b405c4831900f37e052892409 already in progress: creating tablet
I20260928 20:02:36.812373 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 03370aeac73549a195a16382aa6f9de3 (table default.Table_84b84e38b1a343b082d36bca0a4fa27d [id=1c98cebcd6b8483da31aacf5265453f8]) successfully deleted
W20260928 20:02:36.813062 26594 leader_election.cc:343] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.813565 26594 leader_election.cc:304] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:36.814248 26916 tablet_bootstrap.cc:654] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.815896 26912 ts_tablet_manager.cc:1480] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.048s user 0.005s sys 0.001s
I20260928 20:02:36.816618 27400 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:36.819986 26912 tablet_bootstrap.cc:492] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:36.822269 27279 log.cc:1199] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b22118c942324613837c489142d129fa
I20260928 20:02:36.822934 27279 ts_tablet_manager.cc:1996] T b22118c942324613837c489142d129fa P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:36.823094 27011 tablet_replica.cc:333] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:36.824524 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:36.831719 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:36.836017 27343 raft_consensus.cc:493] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.836597 27343 raft_consensus.cc:515] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.836778 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7a89876f5095449caf48d4b9430b1037" } new_table_name: "default.Table_797ad827e0e34feb927d0abdb8b9ab1a" modify_external_catalogs: true
I20260928 20:02:36.837462 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_bffcee37a58246d080c1be814e418f5f" } new_table_name: "default.Table_841f8694539d49ad85dd21d2f74da8f7" modify_external_catalogs: true
I20260928 20:02:36.839587 27343 leader_election.cc:290] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:36.840754 26493 consensus_meta.cc:287] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.532s user 0.008s sys 0.000s
I20260928 20:02:36.840852 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_26df3b482a9148f592e434c9a0d02b0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.846577 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26df3b482a9148f592e434c9a0d02b0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:36.850670 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 674eef4920f94d4f88aa5dc3a0b362d3 consensus state has no leader
I20260928 20:02:36.857621 27387 raft_consensus.cc:493] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:36.857803 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_deb6452bc7ae40239d21f47b0d123fed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:36.858206 27387 raft_consensus.cc:515] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:36.859351 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deb6452bc7ae40239d21f47b0d123fed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.860064 27387 leader_election.cc:290] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:36.861626 26740 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d938ea61370c493585d01a30e7381695
I20260928 20:02:36.864053 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:36.871557 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:36.872255 26515 raft_consensus.cc:2468] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:36.873383 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a79a8a3ed31b47348f4de573aef54ed6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:36.875145 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a79a8a3ed31b47348f4de573aef54ed6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.877231 26595 leader_election.cc:304] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:36.878706 27390 raft_consensus.cc:2804] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:36.879031 27390 raft_consensus.cc:493] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:36.879328 27390 raft_consensus.cc:3060] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:36.883872 26913 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.758s user 0.082s sys 0.132s
W20260928 20:02:36.884187 26913 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.759s user 0.082s sys 0.132s
I20260928 20:02:36.889968 26913 tablet_bootstrap.cc:492] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:36.890522 26913 ts_tablet_manager.cc:1449] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.774s user 0.089s sys 0.132s
I20260928 20:02:36.891167 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet 4c23636443834932852f21092be1d1ac from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:36.891564 27390 raft_consensus.cc:515] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.894387 27279 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 157) took 1117 ms. Trace:
I20260928 20:02:36.896621 27390 leader_election.cc:290] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:36.898756 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4d246ff7bc384944a508f62c7e090eea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:36.898986 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:36.899497 26515 raft_consensus.cc:3060] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:36.900234 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d246ff7bc384944a508f62c7e090eea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:36.905653 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:36.906126 26916 tablet_bootstrap.cc:492] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:36.903381 27279 rpcz_store.cc:276] 0928 20:02:35.777438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:35.777855 (+ 417us) service_pool.cc:224] Handling call
0928 20:02:35.858830 (+ 80975us) ts_tablet_manager.cc:1197] Deleting tablet b22118c942324613837c489142d129fa
0928 20:02:35.858870 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:36.077022 (+218152us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:36.645843 (+568821us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:36.894325 (+248482us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":80340}
I20260928 20:02:36.928146 26912 tablet_bootstrap.cc:654] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.935266 27398 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:36.892966 26913 raft_consensus.cc:359] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.941565 26913 raft_consensus.cc:385] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:36.941924 26913 raft_consensus.cc:740] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:36.942695 26913 consensus_queue.cc:260] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:36.945232 26913 ts_tablet_manager.cc:1480] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.054s user 0.005s sys 0.000s
I20260928 20:02:36.828088 27389 raft_consensus.cc:2749] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:36.946821 26594 leader_election.cc:343] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:36.951001 26913 tablet_bootstrap.cc:492] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:36.918820 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet b22118c942324613837c489142d129fa (table default.Table_08b55d52f8a64fba90ccea539ecd0681 [id=21db6c1a209b49f9b0ea4f7dd7373814]) successfully deleted
W20260928 20:02:36.919615 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 57713.9us
W20260928 20:02:36.952824 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2728c9979bb647a5a8f0a902c299e53d already in progress: creating tablet
W20260928 20:02:36.953604 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 946f215581734bf591ab05502e5ff4a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946f215581734bf591ab05502e5ff4a0 already in progress: creating tablet
I20260928 20:02:36.954551 26916 ts_tablet_manager.cc:1449] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.218s user 0.009s sys 0.002s
W20260928 20:02:36.954876 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 93fb4e1fd0584a42a4de9eab14d5578c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93fb4e1fd0584a42a4de9eab14d5578c already in progress: creating tablet
W20260928 20:02:36.947721 26739 leader_election.cc:343] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: d938ea61370c493585d01a30e7381695
I20260928 20:02:36.924602 26236 master_service.cc:960] ReplaceTablet: received request to replace tablet 2728c9979bb647a5a8f0a902c299e53d from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:36.951138 27011 raft_consensus.cc:2243] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:36.962176 26916 raft_consensus.cc:359] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:36.964422 27011 raft_consensus.cc:2272] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:36.964210 27400 tablet.cc:1751] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:36.957199 26739 leader_election.cc:304] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:36.966696 27011 ts_tablet_manager.cc:1962] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:36.966929 27318 raft_consensus.cc:2749] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:36.975440 26800 raft_consensus.cc:3060] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:36.979619 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:36.983560 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4604b0cf7e56457086383c4314814b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4604b0cf7e56457086383c4314814b21 already in progress: creating tablet
I20260928 20:02:36.984351 27279 tablet_replica.cc:333] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:36.985020 27279 raft_consensus.cc:2243] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:36.985432 27279 raft_consensus.cc:2272] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:36.987005 27279 ts_tablet_manager.cc:1962] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:36.997457 27409 tablet.cc:1751] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:37.017642 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_63e2c04c6cdc43a8a911b566a6ec7a78" } modify_external_catalogs: true
I20260928 20:02:37.018184 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_63e2c04c6cdc43a8a911b566a6ec7a78" } modify_external_catalogs: true
I20260928 20:02:37.018246 26916 raft_consensus.cc:385] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.018579 26916 raft_consensus.cc:740] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.019331 26916 consensus_queue.cc:260] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.021210 26916 ts_tablet_manager.cc:1480] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.066s user 0.005s sys 0.000s
I20260928 20:02:36.947479 27393 tablet.cc:1751] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:36.987324 27408 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:36.927407 26515 raft_consensus.cc:2468] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:37.029439 27346 raft_consensus.cc:493] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.030093 27346 raft_consensus.cc:515] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.032963 27346 leader_election.cc:290] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.035053 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa037333676c4dba93160c5e3337f891" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:37.036525 26450 leader_election.cc:343] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:37.047261 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1284d1f7fa774033b90133447627df4f (table default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1284d1f7fa774033b90133447627df4f consensus state has no leader
I20260928 20:02:37.064009 27411 tablet.cc:1751] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:36.981746 26913 tablet_bootstrap.cc:654] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:36.992865 27390 consensus_queue.cc:1048] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:36.994017 26594 leader_election.cc:343] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.071651 26916 tablet_bootstrap.cc:492] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:37.071918 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 77935.2us
I20260928 20:02:37.074038 26595 leader_election.cc:304] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:37.075352 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 50080.4us
I20260928 20:02:37.076215 27387 raft_consensus.cc:2804] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:37.076839 27387 raft_consensus.cc:697] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:37.079061 27313 raft_consensus.cc:493] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.079589 27359 consensus_queue.cc:1048] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:37.079769 27313 raft_consensus.cc:515] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.083736 27313 leader_election.cc:290] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:37.078052 27387 consensus_queue.cc:237] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.086316 26232 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_deb6452bc7ae40239d21f47b0d123fed" } new_table_name: "default.Table_0db7c57c88674a57b2c4faceaa98eb1e" modify_external_catalogs: true
I20260928 20:02:37.088793 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:37.007025 27400 tablet.cc:1751] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:37.089741 26513 raft_consensus.cc:2468] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:37.037494 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa037333676c4dba93160c5e3337f891" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:37.093294 26450 leader_election.cc:343] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.093786 26450 leader_election.cc:304] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.093618 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_84b84e38b1a343b082d36bca0a4fa27d" } new_table_name: "default.Table_7f99221c4b2141b0bf6f9d399b4225d9" modify_external_catalogs: true
I20260928 20:02:37.095430 27346 raft_consensus.cc:2749] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.097359 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:37.097829 27414 tablet.cc:1751] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:37.104453 26595 leader_election.cc:304] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:37.105222 27389 raft_consensus.cc:2804] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:37.105611 27389 raft_consensus.cc:493] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:37.105933 27389 raft_consensus.cc:3060] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:37.117379 26594 leader_election.cc:343] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.168072 26912 tablet_bootstrap.cc:492] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:37.168655 26912 ts_tablet_manager.cc:1449] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.349s user 0.015s sys 0.004s
I20260928 20:02:37.154520 27011 ts_tablet_manager.cc:1975] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:37.174144 27011 log.cc:1199] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:37.176162 27011 ts_tablet_manager.cc:1996] T c0fd24cd5adf4774a13aeac30315f6f9 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:37.187069 26913 tablet_bootstrap.cc:492] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:37.187776 26913 ts_tablet_manager.cc:1449] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.237s user 0.005s sys 0.008s
I20260928 20:02:37.191864 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet c0fd24cd5adf4774a13aeac30315f6f9 (table default.Table_0dfdabdeae0a4bf1ba4dd59d4bbc98ca [id=11d2d52bae424e51b5379df798890e4f]) successfully deleted
I20260928 20:02:37.223556 26912 raft_consensus.cc:359] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:37.224232 26912 raft_consensus.cc:385] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.224510 26912 raft_consensus.cc:740] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.225347 26912 consensus_queue.cc:260] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:37.236474 26912 ts_tablet_manager.cc:1480] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.067s user 0.004s sys 0.003s
I20260928 20:02:37.242607 26912 tablet_bootstrap.cc:492] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:37.209892 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet c6544b7b405c4831900f37e052892409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6544b7b405c4831900f37e052892409 already in progress: creating tablet
W20260928 20:02:37.271538 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 61677.3us
I20260928 20:02:37.273510 26912 tablet_bootstrap.cc:654] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.283676 26913 raft_consensus.cc:359] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.287398 27279 ts_tablet_manager.cc:1975] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:37.287824 27279 log.cc:1199] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/d938ea61370c493585d01a30e7381695
I20260928 20:02:37.288489 27279 ts_tablet_manager.cc:1996] T d938ea61370c493585d01a30e7381695 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:37.292634 26916 tablet_bootstrap.cc:654] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.300508 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet d938ea61370c493585d01a30e7381695 (table default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]) successfully deleted
W20260928 20:02:37.301204 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet c6544b7b405c4831900f37e052892409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6544b7b405c4831900f37e052892409 already in progress: creating tablet
I20260928 20:02:37.309616 26912 tablet_bootstrap.cc:492] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:37.310145 26912 ts_tablet_manager.cc:1449] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.012s
W20260928 20:02:37.350278 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 54612.2us
I20260928 20:02:37.351835 26912 raft_consensus.cc:359] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.352720 26912 raft_consensus.cc:385] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.352977 26912 raft_consensus.cc:740] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.353734 26912 consensus_queue.cc:260] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.358397 26916 tablet_bootstrap.cc:492] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.358806 26916 ts_tablet_manager.cc:1449] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.287s user 0.006s sys 0.014s
I20260928 20:02:37.359195 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_afc7904735e94895aa832ee117628bac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:37.361256 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afc7904735e94895aa832ee117628bac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:37.363900 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_07eb5136ed464c0b96fe89e451b99913"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:37.364095 26916 raft_consensus.cc:359] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.364804 26916 raft_consensus.cc:385] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.365072 26916 raft_consensus.cc:740] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:02:37.365628 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07eb5136ed464c0b96fe89e451b99913 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:37.366920 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_aea43c3f34b8444484b021f67a963b41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:37.368316 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aea43c3f34b8444484b021f67a963b41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:37.371760 26912 ts_tablet_manager.cc:1480] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.061s user 0.008s sys 0.000s
I20260928 20:02:37.373173 26916 consensus_queue.cc:260] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.382428 26916 ts_tablet_manager.cc:1480] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.023s user 0.005s sys 0.004s
I20260928 20:02:37.383046 26912 tablet_bootstrap.cc:492] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:37.407397 26916 tablet_bootstrap.cc:492] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:37.407565 26912 tablet_bootstrap.cc:654] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.202953 27389 raft_consensus.cc:515] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.416574 27389 leader_election.cc:290] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:37.417161 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:37.417363 26913 raft_consensus.cc:385] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.417690 26516 raft_consensus.cc:3060] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:37.417764 26913 raft_consensus.cc:740] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.418617 26913 consensus_queue.cc:260] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.419212 26916 tablet_bootstrap.cc:654] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.420907 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:37.422465 26594 leader_election.cc:343] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.429867 26516 raft_consensus.cc:2468] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:37.432276 26595 leader_election.cc:304] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:37.432931 26594 consensus_peers.cc:597] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:37.433264 27389 raft_consensus.cc:2804] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:37.436115 26913 ts_tablet_manager.cc:1480] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.248s user 0.003s sys 0.006s
I20260928 20:02:37.437304 26913 tablet_bootstrap.cc:492] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:37.433740 27389 raft_consensus.cc:697] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:37.442512 27389 consensus_queue.cc:237] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.476861 26916 tablet_bootstrap.cc:492] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.477454 26916 ts_tablet_manager.cc:1449] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.070s user 0.013s sys 0.009s
I20260928 20:02:37.480288 26916 raft_consensus.cc:359] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.480875 26916 raft_consensus.cc:385] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.481130 26916 raft_consensus.cc:740] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.481843 26916 consensus_queue.cc:260] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.491504 26916 ts_tablet_manager.cc:1480] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260928 20:02:37.492933 26916 tablet_bootstrap.cc:492] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:37.509878 27318 raft_consensus.cc:493] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.510596 27318 raft_consensus.cc:515] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:37.516024 26916 tablet_bootstrap.cc:654] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:37.516499 26739 leader_election.cc:343] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 03370aeac73549a195a16382aa6f9de3
I20260928 20:02:37.514866 27318 leader_election.cc:290] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:37.523095 26740 leader_election.cc:343] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 03370aeac73549a195a16382aa6f9de3
I20260928 20:02:37.523617 26740 leader_election.cc:304] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:37.527626 26912 tablet_bootstrap.cc:492] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:37.528086 26912 ts_tablet_manager.cc:1449] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.145s user 0.022s sys 0.029s
I20260928 20:02:37.532876 27318 raft_consensus.cc:2749] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:37.544303 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 718a2abfe21b4a2986b77e14e4e52152 consensus state has no leader
W20260928 20:02:37.546969 26232 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a2d13d16d9946c6b09f9197c165033c has no consensus state
I20260928 20:02:37.549028 26916 tablet_bootstrap.cc:492] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.545934 26912 raft_consensus.cc:359] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.549800 26916 ts_tablet_manager.cc:1449] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.057s user 0.006s sys 0.010s
I20260928 20:02:37.549759 26912 raft_consensus.cc:385] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.550035 26912 raft_consensus.cc:740] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.550734 26912 consensus_queue.cc:260] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.553544 26916 raft_consensus.cc:359] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.554275 26916 raft_consensus.cc:385] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.554540 26916 raft_consensus.cc:740] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.554939 26234 master_service.cc:960] ReplaceTablet: received request to replace tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:37.560169 26916 consensus_queue.cc:260] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.563766 26916 ts_tablet_manager.cc:1480] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20260928 20:02:37.565510 26916 tablet_bootstrap.cc:492] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:37.568893 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_66eb05ddc1544e35baad1ae4cd242da2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:37.570910 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66eb05ddc1544e35baad1ae4cd242da2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:37.567601 26912 ts_tablet_manager.cc:1480] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260928 20:02:37.577090 26916 tablet_bootstrap.cc:654] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.580278 26912 tablet_bootstrap.cc:492] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:37.592924 26916 tablet_bootstrap.cc:492] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.593384 26916 ts_tablet_manager.cc:1449] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.007s
I20260928 20:02:37.596120 26916 raft_consensus.cc:359] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.596716 26916 raft_consensus.cc:385] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.596572 27389 consensus_queue.cc:1048] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:37.596959 26916 raft_consensus.cc:740] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.597532 26916 consensus_queue.cc:260] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.605436 26916 ts_tablet_manager.cc:1480] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.003s sys 0.004s
W20260928 20:02:37.606093 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 66) took 844 ms (client timeout 1000 ms). Trace:
I20260928 20:02:37.606389 26916 tablet_bootstrap.cc:492] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:37.606454 26233 rpcz_store.cc:269] 0928 20:02:36.761839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:36.765355 (+ 3516us) service_pool.cc:224] Handling call
0928 20:02:37.606023 (+840668us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260928 20:02:37.612224 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 (DEFAULT_TABLE table=default.Table_ba39b68fc8f040688126ae288d501ac3 [id=5f40398fa88449218e7d77ef265d2e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.613440 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385278bf2df34f4f960a0cfdebd79be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.616511 26912 tablet_bootstrap.cc:654] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.621011 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 (DEFAULT_TABLE table=default.Table_ba39b68fc8f040688126ae288d501ac3 [id=5f40398fa88449218e7d77ef265d2e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.622059 26916 tablet_bootstrap.cc:654] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.622462 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385278bf2df34f4f960a0cfdebd79be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.629902 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 (DEFAULT_TABLE table=default.Table_ba39b68fc8f040688126ae288d501ac3 [id=5f40398fa88449218e7d77ef265d2e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.630704 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 7e86d2d680c545e0b0511dec35ba6c9a (DEFAULT_TABLE table=default.Table_6ec1e12c8d3f4b0495f644ddc8ba7ad9 [id=327206ba45a84f26afeea20f363595af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.631011 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385278bf2df34f4f960a0cfdebd79be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.631760 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e86d2d680c545e0b0511dec35ba6c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.640226 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 7e86d2d680c545e0b0511dec35ba6c9a (DEFAULT_TABLE table=default.Table_6ec1e12c8d3f4b0495f644ddc8ba7ad9 [id=327206ba45a84f26afeea20f363595af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.641341 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e86d2d680c545e0b0511dec35ba6c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.643049 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 7e86d2d680c545e0b0511dec35ba6c9a (DEFAULT_TABLE table=default.Table_6ec1e12c8d3f4b0495f644ddc8ba7ad9 [id=327206ba45a84f26afeea20f363595af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.644140 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e86d2d680c545e0b0511dec35ba6c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.686474 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 4433b79132934b48a3f2dd089592fcaf (DEFAULT_TABLE table=default.Table_101a375ee5e84e1aa7e611fc10883e70 [id=b8d510931aff47298bc0ae12b984ac8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.687777 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4433b79132934b48a3f2dd089592fcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.698290 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 4433b79132934b48a3f2dd089592fcaf (DEFAULT_TABLE table=default.Table_101a375ee5e84e1aa7e611fc10883e70 [id=b8d510931aff47298bc0ae12b984ac8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.699558 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4433b79132934b48a3f2dd089592fcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.709280 26489 tablet_service.cc:1511] Processing CreateTablet for tablet 4433b79132934b48a3f2dd089592fcaf (DEFAULT_TABLE table=default.Table_101a375ee5e84e1aa7e611fc10883e70 [id=b8d510931aff47298bc0ae12b984ac8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.710439 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4433b79132934b48a3f2dd089592fcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.712617 27393 tablet.cc:1751] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:37.714414 26638 tablet_service.cc:1511] Processing CreateTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 (DEFAULT_TABLE table=default.Table_82491753b5fc4f5290c7b0ffaef58075 [id=eb753b0a4a1e415b8b002953ec65c0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.715394 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.718901 26487 tablet_service.cc:1511] Processing CreateTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 (DEFAULT_TABLE table=default.Table_82491753b5fc4f5290c7b0ffaef58075 [id=eb753b0a4a1e415b8b002953ec65c0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.720000 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.721253 26913 tablet_bootstrap.cc:654] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.722250 27265 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.722676 27265 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.724733 27265 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.725286 26774 tablet_service.cc:1511] Processing CreateTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 (DEFAULT_TABLE table=default.Table_82491753b5fc4f5290c7b0ffaef58075 [id=eb753b0a4a1e415b8b002953ec65c0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.726608 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.727290 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:37.729364 26450 leader_election.cc:343] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.730852 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:37.732950 26450 leader_election.cc:343] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.733330 26450 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.734318 27265 raft_consensus.cc:2749] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.744238 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd2204d99e14a07af962295b152d60f (DEFAULT_TABLE table=default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.745301 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd2204d99e14a07af962295b152d60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.751143 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5e0b70bfe04843ab9cfdb7a2dc3846f5" } new_table_name: "default.Table_4633f47f18b74a04b0ab07132b8f7c4c" modify_external_catalogs: true
I20260928 20:02:37.755143 26912 tablet_bootstrap.cc:492] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:37.755641 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab" } new_table_name: "default.Table_88a3630ba1604375aba3e2ef7f7c1003" modify_external_catalogs: true
I20260928 20:02:37.760046 26912 ts_tablet_manager.cc:1449] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.012s
I20260928 20:02:37.762352 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd2204d99e14a07af962295b152d60f (DEFAULT_TABLE table=default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.762441 26912 raft_consensus.cc:359] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.763041 26912 raft_consensus.cc:385] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.763321 26912 raft_consensus.cc:740] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.763592 26492 tablet_service.cc:1511] Processing CreateTablet for tablet b94aed8337bb4b20b7977e91640c6710 (DEFAULT_TABLE table=default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab [id=80962b238d944b279991bb38e31ffddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.763998 26912 consensus_queue.cc:260] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.764802 27318 raft_consensus.cc:493] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.765237 27318 raft_consensus.cc:515] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.766228 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94aed8337bb4b20b7977e91640c6710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.767241 27318 leader_election.cc:290] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.767814 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd2204d99e14a07af962295b152d60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.769125 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:37.771721 26594 consensus_peers.cc:597] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:37.773212 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:37.774986 26740 leader_election.cc:304] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:37.775942 27318 raft_consensus.cc:2749] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.780747 26784 tablet_service.cc:1511] Processing CreateTablet for tablet b94aed8337bb4b20b7977e91640c6710 (DEFAULT_TABLE table=default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab [id=80962b238d944b279991bb38e31ffddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.782063 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94aed8337bb4b20b7977e91640c6710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.788486 27387 raft_consensus.cc:493] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.788424 26776 tablet_service.cc:1511] Processing CreateTablet for tablet bba200d6ef33438187dd643fe3ded009 (DEFAULT_TABLE table=default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.788901 27387 raft_consensus.cc:515] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.789386 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba200d6ef33438187dd643fe3ded009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.790871 27387 leader_election.cc:290] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:37.792475 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:37.793370 26916 tablet_bootstrap.cc:492] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.793769 26916 ts_tablet_manager.cc:1449] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.188s user 0.025s sys 0.035s
W20260928 20:02:37.793776 26594 leader_election.cc:343] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.796530 26916 raft_consensus.cc:359] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.797168 26916 raft_consensus.cc:385] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.797417 26916 raft_consensus.cc:740] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.798169 26916 consensus_queue.cc:260] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.799688 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd2204d99e14a07af962295b152d60f (DEFAULT_TABLE table=default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.800065 26916 ts_tablet_manager.cc:1480] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260928 20:02:37.800137 26635 tablet_service.cc:1511] Processing CreateTablet for tablet b94aed8337bb4b20b7977e91640c6710 (DEFAULT_TABLE table=default.Table_2a0aae5ffebe40a9b55eec5bb82d93ab [id=80962b238d944b279991bb38e31ffddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.800709 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd2204d99e14a07af962295b152d60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.801280 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94aed8337bb4b20b7977e91640c6710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.807083 26916 tablet_bootstrap.cc:492] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:37.810925 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 6c37ee6dd0e14f038c557985ab4c5b0b (DEFAULT_TABLE table=default.Table_66b4fb7dfd10446d99fa01b7f3b019ec [id=639bd5507dc14745860aadffb4b7c94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.812032 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c37ee6dd0e14f038c557985ab4c5b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.812124 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:37.812403 26633 tablet_service.cc:1511] Processing CreateTablet for tablet bba200d6ef33438187dd643fe3ded009 (DEFAULT_TABLE table=default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.812747 26515 raft_consensus.cc:2468] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:37.813374 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba200d6ef33438187dd643fe3ded009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.813987 26595 leader_election.cc:304] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.814855 26489 tablet_service.cc:1511] Processing CreateTablet for tablet bba200d6ef33438187dd643fe3ded009 (DEFAULT_TABLE table=default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.818291 27387 raft_consensus.cc:2804] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:37.818605 27387 raft_consensus.cc:493] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:37.818883 27387 raft_consensus.cc:3060] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:37.830534 27387 raft_consensus.cc:515] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.833205 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:37.833325 27387 leader_election.cc:290] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:37.834353 27436 tablet.cc:1751] T caf030c329e64d208a3f507804edbd54 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:37.834692 26594 leader_election.cc:343] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.835436 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:37.835999 26515 raft_consensus.cc:3060] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:37.836571 26916 tablet_bootstrap.cc:654] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.858916 26916 tablet_bootstrap.cc:492] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.859506 26916 ts_tablet_manager.cc:1449] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.004s
I20260928 20:02:37.862668 26916 raft_consensus.cc:359] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.863359 26916 raft_consensus.cc:385] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.865036 26913 tablet_bootstrap.cc:492] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:37.865500 26913 ts_tablet_manager.cc:1449] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.429s user 0.003s sys 0.009s
I20260928 20:02:37.863615 26916 raft_consensus.cc:740] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.867605 26916 consensus_queue.cc:260] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.871042 27387 consensus_queue.cc:1048] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:37.872098 26912 ts_tablet_manager.cc:1480] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.112s user 0.001s sys 0.004s
I20260928 20:02:37.873903 26916 ts_tablet_manager.cc:1480] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.003s sys 0.002s
I20260928 20:02:37.874924 26912 tablet_bootstrap.cc:492] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:37.877357 27265 raft_consensus.cc:493] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.878096 27265 raft_consensus.cc:515] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.880076 27265 leader_election.cc:290] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.880038 27318 raft_consensus.cc:493] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.880466 27318 raft_consensus.cc:515] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.881359 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8163815661694d70ba4c2e36a424eaa1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:37.876641 26913 raft_consensus.cc:359] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.881901 26913 raft_consensus.cc:385] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.882193 26913 raft_consensus.cc:740] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:37.882479 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8163815661694d70ba4c2e36a424eaa1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:37.883680 26450 leader_election.cc:343] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:37.884629 26450 leader_election.cc:343] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.884961 26450 leader_election.cc:304] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.885838 27265 raft_consensus.cc:2749] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.882802 26913 consensus_queue.cc:260] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.892789 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba200d6ef33438187dd643fe3ded009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.893286 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 6c37ee6dd0e14f038c557985ab4c5b0b (DEFAULT_TABLE table=default.Table_66b4fb7dfd10446d99fa01b7f3b019ec [id=639bd5507dc14745860aadffb4b7c94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.893693 26913 ts_tablet_manager.cc:1480] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260928 20:02:37.894603 26913 tablet_bootstrap.cc:492] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:37.897943 27318 leader_election.cc:290] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:37.899176 26739 leader_election.cc:343] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: d374d592fda8402faac70a923049c9ad
I20260928 20:02:37.901696 26913 tablet_bootstrap.cc:654] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.911897 27265 raft_consensus.cc:493] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.912379 27265 raft_consensus.cc:515] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.914423 27265 leader_election.cc:290] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.915951 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:37.917049 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:37.918310 26450 leader_election.cc:343] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:37.918920 26450 leader_election.cc:343] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.919279 26450 leader_election.cc:304] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.920315 27265 raft_consensus.cc:2749] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.924477 27265 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.925237 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c37ee6dd0e14f038c557985ab4c5b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.928256 26916 tablet_bootstrap.cc:492] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:37.932440 26740 leader_election.cc:343] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d374d592fda8402faac70a923049c9ad
I20260928 20:02:37.932863 26740 leader_election.cc:304] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:37.933820 27318 raft_consensus.cc:2749] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.935089 26916 tablet_bootstrap.cc:654] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.935231 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 6c37ee6dd0e14f038c557985ab4c5b0b (DEFAULT_TABLE table=default.Table_66b4fb7dfd10446d99fa01b7f3b019ec [id=639bd5507dc14745860aadffb4b7c94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.936678 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c37ee6dd0e14f038c557985ab4c5b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.924903 27265 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:37.940804 27265 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.941946 27265 raft_consensus.cc:493] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:37.942607 27265 raft_consensus.cc:515] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:37.943107 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:37.943145 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:37.945401 26450 leader_election.cc:343] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.945660 27387 consensus_queue.cc:1048] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:37.946853 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "946f215581734bf591ab05502e5ff4a0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:37.947571 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "946f215581734bf591ab05502e5ff4a0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:37.945961 26450 leader_election.cc:343] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.950219 26450 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.944252 27265 leader_election.cc:290] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:37.952620 27265 raft_consensus.cc:2749] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:37.953336 26450 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:37.954293 26450 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:37.954667 26450 leader_election.cc:304] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:37.957326 26912 tablet_bootstrap.cc:654] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:37.961053 27442 raft_consensus.cc:2749] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:37.974023 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 01533b61bad74ddb9056aeacef13a126 (DEFAULT_TABLE table=default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:37.975234 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01533b61bad74ddb9056aeacef13a126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:37.976909 26916 tablet_bootstrap.cc:492] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:37.977300 26916 ts_tablet_manager.cc:1449] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.005s
I20260928 20:02:37.984550 26515 raft_consensus.cc:2468] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:37.994356 26916 raft_consensus.cc:359] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:37.995805 26916 raft_consensus.cc:385] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:37.996058 26916 raft_consensus.cc:740] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.002400 26916 consensus_queue.cc:260] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:38.005278 26912 tablet_bootstrap.cc:492] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:38.005692 26912 ts_tablet_manager.cc:1449] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.131s user 0.008s sys 0.001s
I20260928 20:02:38.007946 26912 raft_consensus.cc:359] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.008615 26912 raft_consensus.cc:385] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.008909 26912 raft_consensus.cc:740] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.009440 26912 consensus_queue.cc:260] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.023313 26916 ts_tablet_manager.cc:1480] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.046s user 0.007s sys 0.000s
I20260928 20:02:38.024762 26912 ts_tablet_manager.cc:1480] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20260928 20:02:38.025662 26912 tablet_bootstrap.cc:492] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:38.050691 26912 tablet_bootstrap.cc:654] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.052354 26916 tablet_bootstrap.cc:492] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:38.057802 26916 tablet_bootstrap.cc:654] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.058257 26489 tablet_service.cc:1511] Processing CreateTablet for tablet 01533b61bad74ddb9056aeacef13a126 (DEFAULT_TABLE table=default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.059324 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01533b61bad74ddb9056aeacef13a126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.074322 26912 tablet_bootstrap.cc:492] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:38.074899 26912 ts_tablet_manager.cc:1449] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.049s user 0.008s sys 0.004s
I20260928 20:02:38.088650 26913 tablet_bootstrap.cc:492] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:38.089097 26913 ts_tablet_manager.cc:1449] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.195s user 0.016s sys 0.022s
W20260928 20:02:38.096562 26594 consensus_peers.cc:597] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:38.099404 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 104438us
I20260928 20:02:38.100207 26595 leader_election.cc:304] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:38.101444 27384 raft_consensus.cc:2804] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:38.101855 27384 raft_consensus.cc:697] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:38.102610 27384 consensus_queue.cc:237] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.107964 27440 raft_consensus.cc:493] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.108390 27440 raft_consensus.cc:515] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.110276 27440 leader_election.cc:290] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:38.115340 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:38.115406 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:38.117461 26450 leader_election.cc:343] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:38.118013 26450 leader_election.cc:343] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.118347 26450 leader_election.cc:304] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:38.118939 27440 raft_consensus.cc:2749] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.119681 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 01533b61bad74ddb9056aeacef13a126 (DEFAULT_TABLE table=default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.121556 26913 raft_consensus.cc:359] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:38.122359 26913 raft_consensus.cc:385] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.122617 26913 raft_consensus.cc:740] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.123971 26916 tablet_bootstrap.cc:492] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:38.124436 26916 ts_tablet_manager.cc:1449] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.072s user 0.010s sys 0.001s
I20260928 20:02:38.126965 26916 raft_consensus.cc:359] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.127743 26916 raft_consensus.cc:385] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.128057 26916 raft_consensus.cc:740] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.128847 26916 consensus_queue.cc:260] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.131234 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01533b61bad74ddb9056aeacef13a126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.136886 26492 tablet_service.cc:1511] Processing CreateTablet for tablet e3e86ccb8c334a54b42913bd5f405942 (DEFAULT_TABLE table=default.Table_ff6225f056a84389992b4f66f946fb3e [id=3749b65af21b404e8a638dfc03035266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.138337 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e86ccb8c334a54b42913bd5f405942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.140625 26913 consensus_queue.cc:260] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:38.147596 26913 ts_tablet_manager.cc:1480] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.058s user 0.007s sys 0.000s
I20260928 20:02:38.149537 26916 ts_tablet_manager.cc:1480] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260928 20:02:38.149857 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6
I20260928 20:02:38.151396 26234 catalog_manager.cc:6934] ReplaceTablet: tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 deleted and replaced by tablet d479a8eabc624569968515684e8acb0c
I20260928 20:02:38.077630 26912 raft_consensus.cc:359] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:38.154227 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 0a2d13d16d9946c6b09f9197c165033c (table default.Table_0db7c57c88674a57b2c4faceaa98eb1e [id=17447ae0353e48e3b1fb75ff64ada358], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0a2d13d16d9946c6b09f9197c165033c has no consensus state
I20260928 20:02:38.154402 26912 raft_consensus.cc:385] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.154724 26912 raft_consensus.cc:740] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.155421 26912 consensus_queue.cc:260] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:38.156113 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:38.157374 26913 tablet_bootstrap.cc:492] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:38.157485 26912 ts_tablet_manager.cc:1480] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.082s user 0.004s sys 0.000s
I20260928 20:02:38.157267 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]). Expected version 1 got 0
I20260928 20:02:38.162127 26231 catalog_manager.cc:5838] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:38.160614 26916 tablet_bootstrap.cc:492] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:38.160943 27445 raft_consensus.cc:493] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.170535 27445 raft_consensus.cc:515] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:38.172019 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:38.173318 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70df4ddf0f9430980c967d798ed6c50" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:38.174911 26450 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.176450 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:38.177606 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70df4ddf0f9430980c967d798ed6c50" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:38.179171 26450 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.179476 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 1edf314241784091a603907a43429b28
I20260928 20:02:38.179576 26450 leader_election.cc:304] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:38.180255 27440 raft_consensus.cc:2749] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.180812 26229 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 246) took 1180 ms. Trace:
I20260928 20:02:38.181500 27445 leader_election.cc:290] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:38.185532 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:38.181136 26229 rpcz_store.cc:276] 0928 20:02:37.000664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:37.000785 (+ 121us) service_pool.cc:224] Handling call
0928 20:02:37.017548 (+ 16763us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:37.018578 (+ 1030us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:37.019044 (+ 466us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:37.019169 (+ 125us) catalog_manager.cc:2863] Locking tablets
0928 20:02:37.599496 (+580327us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:38.179139 (+579643us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:38.179318 (+ 179us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:38.179401 (+ 83us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:38.180754 (+ 1353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:37.601421 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:37.601808 (+ 387us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:37.601831 (+ 23us) write_op.cc:435] Acquired schema lock
0928 20:02:37.601842 (+ 11us) tablet.cc:662] Decoding operations
0928 20:02:37.602167 (+ 325us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:37.602207 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:37.602231 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:37.602495 (+ 264us) tablet.cc:701] Row locks acquired
0928 20:02:37.602508 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:37.602618 (+ 110us) write_op.cc:270] Start()
0928 20:02:37.602701 (+ 83us) write_op.cc:276] Timestamp: P: 1790625757602579 usec, L: 0
0928 20:02:37.602717 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:37.603159 (+ 442us) log.cc:844] Serialized 734 byte log entry
0928 20:02:38.177652 (+574493us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.177860 (+ 208us) write_op.cc:301] APPLY: starting
0928 20:02:38.177911 (+ 51us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.178024 (+ 113us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.178130 (+ 106us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.178348 (+ 218us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.178484 (+ 136us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:38.178526 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:38.178696 (+ 170us) log.cc:844] Serialized 29 byte log entry
0928 20:02:38.178840 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.178902 (+ 62us) write_op.cc:454] Released schema lock
0928 20:02:38.178948 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":36916096,"child_traces":[["op",{"apply.queue_time_us":82,"apply.run_cpu_time_us":1335,"apply.run_wall_time_us":4473,"num_ops":2,"prepare.queue_time_us":140,"prepare.run_cpu_time_us":1933,"prepare.run_wall_time_us":2980,"replication_time_us":574844}]]}
I20260928 20:02:38.190397 26912 tablet_bootstrap.cc:492] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:38.190551 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:38.197552 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:38.197930 26916 tablet_bootstrap.cc:654] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.199016 26784 tablet_service.cc:1511] Processing CreateTablet for tablet e3e86ccb8c334a54b42913bd5f405942 (DEFAULT_TABLE table=default.Table_ff6225f056a84389992b4f66f946fb3e [id=3749b65af21b404e8a638dfc03035266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.214715 26635 tablet_service.cc:1511] Processing CreateTablet for tablet e3e86ccb8c334a54b42913bd5f405942 (DEFAULT_TABLE table=default.Table_ff6225f056a84389992b4f66f946fb3e [id=3749b65af21b404e8a638dfc03035266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.215806 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e86ccb8c334a54b42913bd5f405942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.217996 26916 tablet_bootstrap.cc:492] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:38.218477 26916 ts_tablet_manager.cc:1449] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.000s
I20260928 20:02:38.221673 26916 raft_consensus.cc:359] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.222285 26916 raft_consensus.cc:385] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.222535 26916 raft_consensus.cc:740] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.223220 26916 consensus_queue.cc:260] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.225009 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 385278bf2df34f4f960a0cfdebd79be5
I20260928 20:02:38.226614 26230 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 235) took 1716 ms. Trace:
I20260928 20:02:38.228521 26916 ts_tablet_manager.cc:1480] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260928 20:02:38.229205 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4c23636443834932852f21092be1d1ac
I20260928 20:02:38.226897 26230 rpcz_store.cc:276] 0928 20:02:36.510432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:36.510686 (+ 254us) service_pool.cc:224] Handling call
0928 20:02:36.580513 (+ 69827us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:36.630931 (+ 50418us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:36.641441 (+ 10510us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:36.641549 (+ 108us) catalog_manager.cc:2863] Locking tablets
0928 20:02:37.600481 (+958932us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:38.224622 (+624141us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:38.224843 (+ 221us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:38.224930 (+ 87us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:38.226562 (+ 1632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:37.604521 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:37.604870 (+ 349us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:37.604893 (+ 23us) write_op.cc:435] Acquired schema lock
0928 20:02:37.604905 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:37.605202 (+ 297us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:37.605238 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:37.605262 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:37.605552 (+ 290us) tablet.cc:701] Row locks acquired
0928 20:02:37.605564 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:37.605664 (+ 100us) write_op.cc:270] Start()
0928 20:02:37.605740 (+ 76us) write_op.cc:276] Timestamp: P: 1790625757605628 usec, L: 0
0928 20:02:37.605757 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:37.606265 (+ 508us) log.cc:844] Serialized 734 byte log entry
0928 20:02:38.212340 (+606075us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.222543 (+ 10203us) write_op.cc:301] APPLY: starting
0928 20:02:38.222608 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.222716 (+ 108us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.222869 (+ 153us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.223112 (+ 243us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.223243 (+ 131us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:38.223288 (+ 45us) write_op.cc:312] APPLY: finished
0928 20:02:38.223467 (+ 179us) log.cc:844] Serialized 29 byte log entry
0928 20:02:38.224271 (+ 804us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.224360 (+ 89us) write_op.cc:454] Released schema lock
0928 20:02:38.224406 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":156544256,"child_traces":[["op",{"apply.queue_time_us":9977,"apply.run_cpu_time_us":1436,"apply.run_wall_time_us":2129,"num_ops":2,"prepare.queue_time_us":2515,"prepare.run_cpu_time_us":1935,"prepare.run_wall_time_us":2937,"replication_time_us":606466}]]}
I20260928 20:02:38.230466 26235 catalog_manager.cc:6934] ReplaceTablet: tablet 4c23636443834932852f21092be1d1ac deleted and replaced by tablet 1d945be7bea449ba8c5541b60eb18334
I20260928 20:02:38.230794 26235 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 244) took 1341 ms. Trace:
I20260928 20:02:38.233160 26916 tablet_bootstrap.cc:492] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:38.231073 26235 rpcz_store.cc:276] 0928 20:02:36.889373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:36.891053 (+ 1680us) service_pool.cc:224] Handling call
0928 20:02:38.230745 (+1339692us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:37.607565 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:37.607929 (+ 364us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:37.607952 (+ 23us) write_op.cc:435] Acquired schema lock
0928 20:02:37.607965 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:37.608234 (+ 269us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:37.608269 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:37.608289 (+ 20us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:37.608471 (+ 182us) tablet.cc:701] Row locks acquired
0928 20:02:37.608483 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:37.608583 (+ 100us) write_op.cc:270] Start()
0928 20:02:37.608658 (+ 75us) write_op.cc:276] Timestamp: P: 1790625757608549 usec, L: 0
0928 20:02:37.608672 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:37.609104 (+ 432us) log.cc:844] Serialized 631 byte log entry
0928 20:02:38.225134 (+616030us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.225364 (+ 230us) write_op.cc:301] APPLY: starting
0928 20:02:38.225413 (+ 49us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.225504 (+ 91us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.225605 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.225919 (+ 314us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.226192 (+ 273us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:38.226232 (+ 40us) write_op.cc:312] APPLY: finished
0928 20:02:38.226395 (+ 163us) log.cc:844] Serialized 29 byte log entry
0928 20:02:38.228599 (+ 2204us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.228662 (+ 63us) write_op.cc:454] Released schema lock
0928 20:02:38.228692 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":82,"num_ops":2,"prepare.queue_time_us":3343,"prepare.run_cpu_time_us":1721,"prepare.run_wall_time_us":2715,"replication_time_us":616375}]]}
I20260928 20:02:38.236245 26488 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:38.239356 26916 tablet_bootstrap.cc:654] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.201046 26912 tablet_bootstrap.cc:654] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.203999 27318 raft_consensus.cc:493] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.239972 27318 raft_consensus.cc:515] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.241238 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e86ccb8c334a54b42913bd5f405942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.228222 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:38.232718 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:38.242024 27318 leader_election.cc:290] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:38.243801 26913 tablet_bootstrap.cc:654] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.236245 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:38.250038 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:38.250557 26740 leader_election.cc:343] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: cb970d91179e48cdbbb1e32a3ca3171c
W20260928 20:02:38.260561 26739 leader_election.cc:343] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:38.261143 26739 leader_election.cc:304] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:38.262480 27318 raft_consensus.cc:2749] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.268354 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:38.268985 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:38.271152 27389 consensus_queue.cc:1048] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:38.268929 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:38.276021 26912 tablet_bootstrap.cc:492] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:38.276542 26912 ts_tablet_manager.cc:1449] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.011s
I20260928 20:02:38.277872 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3a07cad7ccd24a988d6700cc9bca9ec2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:38.279624 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a07cad7ccd24a988d6700cc9bca9ec2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.279490 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_cc62772283e74f1f82b9c82db3fdd7e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:38.279572 26912 raft_consensus.cc:359] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.280164 26912 raft_consensus.cc:385] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.280403 26912 raft_consensus.cc:740] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:38.280910 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.280974 26912 consensus_queue.cc:260] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.283581 26913 tablet_bootstrap.cc:492] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:38.283986 26913 ts_tablet_manager.cc:1449] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.127s user 0.006s sys 0.005s
I20260928 20:02:38.286552 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_5b3bc03525cd48b7b3c9e4323c0206dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:38.288102 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b3bc03525cd48b7b3c9e4323c0206dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.288405 26913 raft_consensus.cc:359] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.289011 26913 raft_consensus.cc:385] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.289253 26913 raft_consensus.cc:740] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.271195 27457 tablet_replica.cc:333] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:38.290685 27457 raft_consensus.cc:2243] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:38.291549 27457 raft_consensus.cc:2272] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:38.292269 26913 consensus_queue.cc:260] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.296715 26913 ts_tablet_manager.cc:1480] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.012s user 0.004s sys 0.003s
I20260928 20:02:38.297545 26913 tablet_bootstrap.cc:492] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:38.302206 27452 tablet_replica.cc:333] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:38.304296 27453 tablet_replica.cc:333] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:38.304531 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 1edf314241784091a603907a43429b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1edf314241784091a603907a43429b28 already in progress: creating tablet
I20260928 20:02:38.305102 27453 raft_consensus.cc:2243] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:38.305698 27453 raft_consensus.cc:2272] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:38.308040 26913 tablet_bootstrap.cc:654] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.310209 27389 raft_consensus.cc:493] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.310621 27389 raft_consensus.cc:515] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:38.312390 27389 leader_election.cc:290] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:38.313429 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afceff93f6f9401f94bab3e376925d12" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.313812 26912 ts_tablet_manager.cc:1480] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.037s user 0.008s sys 0.000s
I20260928 20:02:38.313584 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba5d2cc979241c4918a154f25dcd305 (DEFAULT_TABLE table=default.Table_07b83969683b44e6a8cfc75d770cd0be [id=e7207699bc354c2fa79e9c58574cddd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.314216 26777 tablet_service.cc:1511] Processing CreateTablet for tablet f478cce587a548e1aab620721c3bb1c1 (DEFAULT_TABLE table=default.Table_2a5441b3341b4a598fabc7fadafde28a [id=0fefcb948cb44c7e8ea026076b0bfccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.314675 26912 tablet_bootstrap.cc:492] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:38.314677 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba5d2cc979241c4918a154f25dcd305 (DEFAULT_TABLE table=default.Table_07b83969683b44e6a8cfc75d770cd0be [id=e7207699bc354c2fa79e9c58574cddd1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:38.314890 26594 leader_election.cc:343] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.315160 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cce587a548e1aab620721c3bb1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.315658 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba5d2cc979241c4918a154f25dcd305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.326709 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba5d2cc979241c4918a154f25dcd305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.327118 27445 raft_consensus.cc:493] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.327759 27445 raft_consensus.cc:515] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.329809 27445 leader_election.cc:290] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:38.331183 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.333844 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:38.335268 26450 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:38.336925 26450 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.337275 26450 leader_election.cc:304] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:38.338186 27445 raft_consensus.cc:2749] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.342799 26913 tablet_bootstrap.cc:492] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:38.343219 26913 ts_tablet_manager.cc:1449] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.000s
I20260928 20:02:38.345083 26912 tablet_bootstrap.cc:654] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.346794 26916 tablet_bootstrap.cc:492] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:38.352911 26916 ts_tablet_manager.cc:1449] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.120s user 0.012s sys 0.001s
I20260928 20:02:38.355446 26916 raft_consensus.cc:359] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.356156 26916 raft_consensus.cc:385] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.356427 26916 raft_consensus.cc:740] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.359292 26913 raft_consensus.cc:359] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.360630 26916 consensus_queue.cc:260] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.375845 26916 ts_tablet_manager.cc:1480] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260928 20:02:38.359995 26913 raft_consensus.cc:385] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.386206 26916 tablet_bootstrap.cc:492] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:38.386770 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b94aed8337bb4b20b7977e91640c6710 consensus state has no leader
I20260928 20:02:38.382368 26913 raft_consensus.cc:740] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.390786 26913 consensus_queue.cc:260] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.393586 26913 ts_tablet_manager.cc:1480] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20260928 20:02:38.395992 26913 tablet_bootstrap.cc:492] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:38.396350 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef3e590ceb1345da99e67e5fa627fa9f consensus state has no leader
W20260928 20:02:38.398892 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 90533.4us
I20260928 20:02:38.401939 27452 raft_consensus.cc:2243] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:38.404027 26916 tablet_bootstrap.cc:654] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.414606 27452 raft_consensus.cc:2272] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:38.423455 27445 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.423995 27445 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:38.425612 26595 leader_election.cc:343] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: afceff93f6f9401f94bab3e376925d12
I20260928 20:02:38.425978 27445 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:38.433774 26916 tablet_bootstrap.cc:492] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:38.434442 26916 ts_tablet_manager.cc:1449] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.000s
I20260928 20:02:38.435410 26227 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_de419094fd8a4aa5b9ff973562f7f89b" } modify_external_catalogs: true
I20260928 20:02:38.435943 26227 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_de419094fd8a4aa5b9ff973562f7f89b" } modify_external_catalogs: true
I20260928 20:02:38.437953 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_2721556696834890a816325ba8ace11f" } modify_external_catalogs: true
I20260928 20:02:38.438484 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_2721556696834890a816325ba8ace11f" } modify_external_catalogs: true
I20260928 20:02:38.452730 27453 ts_tablet_manager.cc:1962] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:38.437917 26916 raft_consensus.cc:359] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.453155 26916 raft_consensus.cc:385] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.456393 26916 raft_consensus.cc:740] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.457701 26916 consensus_queue.cc:260] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.462931 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 41ac9772778c4fe8afc272f98eee2999 (DEFAULT_TABLE table=default.Table_d7d359f62a71495f99580370aacdbff7 [id=986f7e8be10e4f70930a513613b3731f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.467192 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.468425 26803 raft_consensus.cc:3060] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:38.479413 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ac9772778c4fe8afc272f98eee2999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.487486 26912 tablet_bootstrap.cc:492] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
W20260928 20:02:38.487592 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 48) took 1525 ms (client timeout 1000 ms). Trace:
I20260928 20:02:38.487911 26912 ts_tablet_manager.cc:1449] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.173s user 0.021s sys 0.002s
I20260928 20:02:38.490304 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:38.491323 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:38.500967 26234 catalog_manager.cc:5838] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:38.503058 26912 raft_consensus.cc:359] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.503674 26912 raft_consensus.cc:385] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.503901 26912 raft_consensus.cc:740] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.504914 27452 ts_tablet_manager.cc:1962] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:38.509505 26912 consensus_queue.cc:260] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.511449 26912 ts_tablet_manager.cc:1480] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260928 20:02:38.512341 26912 tablet_bootstrap.cc:492] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:38.426007 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba5d2cc979241c4918a154f25dcd305 (DEFAULT_TABLE table=default.Table_07b83969683b44e6a8cfc75d770cd0be [id=e7207699bc354c2fa79e9c58574cddd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.427628 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:38.429261 26913 tablet_bootstrap.cc:654] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.515041 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba5d2cc979241c4918a154f25dcd305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.517948 26912 tablet_bootstrap.cc:654] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.469184 27457 ts_tablet_manager.cc:1962] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:38.526643 26595 leader_election.cc:304] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:38.529667 27389 raft_consensus.cc:2749] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.503340 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:38.535050 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
W20260928 20:02:38.529824 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 104240us
W20260928 20:02:38.478609 26450 leader_election.cc:343] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.547559 26916 ts_tablet_manager.cc:1480] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.113s user 0.008s sys 0.000s
I20260928 20:02:38.553658 26234 catalog_manager.cc:5838] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:38.558799 26631 tablet_service.cc:1511] Processing CreateTablet for tablet f478cce587a548e1aab620721c3bb1c1 (DEFAULT_TABLE table=default.Table_2a5441b3341b4a598fabc7fadafde28a [id=0fefcb948cb44c7e8ea026076b0bfccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.559115 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 41ac9772778c4fe8afc272f98eee2999 (DEFAULT_TABLE table=default.Table_d7d359f62a71495f99580370aacdbff7 [id=986f7e8be10e4f70930a513613b3731f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.559748 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cce587a548e1aab620721c3bb1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.560326 26800 raft_consensus.cc:3060] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:38.568727 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ac9772778c4fe8afc272f98eee2999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.566001 27472 tablet.cc:1751] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:38.579233 27359 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.579670 27359 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.581461 27359 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:38.593041 27359 consensus_queue.cc:1048] T 756342f2b9a245c89ad8dbc6089b71d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:38.610301 26913 tablet_bootstrap.cc:492] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:38.610749 26913 ts_tablet_manager.cc:1449] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.215s user 0.013s sys 0.003s
I20260928 20:02:38.611682 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.612962 26913 raft_consensus.cc:359] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:38.613274 26594 leader_election.cc:343] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.613556 26913 raft_consensus.cc:385] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.613807 26913 raft_consensus.cc:740] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:02:38.545711 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 67135.9us
W20260928 20:02:38.487917 26231 rpcz_store.cc:269] 0928 20:02:36.961813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:36.972934 (+ 11121us) service_pool.cc:224] Handling call
0928 20:02:37.004507 (+ 31573us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:38.487526 (+1483019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:38.174130 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:38.174517 (+ 387us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:38.174541 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:38.174560 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:38.174867 (+ 307us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:38.174917 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:38.174950 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:38.175145 (+ 195us) tablet.cc:701] Row locks acquired
0928 20:02:38.175164 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:38.175300 (+ 136us) write_op.cc:270] Start()
0928 20:02:38.175403 (+ 103us) write_op.cc:276] Timestamp: P: 1790625758175246 usec, L: 0
0928 20:02:38.175425 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:02:38.273028 (+ 97603us) log.cc:844] Serialized 536 byte log entry
0928 20:02:38.275805 (+ 2777us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:38.469825 (+194020us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.470293 (+ 468us) write_op.cc:301] APPLY: starting
0928 20:02:38.470341 (+ 48us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.470437 (+ 96us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.470456 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.470609 (+ 153us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.470736 (+ 127us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:38.470777 (+ 41us) write_op.cc:312] APPLY: finished
0928 20:02:38.471020 (+ 243us) log.cc:844] Serialized 23 byte log entry
0928 20:02:38.471167 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.471219 (+ 52us) write_op.cc:454] Released schema lock
0928 20:02:38.471249 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":67865984,"child_traces":[["op",{"apply.queue_time_us":327,"num_ops":1,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":6131,"prepare.run_wall_time_us":101841,"replication_time_us":294308,"spinlock_wait_cycles":223000960}]]}
I20260928 20:02:38.566234 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:38.547122 27440 raft_consensus.cc:493] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:38.622279 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.590462 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_4000858d14c54415a5908450db7f35bf" } new_table_name: "default.Table_b09ea4c7a617469e9e4de4fc21c34fa3" modify_external_catalogs: true
I20260928 20:02:38.622416 27440 raft_consensus.cc:515] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.624271 27440 leader_election.cc:290] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:38.624658 27440 raft_consensus.cc:493] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.624795 27318 raft_consensus.cc:493] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.625228 27318 raft_consensus.cc:515] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.625712 26231 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_66eb05ddc1544e35baad1ae4cd242da2" } new_table_name: "default.Table_82c8c6d1d671463f91831833219aa073" modify_external_catalogs: true
I20260928 20:02:38.627254 27318 leader_election.cc:290] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:38.625190 27440 raft_consensus.cc:515] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:38.632428 26739 leader_election.cc:343] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:38.651368 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 41ac9772778c4fe8afc272f98eee2999 (DEFAULT_TABLE table=default.Table_d7d359f62a71495f99580370aacdbff7 [id=986f7e8be10e4f70930a513613b3731f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.652626 26916 tablet_bootstrap.cc:492] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:38.657282 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ac9772778c4fe8afc272f98eee2999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.663017 26913 consensus_queue.cc:260] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.677947 26234 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:38.691300 26801 raft_consensus.cc:3060] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:38.638559 26489 consensus_meta.cc:287] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.518s user 0.005s sys 0.003s
W20260928 20:02:38.704627 26740 leader_election.cc:343] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:38.705065 26740 leader_election.cc:304] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:38.706018 27318 raft_consensus.cc:2749] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.707679 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 1284d1f7fa774033b90133447627df4f
I20260928 20:02:38.701362 27440 leader_election.cc:290] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:38.703286 27445 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.713135 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:38.715381 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:38.716374 27445 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.719012 27445 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:38.719587 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_fa816eb9f57a489f807cdadfb66680b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:38.721474 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa816eb9f57a489f807cdadfb66680b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.734935 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:38.747520 26913 ts_tablet_manager.cc:1480] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.137s user 0.008s sys 0.000s
I20260928 20:02:38.748708 26913 tablet_bootstrap.cc:492] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:38.761201 27318 raft_consensus.cc:493] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.761696 27318 raft_consensus.cc:515] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.765632 26916 tablet_bootstrap.cc:654] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.787873 26487 tablet_service.cc:1511] Processing CreateTablet for tablet f478cce587a548e1aab620721c3bb1c1 (DEFAULT_TABLE table=default.Table_2a5441b3341b4a598fabc7fadafde28a [id=0fefcb948cb44c7e8ea026076b0bfccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:38.813498 27457 ts_tablet_manager.cc:1975] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:38.814005 27457 log.cc:1199] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/bd70ba6c0f1b43fcaa37bce4bf87a5e6
I20260928 20:02:38.814872 27457 ts_tablet_manager.cc:1996] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:38.818060 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 (table default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]) successfully deleted
W20260928 20:02:38.820060 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 385278bf2df34f4f960a0cfdebd79be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 385278bf2df34f4f960a0cfdebd79be5 already in progress: creating tablet
W20260928 20:02:38.822010 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4c23636443834932852f21092be1d1ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c23636443834932852f21092be1d1ac already in progress: creating tablet
W20260928 20:02:38.824119 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 1edf314241784091a603907a43429b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1edf314241784091a603907a43429b28 already in progress: creating tablet
W20260928 20:02:38.826264 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 1284d1f7fa774033b90133447627df4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1284d1f7fa774033b90133447627df4f already in progress: creating tablet
I20260928 20:02:38.828516 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:38.829803 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b059111d6383414890a28c2947934dd8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:38.831225 26740 leader_election.cc:304] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:38.846275 27481 raft_consensus.cc:2749] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.847949 26912 tablet_bootstrap.cc:492] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:38.848874 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:38.850461 26912 ts_tablet_manager.cc:1449] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.338s user 0.036s sys 0.046s
I20260928 20:02:38.852771 26912 raft_consensus.cc:359] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.853384 26912 raft_consensus.cc:385] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.853616 26912 raft_consensus.cc:740] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.853763 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f478cce587a548e1aab620721c3bb1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:38.854214 26912 consensus_queue.cc:260] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.858376 26635 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:38.860229 26916 tablet_bootstrap.cc:492] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:38.860735 26916 ts_tablet_manager.cc:1449] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.217s user 0.012s sys 0.000s
I20260928 20:02:38.861613 26489 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:38.862242 27318 leader_election.cc:290] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:38.866134 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4d0308d824cf401c8cca0cf7a950fd53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d0308d824cf401c8cca0cf7a950fd53 already in progress: creating tablet
I20260928 20:02:38.872443 27389 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:38.876721 27389 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:38.878772 26912 ts_tablet_manager.cc:1480] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260928 20:02:38.882536 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:38.883138 26513 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:38.889495 27389 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:38.890817 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.892786 26912 tablet_bootstrap.cc:492] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:38.893990 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 62836.7us
I20260928 20:02:38.895287 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:38.897378 26450 leader_election.cc:343] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.897980 26450 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:38.892256 26594 leader_election.cc:343] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:38.911414 26912 tablet_bootstrap.cc:654] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.902042 26913 tablet_bootstrap.cc:654] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:38.918509 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:38.920053 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.921692 27476 raft_consensus.cc:2749] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:38.920954 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dd3080d50748d2ad79f472d3c17673" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.935491 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dd3080d50748d2ad79f472d3c17673" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:38.948549 26912 tablet_bootstrap.cc:492] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:38.948982 26912 ts_tablet_manager.cc:1449] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.000s
I20260928 20:02:38.950712 27452 ts_tablet_manager.cc:1975] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:38.951179 27452 log.cc:1199] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/bd70ba6c0f1b43fcaa37bce4bf87a5e6
I20260928 20:02:38.952121 27452 ts_tablet_manager.cc:1996] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:38.951907 26912 raft_consensus.cc:359] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.952551 26912 raft_consensus.cc:385] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.952817 26912 raft_consensus.cc:740] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.959898 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018497a652234fbdb04cf6c034bcc5d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.960877 26912 consensus_queue.cc:260] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.962236 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018497a652234fbdb04cf6c034bcc5d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:38.963551 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:38.964208 26656 raft_consensus.cc:2468] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:38.965209 26912 ts_tablet_manager.cc:1480] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260928 20:02:38.966087 26912 tablet_bootstrap.cc:492] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:38.969843 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:38.972472 26595 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:38.973394 27389 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:38.973747 27389 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:38.974066 27389 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:38.918699 26916 raft_consensus.cc:359] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.980041 26916 raft_consensus.cc:385] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:38.980372 26916 raft_consensus.cc:740] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:38.981181 27389 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.981122 26916 consensus_queue.cc:260] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:38.992240 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:38.992893 26803 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:38.999491 26803 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:39.001179 27389 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:39.002667 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0ec120567bd34b25a3d9557552e911ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:39.004148 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ec120567bd34b25a3d9557552e911ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:38.998031 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]). Expected version 1 got 0
I20260928 20:02:39.011296 26594 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:39.011638 26232 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:39.012418 27389 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:39.013180 27389 raft_consensus.cc:697] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:39.014179 27389 consensus_queue.cc:237] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.025353 26912 tablet_bootstrap.cc:654] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:39.040179 26913 tablet_bootstrap.cc:492] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:39.040589 26913 ts_tablet_manager.cc:1449] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.292s user 0.009s sys 0.000s
I20260928 20:02:39.041644 27476 raft_consensus.cc:493] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.042071 27476 raft_consensus.cc:515] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.044376 26912 tablet_bootstrap.cc:492] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:39.045519 26916 ts_tablet_manager.cc:1480] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.185s user 0.007s sys 0.000s
I20260928 20:02:39.048931 26916 tablet_bootstrap.cc:492] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:39.055917 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 (table default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]) successfully deleted
I20260928 20:02:39.047190 26803 raft_consensus.cc:3060] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.057219 27359 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.057472 27476 leader_election.cc:290] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:39.057687 27359 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.059811 27359 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:39.062520 27453 ts_tablet_manager.cc:1975] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:39.062954 27453 log.cc:1199] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/bd70ba6c0f1b43fcaa37bce4bf87a5e6
I20260928 20:02:39.065016 26912 ts_tablet_manager.cc:1449] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.001s
I20260928 20:02:39.067505 26912 raft_consensus.cc:359] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.068154 26912 raft_consensus.cc:385] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.068397 26912 raft_consensus.cc:740] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.069005 26912 consensus_queue.cc:260] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.080731 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:39.081283 26515 raft_consensus.cc:2468] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:39.088760 26913 raft_consensus.cc:359] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.089546 26913 raft_consensus.cc:385] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.089843 26913 raft_consensus.cc:740] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.090651 26913 consensus_queue.cc:260] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.091691 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:39.092293 26800 raft_consensus.cc:2468] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:39.093829 26594 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:39.096146 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 1edf314241784091a603907a43429b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1edf314241784091a603907a43429b28 already in progress: creating tablet
W20260928 20:02:39.097088 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 385278bf2df34f4f960a0cfdebd79be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 385278bf2df34f4f960a0cfdebd79be5 already in progress: creating tablet
W20260928 20:02:39.098248 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4c23636443834932852f21092be1d1ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c23636443834932852f21092be1d1ac already in progress: creating tablet
W20260928 20:02:39.099730 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 1284d1f7fa774033b90133447627df4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1284d1f7fa774033b90133447627df4f already in progress: creating tablet
I20260928 20:02:39.100344 27453 ts_tablet_manager.cc:1996] T bd70ba6c0f1b43fcaa37bce4bf87a5e6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:39.108922 26912 ts_tablet_manager.cc:1480] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260928 20:02:39.109769 26912 tablet_bootstrap.cc:492] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:39.113366 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 (table default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]) successfully deleted
W20260928 20:02:39.119520 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4c23636443834932852f21092be1d1ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c23636443834932852f21092be1d1ac already in progress: creating tablet
I20260928 20:02:39.138350 26912 tablet_bootstrap.cc:654] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:39.145066 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:39.145720 26515 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.157910 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:39.158569 26513 raft_consensus.cc:2468] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:02:39.158866 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87024e1a4f184c669ff78efc918a9eef has no consensus state
I20260928 20:02:39.159089 26912 tablet_bootstrap.cc:492] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:39.159467 26912 ts_tablet_manager.cc:1449] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.003s
I20260928 20:02:39.162576 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:39.163177 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:39.164623 26595 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:39.165643 26450 leader_election.cc:343] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:39.166206 26450 leader_election.cc:343] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.166648 26912 raft_consensus.cc:359] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.167279 26912 raft_consensus.cc:385] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:02:39.170481 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 76746.5us
I20260928 20:02:39.170696 27359 raft_consensus.cc:2804] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:39.171006 27359 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:39.171294 27359 raft_consensus.cc:3060] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.171762 27389 raft_consensus.cc:2804] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:39.172101 27389 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:39.172394 27389 raft_consensus.cc:3060] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.181128 27389 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.185474 27389 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:39.193032 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4d0308d824cf401c8cca0cf7a950fd53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d0308d824cf401c8cca0cf7a950fd53 already in progress: creating tablet
I20260928 20:02:39.167526 26912 raft_consensus.cc:740] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.188979 27384 consensus_queue.cc:1048] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:39.195571 26912 consensus_queue.cc:260] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.191149 27359 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.203164 26227 master_service.cc:960] ReplaceTablet: received request to replace tablet 38abbc891d9c4268820cb0faba3d08b5 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:39.206562 26912 ts_tablet_manager.cc:1480] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.047s user 0.006s sys 0.001s
I20260928 20:02:39.206815 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0" } modify_external_catalogs: true
I20260928 20:02:39.207334 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0" } modify_external_catalogs: true
I20260928 20:02:39.209151 26912 tablet_bootstrap.cc:492] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:39.210949 26803 raft_consensus.cc:3060] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:39.213981 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_b09ea4c7a617469e9e4de4fc21c34fa3 [id=cccad7b111c844f3a7e5a1ae62c06adf], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 87024e1a4f184c669ff78efc918a9eef has no consensus state
I20260928 20:02:39.219304 27384 consensus_queue.cc:1048] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:39.226413 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:39.227751 26594 leader_election.cc:343] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.238821 27453 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 194) took 1003 ms. Trace:
I20260928 20:02:39.239351 27453 rpcz_store.cc:276] 0928 20:02:38.235730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:38.236125 (+ 395us) service_pool.cc:224] Handling call
0928 20:02:39.238406 (+1002281us) ts_tablet_manager.cc:1197] Deleting tablet 385278bf2df34f4f960a0cfdebd79be5
0928 20:02:39.238456 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:39.238754 (+ 298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":993635}
W20260928 20:02:39.241075 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 385278bf2df34f4f960a0cfdebd79be5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 385278bf2df34f4f960a0cfdebd79be5 already in progress: creating tablet
W20260928 20:02:39.242972 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 1284d1f7fa774033b90133447627df4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1284d1f7fa774033b90133447627df4f already in progress: creating tablet
W20260928 20:02:39.244702 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4d0308d824cf401c8cca0cf7a950fd53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d0308d824cf401c8cca0cf7a950fd53 already in progress: creating tablet
I20260928 20:02:39.245253 26912 tablet_bootstrap.cc:654] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:39.246027 27359 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:39.246662 26913 ts_tablet_manager.cc:1480] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.206s user 0.008s sys 0.000s
I20260928 20:02:39.246778 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:39.247289 26803 raft_consensus.cc:3060] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.247816 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3" } modify_external_catalogs: true
I20260928 20:02:39.248297 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3" } modify_external_catalogs: true
I20260928 20:02:39.253857 26913 tablet_bootstrap.cc:492] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:39.268967 26231 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b667a45712c1449384e1a288f55fd062 has no consensus state
I20260928 20:02:39.271813 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7bc4de2a66f140ed9204fdc4d2336ce3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:39.273772 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bc4de2a66f140ed9204fdc4d2336ce3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:39.280419 26803 raft_consensus.cc:2468] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:39.281703 26594 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:39.282703 27494 raft_consensus.cc:2804] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:39.283205 27494 raft_consensus.cc:697] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:39.284031 27494 consensus_queue.cc:237] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.153375 26515 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:02:39.296886 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 130162us
I20260928 20:02:39.297652 26450 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:39.298471 27476 raft_consensus.cc:2804] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:39.298787 27476 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:39.299082 27476 raft_consensus.cc:3060] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.303365 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet ee4c267b42754dbca8eb5ebec2d66a23
I20260928 20:02:39.304957 26229 master_service.cc:960] ReplaceTablet: received request to replace tablet 2728c9979bb647a5a8f0a902c299e53d from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:39.307657 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:39.308873 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:39.310879 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:39.311446 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet ee4c267b42754dbca8eb5ebec2d66a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee4c267b42754dbca8eb5ebec2d66a23 already in progress: creating tablet
I20260928 20:02:39.311962 27476 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.314962 27476 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:39.137928 26916 tablet_bootstrap.cc:654] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:39.319453 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet ee4c267b42754dbca8eb5ebec2d66a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee4c267b42754dbca8eb5ebec2d66a23 already in progress: creating tablet
I20260928 20:02:39.320190 26912 tablet_bootstrap.cc:492] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:39.320598 26912 ts_tablet_manager.cc:1449] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.005s
I20260928 20:02:39.329651 26912 raft_consensus.cc:359] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.330294 26912 raft_consensus.cc:385] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.330533 26912 raft_consensus.cc:740] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.336902 26912 consensus_queue.cc:260] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:39.343475 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet ee4c267b42754dbca8eb5ebec2d66a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee4c267b42754dbca8eb5ebec2d66a23 already in progress: creating tablet
I20260928 20:02:39.347388 26913 tablet_bootstrap.cc:654] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:39.349491 26450 leader_election.cc:343] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:39.349993 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 43513.6us
W20260928 20:02:39.350955 26450 leader_election.cc:343] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.351591 26450 leader_election.cc:304] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:39.352662 27440 raft_consensus.cc:2749] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:39.354008 26450 leader_election.cc:343] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.355688 26912 ts_tablet_manager.cc:1480] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.029s user 0.004s sys 0.000s
I20260928 20:02:39.358024 27494 raft_consensus.cc:493] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.359122 27494 raft_consensus.cc:515] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.362501 27494 leader_election.cc:290] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:39.364480 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_402a55b920da45e884c1b48742a7e424" } new_table_name: "default.Table_07fc7a223812466d8d63a0097bbbd86b" modify_external_catalogs: true
I20260928 20:02:39.361876 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4604b0cf7e56457086383c4314814b21" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:39.367826 26594 leader_election.cc:343] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.369112 26912 tablet_bootstrap.cc:492] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:39.383935 26912 tablet_bootstrap.cc:654] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:39.395059 26450 leader_election.cc:304] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:39.408910 26916 tablet_bootstrap.cc:492] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:39.409435 26916 ts_tablet_manager.cc:1449] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.361s user 0.011s sys 0.000s
I20260928 20:02:39.412544 26916 raft_consensus.cc:359] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.423655 26912 tablet_bootstrap.cc:492] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:39.425010 26912 ts_tablet_manager.cc:1449] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.004s
I20260928 20:02:39.432582 26912 raft_consensus.cc:359] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.442239 26912 raft_consensus.cc:385] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.414139 27476 raft_consensus.cc:2749] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:39.414163 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 59964.7us
W20260928 20:02:39.445942 26450 leader_election.cc:343] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.444798 26912 raft_consensus.cc:740] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:39.447629 26450 leader_election.cc:343] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.447965 26450 leader_election.cc:304] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:39.448552 27476 raft_consensus.cc:2749] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:39.447640 26912 consensus_queue.cc:260] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.453120 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:39.453899 26657 raft_consensus.cc:2393] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:39.413452 26916 raft_consensus.cc:385] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.453747 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:39.455794 26916 raft_consensus.cc:740] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.456677 27318 raft_consensus.cc:493] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.456487 26916 consensus_queue.cc:260] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.457077 27318 raft_consensus.cc:515] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.460729 27318 leader_election.cc:290] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:39.460827 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:39.461381 26513 raft_consensus.cc:2468] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:39.465062 26740 leader_election.cc:304] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:39.466452 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:39.466943 27318 raft_consensus.cc:2804] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:39.467240 27318 raft_consensus.cc:493] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:39.467538 27318 raft_consensus.cc:3060] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.468061 26912 ts_tablet_manager.cc:1480] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.038s user 0.005s sys 0.001s
W20260928 20:02:39.470649 26739 leader_election.cc:343] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.471975 26912 tablet_bootstrap.cc:492] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:39.474596 26487 tablet_service.cc:1511] Processing CreateTablet for tablet bd3fa371924149fb814c8458488aea61 (DEFAULT_TABLE table=default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.475943 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3fa371924149fb814c8458488aea61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.486488 26636 tablet_service.cc:1511] Processing CreateTablet for tablet bd3fa371924149fb814c8458488aea61 (DEFAULT_TABLE table=default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.487181 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 (DEFAULT_TABLE table=default.Table_afc7904735e94895aa832ee117628bac [id=15aa9f1d18a24b75b9d5c43329d8ddd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.487464 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3fa371924149fb814c8458488aea61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.488147 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d7ab92a37c4f9b865fa9fe49d46916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.487181 26784 tablet_service.cc:1511] Processing CreateTablet for tablet bd3fa371924149fb814c8458488aea61 (DEFAULT_TABLE table=default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.491168 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3fa371924149fb814c8458488aea61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.491240 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:39.492281 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:39.493076 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e70df4ddf0f9430980c967d798ed6c50 (table default.Table_060bc0393e4d45c2a1ef08a71894f56d [id=14b35dc03a724a6d9062137acac612cc]). Expected version 1 got 0
I20260928 20:02:39.493626 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:39.494081 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:39.496531 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 (DEFAULT_TABLE table=default.Table_afc7904735e94895aa832ee117628bac [id=15aa9f1d18a24b75b9d5c43329d8ddd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.497509 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d7ab92a37c4f9b865fa9fe49d46916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.499038 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1c8e5a49db49f39e90c3737c33e8fc (DEFAULT_TABLE table=default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.499646 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 (DEFAULT_TABLE table=default.Table_afc7904735e94895aa832ee117628bac [id=15aa9f1d18a24b75b9d5c43329d8ddd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.499965 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1c8e5a49db49f39e90c3737c33e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.500784 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d7ab92a37c4f9b865fa9fe49d46916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.502385 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1c8e5a49db49f39e90c3737c33e8fc (DEFAULT_TABLE table=default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.503291 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1c8e5a49db49f39e90c3737c33e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.481837 27318 raft_consensus.cc:515] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.513929 27318 leader_election.cc:290] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:39.514128 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:39.515762 26739 leader_election.cc:343] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.516166 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:39.516724 26513 raft_consensus.cc:3060] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.527199 26916 ts_tablet_manager.cc:1480] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.117s user 0.008s sys 0.000s
I20260928 20:02:39.528194 26916 tablet_bootstrap.cc:492] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:39.533907 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:39.534582 26515 raft_consensus.cc:2393] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:39.538482 26513 raft_consensus.cc:2468] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:39.542089 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:39.542618 26516 raft_consensus.cc:3060] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.543155 26595 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:39.544596 26740 leader_election.cc:304] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
W20260928 20:02:39.510914 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260928 20:02:39.529134 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:39.546919 26227 catalog_manager.cc:6934] ReplaceTablet: tablet 38abbc891d9c4268820cb0faba3d08b5 deleted and replaced by tablet 91b11022fc774d18b92e0c694f834375
I20260928 20:02:39.547744 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_29313cec5adc47e1af7bd7a25a0ce4ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:39.549072 27494 raft_consensus.cc:2749] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:02:39.549396 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29313cec5adc47e1af7bd7a25a0ce4ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:39.549063 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:39.549680 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:39.551719 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:39.553792 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 38abbc891d9c4268820cb0faba3d08b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38abbc891d9c4268820cb0faba3d08b5 already in progress: creating tablet
I20260928 20:02:39.554288 26516 raft_consensus.cc:2468] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:39.556512 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1c8e5a49db49f39e90c3737c33e8fc (DEFAULT_TABLE table=default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.557590 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1c8e5a49db49f39e90c3737c33e8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.558333 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 775b9a076bf048bea39423d3554babf7
I20260928 20:02:39.560369 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_487262bf721f4183a8850da9cac26908"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:39.561926 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_487262bf721f4183a8850da9cac26908 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:39.564209 26489 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 (DEFAULT_TABLE table=default.Table_9383c6792e2d433ab615717932fa897e [id=b639dae4a9234107aa133677343f4d12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.565254 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb8477c5cb74205b4b55eb38d7f9542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.566322 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:39.567482 27318 raft_consensus.cc:2804] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:39.569891 27318 raft_consensus.cc:697] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
W20260928 20:02:39.572259 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 38abbc891d9c4268820cb0faba3d08b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38abbc891d9c4268820cb0faba3d08b5 already in progress: creating tablet
I20260928 20:02:39.571943 27318 consensus_queue.cc:237] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:39.575103 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 38abbc891d9c4268820cb0faba3d08b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38abbc891d9c4268820cb0faba3d08b5 already in progress: creating tablet
I20260928 20:02:39.576357 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:39.576515 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 (DEFAULT_TABLE table=default.Table_9383c6792e2d433ab615717932fa897e [id=b639dae4a9234107aa133677343f4d12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.577586 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb8477c5cb74205b4b55eb38d7f9542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.584630 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:39.586733 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 (DEFAULT_TABLE table=default.Table_9383c6792e2d433ab615717932fa897e [id=b639dae4a9234107aa133677343f4d12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.587738 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb8477c5cb74205b4b55eb38d7f9542. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:39.589610 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 775b9a076bf048bea39423d3554babf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 775b9a076bf048bea39423d3554babf7 already in progress: creating tablet
I20260928 20:02:39.611238 26912 tablet_bootstrap.cc:654] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:39.578163 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 775b9a076bf048bea39423d3554babf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 775b9a076bf048bea39423d3554babf7 already in progress: creating tablet
W20260928 20:02:39.590628 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 79728us
W20260928 20:02:39.626461 26223 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48341us
I20260928 20:02:39.630949 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 (DEFAULT_TABLE table=default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.632114 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a86cd5167c43a4beb51cd3138cdef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.635344 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 0aad5c72e4c64b9e91082860477c78fa (DEFAULT_TABLE table=default.Table_a79a8a3ed31b47348f4de573aef54ed6 [id=eb4db143a6e04cab9ef4d9f60b540953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.636332 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aad5c72e4c64b9e91082860477c78fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.639097 26486 tablet_service.cc:1511] Processing CreateTablet for tablet 87024e1a4f184c669ff78efc918a9eef (DEFAULT_TABLE table=default.Table_b09ea4c7a617469e9e4de4fc21c34fa3 [id=cccad7b111c844f3a7e5a1ae62c06adf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:39.639426 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260928 20:02:39.640198 26486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87024e1a4f184c669ff78efc918a9eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.643364 26494 tablet_service.cc:1511] Processing CreateTablet for tablet aec2497f4eac4408a37eb2a40122a672 (DEFAULT_TABLE table=default.Table_4d246ff7bc384944a508f62c7e090eea [id=023649e64be246a989059f38b897055e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.644323 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec2497f4eac4408a37eb2a40122a672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.647578 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 1d945be7bea449ba8c5541b60eb18334 (DEFAULT_TABLE table=default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.647902 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 (DEFAULT_TABLE table=default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.648658 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d945be7bea449ba8c5541b60eb18334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.649194 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5de4a82bd41c1a8b2af2ba7417c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.674299 27476 raft_consensus.cc:493] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.675158 27476 raft_consensus.cc:515] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.679836 26495 tablet_service.cc:1511] Processing CreateTablet for tablet b667a45712c1449384e1a288f55fd062 (DEFAULT_TABLE table=default.Table_82c8c6d1d671463f91831833219aa073 [id=e2819060d01546218e8b53248ca6decd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.680859 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b667a45712c1449384e1a288f55fd062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.685412 26912 tablet_bootstrap.cc:492] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:39.685835 26912 ts_tablet_manager.cc:1449] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.214s user 0.006s sys 0.004s
W20260928 20:02:39.690737 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 101156us
I20260928 20:02:39.695333 26485 tablet_service.cc:1511] Processing CreateTablet for tablet 647a383938f947108890ae2042e3edc3 (DEFAULT_TABLE table=default.Table_0f2425b8a3f44839afa3d4dd8d45b246 [id=1e0af613169c4eb7b1bc6dbca175a3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.696911 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647a383938f947108890ae2042e3edc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.700922 27359 raft_consensus.cc:493] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.701427 27359 raft_consensus.cc:515] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.703472 27359 leader_election.cc:290] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:39.703379 26484 tablet_service.cc:1511] Processing CreateTablet for tablet d479a8eabc624569968515684e8acb0c (DEFAULT_TABLE table=default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.704622 26484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d479a8eabc624569968515684e8acb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.705341 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:39.705974 26800 raft_consensus.cc:2468] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:39.707881 26594 leader_election.cc:304] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:39.710613 27495 raft_consensus.cc:2804] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:39.711059 27495 raft_consensus.cc:493] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:39.711443 27495 raft_consensus.cc:3060] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:39.720746 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 775b9a076bf048bea39423d3554babf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 775b9a076bf048bea39423d3554babf7 already in progress: creating tablet
I20260928 20:02:39.720989 27495 raft_consensus.cc:515] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.728523 27495 leader_election.cc:290] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:39.728891 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:39.727291 26912 raft_consensus.cc:359] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.729512 26800 raft_consensus.cc:3060] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.729702 26912 raft_consensus.cc:385] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.729954 26912 raft_consensus.cc:740] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.730566 26912 consensus_queue.cc:260] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.741025 26800 raft_consensus.cc:2468] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:39.574863 26235 catalog_manager.cc:5838] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:39.750519 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 0aad5c72e4c64b9e91082860477c78fa (DEFAULT_TABLE table=default.Table_a79a8a3ed31b47348f4de573aef54ed6 [id=eb4db143a6e04cab9ef4d9f60b540953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.750514 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:39.751782 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aad5c72e4c64b9e91082860477c78fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.751706 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:39.752346 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:39.715234 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2d13d16d9946c6b09f9197c165033c (DEFAULT_TABLE table=default.Table_0db7c57c88674a57b2c4faceaa98eb1e [id=17447ae0353e48e3b1fb75ff64ada358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.773402 26913 tablet_bootstrap.cc:492] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:39.774320 26913 ts_tablet_manager.cc:1449] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.521s user 0.009s sys 0.004s
I20260928 20:02:39.778532 26913 raft_consensus.cc:359] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.779428 26913 raft_consensus.cc:385] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.779680 26913 raft_consensus.cc:740] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.781977 26594 leader_election.cc:304] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:39.783107 27495 raft_consensus.cc:2804] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:39.783634 27495 raft_consensus.cc:697] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:39.784610 27495 consensus_queue.cc:237] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:39.741755 26912 ts_tablet_manager.cc:1480] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260928 20:02:39.750363 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 0aad5c72e4c64b9e91082860477c78fa (DEFAULT_TABLE table=default.Table_a79a8a3ed31b47348f4de573aef54ed6 [id=eb4db143a6e04cab9ef4d9f60b540953]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.796599 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 (DEFAULT_TABLE table=default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.798237 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2d13d16d9946c6b09f9197c165033c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.805030 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 87024e1a4f184c669ff78efc918a9eef (DEFAULT_TABLE table=default.Table_b09ea4c7a617469e9e4de4fc21c34fa3 [id=cccad7b111c844f3a7e5a1ae62c06adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.806119 27510 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:39.808377 27511 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:39.823479 26916 tablet_bootstrap.cc:654] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:39.753232 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:39.838243 27476 leader_election.cc:290] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:39.839496 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 16796100116a4fe4a64893f49fb1cad4 (DEFAULT_TABLE table=default.Table_3a07cad7ccd24a988d6700cc9bca9ec2 [id=953ae93d35534f35966832d4a4ab3fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.840642 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16796100116a4fe4a64893f49fb1cad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.847257 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 23d262c7a15b434d8caea0a818323dd1 (DEFAULT_TABLE table=default.Table_ddbef16a957543e9a5d66e47979c16be [id=1fa1c63e9885499c832e048aba0808a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.806787 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 (DEFAULT_TABLE table=default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.848232 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d262c7a15b434d8caea0a818323dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.848577 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a86cd5167c43a4beb51cd3138cdef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.808295 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 87024e1a4f184c669ff78efc918a9eef (DEFAULT_TABLE table=default.Table_b09ea4c7a617469e9e4de4fc21c34fa3 [id=cccad7b111c844f3a7e5a1ae62c06adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.854063 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87024e1a4f184c669ff78efc918a9eef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:39.822095 26595 leader_election.cc:343] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21
I20260928 20:02:39.866348 26595 leader_election.cc:304] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:39.867960 27359 raft_consensus.cc:2749] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:39.869798 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 47740.3us
I20260928 20:02:39.871628 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 1d945be7bea449ba8c5541b60eb18334 (DEFAULT_TABLE table=default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.871532 26631 tablet_service.cc:1511] Processing CreateTablet for tablet aec2497f4eac4408a37eb2a40122a672 (DEFAULT_TABLE table=default.Table_4d246ff7bc384944a508f62c7e090eea [id=023649e64be246a989059f38b897055e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.872666 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d945be7bea449ba8c5541b60eb18334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.877784 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec2497f4eac4408a37eb2a40122a672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.929322 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 (DEFAULT_TABLE table=default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.930390 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5de4a82bd41c1a8b2af2ba7417c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.939281 26633 tablet_service.cc:1511] Processing CreateTablet for tablet b667a45712c1449384e1a288f55fd062 (DEFAULT_TABLE table=default.Table_82c8c6d1d671463f91831833219aa073 [id=e2819060d01546218e8b53248ca6decd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.940279 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b667a45712c1449384e1a288f55fd062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.940850 26916 tablet_bootstrap.cc:492] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:39.941262 26916 ts_tablet_manager.cc:1449] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.413s user 0.006s sys 0.004s
I20260928 20:02:39.815196 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aad5c72e4c64b9e91082860477c78fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.943766 26916 raft_consensus.cc:359] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.944362 26916 raft_consensus.cc:385] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:39.944593 26916 raft_consensus.cc:740] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:39.945006 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a86cd5167c43a4beb51cd3138cdef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.945188 26916 consensus_queue.cc:260] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.950824 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87024e1a4f184c669ff78efc918a9eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.836958 26776 tablet_service.cc:1511] Processing CreateTablet for tablet aec2497f4eac4408a37eb2a40122a672 (DEFAULT_TABLE table=default.Table_4d246ff7bc384944a508f62c7e090eea [id=023649e64be246a989059f38b897055e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.953621 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec2497f4eac4408a37eb2a40122a672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.842857 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 1d945be7bea449ba8c5541b60eb18334 (DEFAULT_TABLE table=default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.959167 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d945be7bea449ba8c5541b60eb18334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:39.927340 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 (DEFAULT_TABLE table=default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:39.917861 26450 leader_election.cc:343] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:39.963837 26450 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:39.928081 26775 tablet_service.cc:1511] Processing CreateTablet for tablet b667a45712c1449384e1a288f55fd062 (DEFAULT_TABLE table=default.Table_82c8c6d1d671463f91831833219aa073 [id=e2819060d01546218e8b53248ca6decd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.928906 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 647a383938f947108890ae2042e3edc3 (DEFAULT_TABLE table=default.Table_0f2425b8a3f44839afa3d4dd8d45b246 [id=1e0af613169c4eb7b1bc6dbca175a3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.817600 26912 tablet_bootstrap.cc:492] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:39.984746 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b6d3e2c8a9994b19b860b97f44a72785"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:39.986402 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6d3e2c8a9994b19b860b97f44a72785 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:40.006824 26916 ts_tablet_manager.cc:1480] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.065s user 0.006s sys 0.000s
I20260928 20:02:40.007865 26916 tablet_bootstrap.cc:492] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:40.010072 27476 raft_consensus.cc:2749] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:02:40.010952 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 93119.8us
I20260928 20:02:40.026810 27476 raft_consensus.cc:493] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.027277 27476 raft_consensus.cc:515] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.028452 26913 consensus_queue.cc:260] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.029147 27476 leader_election.cc:290] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:40.030429 26913 ts_tablet_manager.cc:1480] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.256s user 0.005s sys 0.002s
I20260928 20:02:40.031245 26913 tablet_bootstrap.cc:492] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:40.038196 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:40.038713 26516 raft_consensus.cc:3060] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:39.982883 27318 raft_consensus.cc:493] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:39.991504 26783 tablet_service.cc:1511] Processing CreateTablet for tablet d479a8eabc624569968515684e8acb0c (DEFAULT_TABLE table=default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:39.992154 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2d13d16d9946c6b09f9197c165033c (DEFAULT_TABLE table=default.Table_0db7c57c88674a57b2c4faceaa98eb1e [id=17447ae0353e48e3b1fb75ff64ada358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.041405 27318 raft_consensus.cc:515] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:39.991906 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 16796100116a4fe4a64893f49fb1cad4 (DEFAULT_TABLE table=default.Table_3a07cad7ccd24a988d6700cc9bca9ec2 [id=953ae93d35534f35966832d4a4ab3fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.046764 26912 tablet_bootstrap.cc:654] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.040308 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:40.047441 26740 leader_election.cc:343] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:40.015645 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:40.048506 26803 raft_consensus.cc:2393] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:40.051138 26516 raft_consensus.cc:2468] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:40.052186 27318 leader_election.cc:290] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.052290 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 23d262c7a15b434d8caea0a818323dd1 (DEFAULT_TABLE table=default.Table_ddbef16a957543e9a5d66e47979c16be [id=1fa1c63e9885499c832e048aba0808a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.053683 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b667a45712c1449384e1a288f55fd062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.054281 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647a383938f947108890ae2042e3edc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.058599 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d5de4a82bd41c1a8b2af2ba7417c46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:40.049683 26450 leader_election.cc:343] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.076589 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d479a8eabc624569968515684e8acb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.078598 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2d13d16d9946c6b09f9197c165033c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.082507 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16796100116a4fe4a64893f49fb1cad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.093134 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d262c7a15b434d8caea0a818323dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.106838 26912 tablet_bootstrap.cc:492] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:40.107250 26912 ts_tablet_manager.cc:1449] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.290s user 0.010s sys 0.000s
I20260928 20:02:40.130483 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:40.131117 26512 raft_consensus.cc:2376] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1. Re-sending same reply.
I20260928 20:02:40.132157 27476 raft_consensus.cc:493] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.132570 27476 raft_consensus.cc:515] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.134508 27476 leader_election.cc:290] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.153273 26916 tablet_bootstrap.cc:654] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.163813 26912 raft_consensus.cc:359] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.164491 26912 raft_consensus.cc:385] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.164763 26912 raft_consensus.cc:740] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:40.170729 26912 consensus_queue.cc:260] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.172819 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:40.174875 26450 leader_election.cc:343] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.181910 26912 ts_tablet_manager.cc:1480] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.074s user 0.006s sys 0.000s
I20260928 20:02:40.194320 26912 tablet_bootstrap.cc:492] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:40.201221 26912 tablet_bootstrap.cc:654] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.215476 26916 tablet_bootstrap.cc:492] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:40.216038 26916 ts_tablet_manager.cc:1449] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.208s user 0.011s sys 0.002s
I20260928 20:02:40.262176 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3a07cad7ccd24a988d6700cc9bca9ec2" } new_table_name: "default.Table_746822f22dac49c1b0b2562338e8dcb5" modify_external_catalogs: true
I20260928 20:02:40.268720 26912 tablet_bootstrap.cc:492] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:40.269109 26912 ts_tablet_manager.cc:1449] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.011s
I20260928 20:02:40.271081 26916 raft_consensus.cc:359] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.276244 26912 raft_consensus.cc:359] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:40.276880 26912 raft_consensus.cc:385] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.277110 26912 raft_consensus.cc:740] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:40.280689 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bba200d6ef33438187dd643fe3ded009 consensus state has no leader
W20260928 20:02:40.281955 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16796100116a4fe4a64893f49fb1cad4 consensus state has no leader
I20260928 20:02:40.284533 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0db7c57c88674a57b2c4faceaa98eb1e" } modify_external_catalogs: true
I20260928 20:02:40.285277 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0db7c57c88674a57b2c4faceaa98eb1e" } modify_external_catalogs: true
I20260928 20:02:40.292822 27517 raft_consensus.cc:493] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.293365 27517 raft_consensus.cc:515] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.277678 26912 consensus_queue.cc:260] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:40.296377 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:40.297534 26912 ts_tablet_manager.cc:1480] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.028s user 0.004s sys 0.002s
W20260928 20:02:40.300210 26450 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.302165 27517 leader_election.cc:290] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.303421 26912 tablet_bootstrap.cc:492] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:40.310159 26916 raft_consensus.cc:385] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.310472 26916 raft_consensus.cc:740] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:40.311187 26916 consensus_queue.cc:260] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.313493 26916 ts_tablet_manager.cc:1480] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.097s user 0.005s sys 0.000s
I20260928 20:02:40.321493 26912 tablet_bootstrap.cc:654] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.342265 27522 raft_consensus.cc:493] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.343271 27522 raft_consensus.cc:515] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.362478 27476 raft_consensus.cc:493] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.362993 27476 raft_consensus.cc:515] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.364773 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:40.364969 27476 leader_election.cc:290] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.366120 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:40.367257 26450 leader_election.cc:343] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.371492 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:40.373412 27522 leader_election.cc:290] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:40.374137 26450 leader_election.cc:343] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.374481 26450 leader_election.cc:304] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.374655 26651 raft_consensus.cc:3060] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:40.375411 27517 raft_consensus.cc:2749] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.380963 26912 tablet_bootstrap.cc:492] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:40.381392 26912 ts_tablet_manager.cc:1449] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.006s
I20260928 20:02:40.391940 26912 raft_consensus.cc:359] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.392611 26912 raft_consensus.cc:385] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.392860 26912 raft_consensus.cc:740] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:40.393445 26912 consensus_queue.cc:260] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.407922 26912 ts_tablet_manager.cc:1480] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20260928 20:02:40.411522 26912 tablet_bootstrap.cc:492] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:40.411907 26916 tablet_bootstrap.cc:492] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:40.425897 26912 tablet_bootstrap.cc:654] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.379379 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:40.443602 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43571.2us
I20260928 20:02:40.443884 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:40.445802 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:40.447873 26450 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.448529 26450 leader_election.cc:304] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.449697 27517 raft_consensus.cc:2749] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.462178 26912 tablet_bootstrap.cc:492] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:40.462692 26912 ts_tablet_manager.cc:1449] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.005s
I20260928 20:02:40.465236 26912 raft_consensus.cc:359] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.473081 26912 raft_consensus.cc:385] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.473457 26912 raft_consensus.cc:740] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:40.474298 26912 consensus_queue.cc:260] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.482247 26773 tablet_service.cc:1511] Processing CreateTablet for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (DEFAULT_TABLE table=default.Table_7bc4de2a66f140ed9204fdc4d2336ce3 [id=d470ed945a154ff081f5e46e0377f77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.483373 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d6dcd913394d4ca2e4b9f5be5ea069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.495108 26912 ts_tablet_manager.cc:1480] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.032s user 0.004s sys 0.001s
I20260928 20:02:40.500816 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 0a2d13d16d9946c6b09f9197c165033c
I20260928 20:02:40.500957 26912 tablet_bootstrap.cc:492] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:40.503188 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:40.505203 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:40.507187 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
W20260928 20:02:40.510300 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 76410.8us
I20260928 20:02:40.512116 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:40.512714 27517 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.513240 27517 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.513276 27522 consensus_queue.cc:1048] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:40.515134 27517 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.516891 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:40.517047 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:40.517421 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:40.518311 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:40.519910 26913 tablet_bootstrap.cc:654] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.521600 26483 tablet_service.cc:1511] Processing CreateTablet for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (DEFAULT_TABLE table=default.Table_7bc4de2a66f140ed9204fdc4d2336ce3 [id=d470ed945a154ff081f5e46e0377f77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.522915 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d6dcd913394d4ca2e4b9f5be5ea069. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:40.524842 26739 leader_election.cc:343] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:40.525215 26739 leader_election.cc:304] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:40.526221 27318 raft_consensus.cc:2749] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:40.526432 26450 leader_election.cc:343] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.526813 26450 leader_election.cc:304] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:40.528071 26450 leader_election.cc:343] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:40.528766 26450 leader_election.cc:343] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.529172 26450 leader_election.cc:304] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.530651 27476 raft_consensus.cc:2749] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.531347 27476 raft_consensus.cc:2749] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:40.531328 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 72698.9us
I20260928 20:02:40.532200 27476 raft_consensus.cc:493] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.532601 27476 raft_consensus.cc:515] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.534757 27476 leader_election.cc:290] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:40.535915 26450 leader_election.cc:343] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.536402 26450 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.538468 27517 raft_consensus.cc:2749] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.539121 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fb4e1fd0584a42a4de9eab14d5578c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:40.539669 27528 consensus_queue.cc:1048] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260928 20:02:40.542272 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fb4e1fd0584a42a4de9eab14d5578c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:40.532269 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee464b814dbf4e4b89b2d1c019befac6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:40.542560 27493 consensus_queue.cc:1048] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260928 20:02:40.547299 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 647a383938f947108890ae2042e3edc3 (DEFAULT_TABLE table=default.Table_0f2425b8a3f44839afa3d4dd8d45b246 [id=1e0af613169c4eb7b1bc6dbca175a3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.548982 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647a383938f947108890ae2042e3edc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:40.551090 26450 leader_election.cc:343] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:40.551702 26450 leader_election.cc:343] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:40.562659 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2d13d16d9946c6b09f9197c165033c (DEFAULT_TABLE table=default.Table_0db7c57c88674a57b2c4faceaa98eb1e [id=17447ae0353e48e3b1fb75ff64ada358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.563562 26631 tablet_service.cc:1511] Processing CreateTablet for tablet d479a8eabc624569968515684e8acb0c (DEFAULT_TABLE table=default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.564291 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2d13d16d9946c6b09f9197c165033c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.564177 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 16796100116a4fe4a64893f49fb1cad4 (DEFAULT_TABLE table=default.Table_3a07cad7ccd24a988d6700cc9bca9ec2 [id=953ae93d35534f35966832d4a4ab3fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.564754 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d479a8eabc624569968515684e8acb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.565510 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16796100116a4fe4a64893f49fb1cad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.566900 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 23d262c7a15b434d8caea0a818323dd1 (DEFAULT_TABLE table=default.Table_ddbef16a957543e9a5d66e47979c16be [id=1fa1c63e9885499c832e048aba0808a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.570483 27318 consensus_queue.cc:1048] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:40.569730 26630 tablet_service.cc:1511] Processing CreateTablet for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (DEFAULT_TABLE table=default.Table_7bc4de2a66f140ed9204fdc4d2336ce3 [id=d470ed945a154ff081f5e46e0377f77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.573972 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d262c7a15b434d8caea0a818323dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.590587 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d6dcd913394d4ca2e4b9f5be5ea069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.593362 26450 leader_election.cc:304] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.594084 27476 raft_consensus.cc:2749] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.594938 26450 leader_election.cc:304] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.595748 27517 raft_consensus.cc:2749] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.608127 26916 tablet_bootstrap.cc:654] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.622470 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:40.623466 27534 raft_consensus.cc:493] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.623966 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f]). Expected version 3 got 0
I20260928 20:02:40.624017 27534 raft_consensus.cc:515] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.626940 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:40.628861 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:40.631301 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0acdca2ff4dfc9ae5ddc97d7aab24" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:40.632571 26739 leader_election.cc:343] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:40.633291 26634 consensus_meta.cc:287] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.856s user 0.015s sys 0.003s
W20260928 20:02:40.636201 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 77768.5us
W20260928 20:02:40.644692 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 0a2d13d16d9946c6b09f9197c165033c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a2d13d16d9946c6b09f9197c165033c already in progress: creating tablet
W20260928 20:02:40.644711 26740 leader_election.cc:343] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:40.645167 26912 tablet_bootstrap.cc:654] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.645673 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e70df4ddf0f9430980c967d798ed6c50 (table default.Table_060bc0393e4d45c2a1ef08a71894f56d [id=14b35dc03a724a6d9062137acac612cc]). Expected version 1 got 0
I20260928 20:02:40.646534 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25 (DEFAULT_TABLE table=default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 [id=6fc28fd5258c423ab0cf022d50525caf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.647981 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.611121 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25 (DEFAULT_TABLE table=default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 [id=6fc28fd5258c423ab0cf022d50525caf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.651995 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.646605 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:40.655292 26516 raft_consensus.cc:2393] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:40.677430 27318 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.678148 27318 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:40.681291 27318 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:40.681509 27541 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:40.684442 27318 raft_consensus.cc:493] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:40.684828 27318 raft_consensus.cc:515] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.691917 27534 leader_election.cc:290] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.692505 26913 tablet_bootstrap.cc:492] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:40.693050 26913 ts_tablet_manager.cc:1449] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.662s user 0.015s sys 0.006s
I20260928 20:02:40.645186 26740 leader_election.cc:304] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:40.694572 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4604b0cf7e56457086383c4314814b21" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:40.679769 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 0a2d13d16d9946c6b09f9197c165033c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a2d13d16d9946c6b09f9197c165033c already in progress: creating tablet
I20260928 20:02:40.694572 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:40.695494 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 59806.1us
I20260928 20:02:40.696247 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
W20260928 20:02:40.697224 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 52561.5us
I20260928 20:02:40.697786 26227 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:40.701000 26490 tablet_service.cc:1511] Processing CreateTablet for tablet d8d27cbf353246fbb7fe09f385194d8a (DEFAULT_TABLE table=default.Table_5b3bc03525cd48b7b3c9e4323c0206dd [id=e9cf8c7bf50d427c832e7a7d884f6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.702163 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d27cbf353246fbb7fe09f385194d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.702625 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 91b11022fc774d18b92e0c694f834375 (DEFAULT_TABLE table=default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.703485 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b11022fc774d18b92e0c694f834375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.706539 26658 raft_consensus.cc:2468] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:40.715004 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25 (DEFAULT_TABLE table=default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 [id=6fc28fd5258c423ab0cf022d50525caf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.729450 26773 tablet_service.cc:1511] Processing CreateTablet for tablet d8d27cbf353246fbb7fe09f385194d8a (DEFAULT_TABLE table=default.Table_5b3bc03525cd48b7b3c9e4323c0206dd [id=e9cf8c7bf50d427c832e7a7d884f6190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.729651 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:40.730401 26512 raft_consensus.cc:2393] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:40.731145 26638 tablet_service.cc:1511] Processing CreateTablet for tablet d8d27cbf353246fbb7fe09f385194d8a (DEFAULT_TABLE table=default.Table_5b3bc03525cd48b7b3c9e4323c0206dd [id=e9cf8c7bf50d427c832e7a7d884f6190]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:40.731302 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 0a2d13d16d9946c6b09f9197c165033c because the tablet was not found. No further retry: Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c
I20260928 20:02:40.730638 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d27cbf353246fbb7fe09f385194d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.697746 27534 raft_consensus.cc:2749] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:40.738023 26233 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c] alter complete (version 1)
I20260928 20:02:40.698287 27318 leader_election.cc:290] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:40.708045 26739 leader_election.cc:304] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:40.752611 26740 leader_election.cc:343] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21
I20260928 20:02:40.777181 27536 consensus_queue.cc:1048] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:40.782491 27495 consensus_queue.cc:1048] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260928 20:02:40.753430 27527 consensus_queue.cc:1048] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.075s
I20260928 20:02:40.788336 26652 raft_consensus.cc:2393] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:02:40.791818 26916 tablet_bootstrap.cc:492] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:40.792399 26916 ts_tablet_manager.cc:1449] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.478s user 0.011s sys 0.000s
I20260928 20:02:40.793048 26739 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:40.799431 27318 raft_consensus.cc:3060] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:40.775866 27534 raft_consensus.cc:2804] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:40.805291 27534 raft_consensus.cc:493] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:40.810456 26487 tablet_service.cc:1511] Processing CreateTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f (DEFAULT_TABLE table=default.Table_fa816eb9f57a489f807cdadfb66680b9 [id=d89268285ef14f5dbd9e5d503ecba72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.794734 26916 raft_consensus.cc:359] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.826201 26916 raft_consensus.cc:385] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.826613 26916 raft_consensus.cc:740] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:40.827461 26916 consensus_queue.cc:260] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.834738 26916 ts_tablet_manager.cc:1480] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20260928 20:02:40.807173 26912 tablet_bootstrap.cc:492] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:40.835717 26912 ts_tablet_manager.cc:1449] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.335s user 0.008s sys 0.002s
I20260928 20:02:40.838835 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 91b11022fc774d18b92e0c694f834375 (DEFAULT_TABLE table=default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.839950 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b11022fc774d18b92e0c694f834375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.843128 26783 tablet_service.cc:1511] Processing CreateTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f (DEFAULT_TABLE table=default.Table_fa816eb9f57a489f807cdadfb66680b9 [id=d89268285ef14f5dbd9e5d503ecba72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.844354 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e8ff2ad1f745f88df6e471ed935f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.847512 26230 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:40.837356 27534 raft_consensus.cc:3060] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:40.859560 26483 tablet_service.cc:1511] Processing CreateTablet for tablet fa49943f465f47778ac985cb5f4e6c0f (DEFAULT_TABLE table=default.Table_0ec120567bd34b25a3d9557552e911ea [id=1d18dd75f3d34be3a2e195cf8bed408b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.862196 26230 catalog_manager.cc:5838] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:40.866478 26916 tablet_bootstrap.cc:492] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:40.880534 26493 tablet_service.cc:1511] Processing CreateTablet for tablet a8b15d2c55d94e64b75da8089a68b6e1 (DEFAULT_TABLE table=default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f [id=6ded8787f37141558c95545a1da78a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.882213 26230 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:40.883327 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.890533 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d27cbf353246fbb7fe09f385194d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.893707 26782 tablet_service.cc:1511] Processing CreateTablet for tablet a8b15d2c55d94e64b75da8089a68b6e1 (DEFAULT_TABLE table=default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f [id=6ded8787f37141558c95545a1da78a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:40.894665 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b15d2c55d94e64b75da8089a68b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.894529 26230 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:40.895087 26230 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:40.899866 26234 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8] alter complete (version 1)
I20260928 20:02:40.910583 26236 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_841f8694539d49ad85dd21d2f74da8f7 [id=785cc43f9b7d4d02aa025ab9ec645ce1] alter complete (version 1)
I20260928 20:02:40.918893 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_402a55b920da45e884c1b48742a7e424 [id=bfbc8f3e5a924682a1dd0a5996898e28] alter complete (version 2)
I20260928 20:02:40.921876 26913 raft_consensus.cc:359] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.922720 26913 raft_consensus.cc:385] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:40.923182 26913 raft_consensus.cc:740] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:02:40.926066 26228 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 49) took 3555 ms (client timeout 1000 ms). Trace:
W20260928 20:02:40.926566 26228 rpcz_store.cc:269] 0928 20:02:37.370849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:37.545364 (+174515us) service_pool.cc:224] Handling call
0928 20:02:37.588658 (+ 43294us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:40.925991 (+3337333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:38.543200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:38.543706 (+ 506us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:38.543742 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:38.543762 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:38.544031 (+ 269us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:38.544063 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:38.544084 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:38.544214 (+ 130us) tablet.cc:701] Row locks acquired
0928 20:02:38.544227 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:38.544330 (+ 103us) write_op.cc:270] Start()
0928 20:02:38.544409 (+ 79us) write_op.cc:276] Timestamp: P: 1790625758544257 usec, L: 0
0928 20:02:38.544422 (+ 13us) op_driver.cc:348] REPLICATION: starting
0928 20:02:38.606217 (+ 61795us) log.cc:844] Serialized 356 byte log entry
0928 20:02:38.653521 (+ 47304us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:38.876786 (+223265us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.877093 (+ 307us) write_op.cc:301] APPLY: starting
0928 20:02:38.877163 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.877287 (+ 124us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.877316 (+ 29us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.877510 (+ 194us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.877685 (+ 175us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:38.877761 (+ 76us) write_op.cc:312] APPLY: finished
0928 20:02:38.877987 (+ 226us) log.cc:844] Serialized 23 byte log entry
0928 20:02:38.878193 (+ 206us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.878272 (+ 79us) write_op.cc:454] Released schema lock
0928 20:02:38.878313 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":48655616,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":1444,"apply.run_wall_time_us":1444,"num_ops":1,"prepare.queue_time_us":59577,"prepare.run_cpu_time_us":3886,"prepare.run_wall_time_us":118182,"raft.queue_time_us":2369,"raft.run_cpu_time_us":13,"raft.run_wall_time_us":15,"replication_time_us":332249,"spinlock_wait_cycles":140934016}]]}
I20260928 20:02:40.931991 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e8ff2ad1f745f88df6e471ed935f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.933364 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b15d2c55d94e64b75da8089a68b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:40.924124 26913 consensus_queue.cc:260] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.934361 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a443f94d7c7c4e60b56e3c9fdebecac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:40.936864 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a443f94d7c7c4e60b56e3c9fdebecac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:40.938390 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa49943f465f47778ac985cb5f4e6c0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:40.962673 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 230206us
I20260928 20:02:40.967717 26913 ts_tablet_manager.cc:1480] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.274s user 0.009s sys 0.000s
I20260928 20:02:40.972164 26913 tablet_bootstrap.cc:492] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:40.984458 27534 raft_consensus.cc:515] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:40.963506 26595 leader_election.cc:304] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:40.995049 27526 raft_consensus.cc:2749] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.005584 26916 tablet_bootstrap.cc:654] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:40.986258 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:40.986701 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 03370aeac73549a195a16382aa6f9de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 718a2abfe21b4a2986b77e14e4e52152) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:40.987881 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:40.988751 27536 raft_consensus.cc:493] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:40.990350 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 197380us
W20260928 20:02:41.023756 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 because the tablet was not found. No further retry: Not found: Tablet not found: bd70ba6c0f1b43fcaa37bce4bf87a5e6
I20260928 20:02:41.024117 27536 raft_consensus.cc:515] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.026079 27536 leader_election.cc:290] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.033661 26775 tablet_service.cc:1511] Processing CreateTablet for tablet fa49943f465f47778ac985cb5f4e6c0f (DEFAULT_TABLE table=default.Table_0ec120567bd34b25a3d9557552e911ea [id=1d18dd75f3d34be3a2e195cf8bed408b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.034763 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa49943f465f47778ac985cb5f4e6c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.051596 27476 raft_consensus.cc:493] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.052217 27476 raft_consensus.cc:515] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.059027 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:41.059641 26511 raft_consensus.cc:2468] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:41.061276 26740 leader_election.cc:304] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:41.070511 27536 raft_consensus.cc:2804] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:41.070979 27536 raft_consensus.cc:493] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:41.071365 27536 raft_consensus.cc:3060] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.091325 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.098011 26740 leader_election.cc:343] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21
W20260928 20:02:41.101536 26234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 49) took 3127 ms (client timeout 1000 ms). Trace:
I20260928 20:02:41.111994 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:41.112916 27531 tablet_replica.cc:333] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:41.112859 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:41.113500 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:41.114282 27531 raft_consensus.cc:2243] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.114488 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:41.114756 27531 raft_consensus.cc:2272] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:41.115618 26739 leader_election.cc:343] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.116487 27531 ts_tablet_manager.cc:1962] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:41.118793 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 67) took 3431 ms (client timeout 1000 ms). Trace:
I20260928 20:02:41.119982 27534 leader_election.cc:290] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:41.119318 26233 rpcz_store.cc:269] 0928 20:02:37.686911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:37.687032 (+ 121us) service_pool.cc:224] Handling call
0928 20:02:41.118713 (+3431681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:38.669707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:38.670652 (+ 945us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:38.670719 (+ 67us) write_op.cc:435] Acquired schema lock
0928 20:02:38.670771 (+ 52us) tablet.cc:662] Decoding operations
0928 20:02:38.671473 (+ 702us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:38.671552 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:38.671613 (+ 61us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:38.671961 (+ 348us) tablet.cc:701] Row locks acquired
0928 20:02:38.672022 (+ 61us) write_op.cc:260] PREPARE: finished
0928 20:02:38.672294 (+ 272us) write_op.cc:270] Start()
0928 20:02:38.672500 (+ 206us) write_op.cc:276] Timestamp: P: 1790625758672216 usec, L: 0
0928 20:02:38.672518 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:38.673830 (+ 1312us) log.cc:844] Serialized 356 byte log entry
0928 20:02:38.879682 (+205852us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.879957 (+ 275us) write_op.cc:301] APPLY: starting
0928 20:02:38.880022 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.880161 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.880272 (+ 111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.880496 (+ 224us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.880661 (+ 165us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:38.880725 (+ 64us) write_op.cc:312] APPLY: finished
0928 20:02:38.880946 (+ 221us) log.cc:844] Serialized 23 byte log entry
0928 20:02:38.881119 (+ 173us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.881192 (+ 73us) write_op.cc:454] Released schema lock
0928 20:02:38.881232 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":1503,"apply.run_wall_time_us":1504,"num_ops":1,"prepare.queue_time_us":157215,"prepare.run_cpu_time_us":2938,"prepare.run_wall_time_us":80889,"raft.queue_time_us":74655,"raft.run_cpu_time_us":17,"raft.run_wall_time_us":18,"replication_time_us":207054}]]}
I20260928 20:02:41.126677 27536 raft_consensus.cc:515] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.129999 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:41.130623 26511 raft_consensus.cc:3060] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:41.136902 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 50) took 2143 ms (client timeout 1000 ms). Trace:
I20260928 20:02:41.138062 26511 raft_consensus.cc:2468] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:41.139273 26740 leader_election.cc:304] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:41.140056 27557 raft_consensus.cc:2804] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:41.140498 27557 raft_consensus.cc:697] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:41.141305 27557 consensus_queue.cc:237] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.154069 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4604b0cf7e56457086383c4314814b21" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:41.154726 26652 raft_consensus.cc:3060] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.159051 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:41.164227 26652 raft_consensus.cc:2468] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:41.165274 27531 ts_tablet_manager.cc:1975] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 20:02:41.165357 26232 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 50) took 2786 ms (client timeout 1000 ms). Trace:
W20260928 20:02:41.165799 26232 rpcz_store.cc:269] 0928 20:02:38.379410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:38.379556 (+ 146us) service_pool.cc:224] Handling call
0928 20:02:38.431959 (+ 52403us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:41.165254 (+2733295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54232,"reported_tablets":12,"spinlock_wait_cycles":115414272}
I20260928 20:02:41.168215 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:41.168798 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:41.169349 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:41.173848 26229 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 272) took 1810 ms. Trace:
I20260928 20:02:41.174273 26229 rpcz_store.cc:276] 0928 20:02:39.364028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:39.364162 (+ 134us) service_pool.cc:224] Handling call
0928 20:02:39.365030 (+ 868us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:40.922817 (+1557787us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:41.031558 (+108741us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:41.031776 (+ 218us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:41.093274 (+ 61498us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:41.173779 (+ 80505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:41.033323 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:41.033813 (+ 490us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:41.033849 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:41.033869 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:41.034207 (+ 338us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:41.034263 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:41.034296 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:41.034474 (+ 178us) tablet.cc:701] Row locks acquired
0928 20:02:41.034493 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:41.034618 (+ 125us) write_op.cc:270] Start()
0928 20:02:41.034718 (+ 100us) write_op.cc:276] Timestamp: P: 1790625761034537 usec, L: 0
0928 20:02:41.034741 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:02:41.035341 (+ 600us) log.cc:844] Serialized 405 byte log entry
0928 20:02:41.082400 (+ 47059us) op_driver.cc:464] REPLICATION: finished
0928 20:02:41.082782 (+ 382us) write_op.cc:301] APPLY: starting
0928 20:02:41.082836 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:41.082924 (+ 88us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:41.083025 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:41.083196 (+ 171us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:41.083346 (+ 150us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:41.083415 (+ 69us) write_op.cc:312] APPLY: finished
0928 20:02:41.083631 (+ 216us) log.cc:844] Serialized 23 byte log entry
0928 20:02:41.083825 (+ 194us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:41.083905 (+ 80us) write_op.cc:454] Released schema lock
0928 20:02:41.083947 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:41.084242 (+ 295us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:41.084278 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59861,"child_traces":[["op",{"apply.queue_time_us":240,"apply.run_cpu_time_us":1396,"apply.run_wall_time_us":1396,"num_ops":1,"prepare.queue_time_us":390,"prepare.run_cpu_time_us":2358,"prepare.run_wall_time_us":2359,"raft.queue_time_us":30254,"raft.run_cpu_time_us":897,"raft.run_wall_time_us":899,"replication_time_us":47564}]]}
I20260928 20:02:41.180930 26228 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 278) took 1591 ms. Trace:
I20260928 20:02:41.183307 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:41.181324 26228 rpcz_store.cc:276] 0928 20:02:39.589387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:40.933740 (+1344353us) service_pool.cc:224] Handling call
0928 20:02:41.031790 (+ 98050us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:41.033182 (+ 1392us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:41.180377 (+147195us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:41.180640 (+ 263us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:41.180876 (+ 236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:41.035797 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:41.036275 (+ 478us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:41.036309 (+ 34us) write_op.cc:435] Acquired schema lock
0928 20:02:41.036330 (+ 21us) tablet.cc:662] Decoding operations
0928 20:02:41.036644 (+ 314us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:41.036805 (+ 161us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:41.036842 (+ 37us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:41.037092 (+ 250us) tablet.cc:701] Row locks acquired
0928 20:02:41.037111 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:41.037229 (+ 118us) write_op.cc:270] Start()
0928 20:02:41.037336 (+ 107us) write_op.cc:276] Timestamp: P: 1790625761037151 usec, L: 0
0928 20:02:41.037357 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:41.037889 (+ 532us) log.cc:844] Serialized 433 byte log entry
0928 20:02:41.084492 (+ 46603us) op_driver.cc:464] REPLICATION: finished
0928 20:02:41.088984 (+ 4492us) write_op.cc:301] APPLY: starting
0928 20:02:41.089058 (+ 74us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:41.089183 (+ 125us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:41.089288 (+ 105us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:41.089743 (+ 455us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:41.089910 (+ 167us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:41.089979 (+ 69us) write_op.cc:312] APPLY: finished
0928 20:02:41.090199 (+ 220us) log.cc:844] Serialized 29 byte log entry
0928 20:02:41.090355 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:41.090436 (+ 81us) write_op.cc:454] Released schema lock
0928 20:02:41.090473 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:41.090727 (+ 254us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:41.090761 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4311,"apply.run_cpu_time_us":1703,"apply.run_wall_time_us":1703,"num_ops":2,"prepare.queue_time_us":1409,"prepare.run_cpu_time_us":2360,"prepare.run_wall_time_us":32115,"raft.queue_time_us":28779,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":13,"replication_time_us":45194}]]}
I20260928 20:02:41.185101 27531 log.cc:1199] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/fa037333676c4dba93160c5e3337f891
I20260928 20:02:41.185802 26739 leader_election.cc:304] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:41.186980 27531 ts_tablet_manager.cc:1996] T fa037333676c4dba93160c5e3337f891 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:41.188028 27551 raft_consensus.cc:2804] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:02:41.189292 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 51) took 1793 ms (client timeout 1000 ms). Trace:
I20260928 20:02:41.199250 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:41.199870 26916 tablet_bootstrap.cc:492] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:41.200356 26916 ts_tablet_manager.cc:1449] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.334s user 0.011s sys 0.000s
I20260928 20:02:41.203138 26916 raft_consensus.cc:359] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.203881 26916 raft_consensus.cc:385] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.204254 26916 raft_consensus.cc:740] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.205138 26916 consensus_queue.cc:260] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:41.101960 26234 rpcz_store.cc:269] 0928 20:02:37.974083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:38.152052 (+177969us) service_pool.cc:224] Handling call
0928 20:02:38.284661 (+132609us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:41.101456 (+2816795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:38.750686 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:38.751187 (+ 501us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:38.751222 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:02:38.751242 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:38.751620 (+ 378us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:38.751670 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:38.751703 (+ 33us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:38.752040 (+ 337us) tablet.cc:701] Row locks acquired
0928 20:02:38.752058 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:02:38.752189 (+ 131us) write_op.cc:270] Start()
0928 20:02:38.752289 (+ 100us) write_op.cc:276] Timestamp: P: 1790625758752135 usec, L: 0
0928 20:02:38.752310 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:38.752939 (+ 629us) log.cc:844] Serialized 919 byte log entry
0928 20:02:38.882856 (+129917us) op_driver.cc:464] REPLICATION: finished
0928 20:02:38.883128 (+ 272us) write_op.cc:301] APPLY: starting
0928 20:02:38.883196 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:38.883361 (+ 165us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:38.883497 (+ 136us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:38.883772 (+ 275us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:38.883949 (+ 177us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:38.884012 (+ 63us) write_op.cc:312] APPLY: finished
0928 20:02:38.884220 (+ 208us) log.cc:844] Serialized 29 byte log entry
0928 20:02:38.885209 (+ 989us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:38.885300 (+ 91us) write_op.cc:454] Released schema lock
0928 20:02:38.885363 (+ 63us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 20:02:40.743494 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:40.744010 (+ 516us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:40.744046 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:40.744066 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:40.744392 (+ 326us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:40.744449 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:40.744483 (+ 34us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:40.744670 (+ 187us) tablet.cc:701] Row locks acquired
0928 20:02:40.744690 (+ 20us) write_op.cc:260] PREPARE: finished
0928 20:02:40.744845 (+ 155us) write_op.cc:270] Start()
0928 20:02:40.744953 (+ 108us) write_op.cc:276] Timestamp: P: 1790625760744783 usec, L: 0
0928 20:02:40.744976 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:02:40.745625 (+ 649us) log.cc:844] Serialized 356 byte log entry
0928 20:02:40.754096 (+ 8471us) op_driver.cc:464] REPLICATION: finished
0928 20:02:40.754607 (+ 511us) write_op.cc:301] APPLY: starting
0928 20:02:40.754664 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:40.754759 (+ 95us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:40.754848 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:40.755025 (+ 177us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:40.755184 (+ 159us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:40.755226 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:40.755394 (+ 168us) log.cc:844] Serialized 23 byte log entry
0928 20:02:40.755540 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:40.755608 (+ 68us) write_op.cc:454] Released schema lock
0928 20:02:40.755645 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:40.755868 (+ 223us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:40.755892 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61,"reported_tablets":13,"spinlock_wait_cycles":299717888,"child_traces":[["op",{"apply.queue_time_us":110,"apply.run_cpu_time_us":1660,"apply.run_wall_time_us":3356,"num_ops":2,"prepare.queue_time_us":70431,"prepare.run_cpu_time_us":2589,"prepare.run_wall_time_us":4054,"raft.queue_time_us":94,"raft.run_cpu_time_us":17,"raft.run_wall_time_us":18,"replication_time_us":130441}],["op",{"apply.queue_time_us":320,"apply.run_cpu_time_us":1233,"apply.run_wall_time_us":1233,"num_ops":1,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":2504,"prepare.run_wall_time_us":2504,"raft.queue_time_us":1251,"raft.run_cpu_time_us":920,"raft.run_wall_time_us":921,"replication_time_us":8994}]]}
I20260928 20:02:41.210230 26916 ts_tablet_manager.cc:1480] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260928 20:02:41.211617 26916 tablet_bootstrap.cc:492] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:41.213670 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:41.213927 26236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 68) took 2421 ms (client timeout 1000 ms). Trace:
I20260928 20:02:40.990557 27318 raft_consensus.cc:2749] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.021986 26912 raft_consensus.cc:359] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.023715 27530 tablet_replica.cc:333] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:41.217517 27530 raft_consensus.cc:2243] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.218070 27530 raft_consensus.cc:2272] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.220233 27530 ts_tablet_manager.cc:1962] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:41.222333 26912 raft_consensus.cc:385] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.222719 26912 raft_consensus.cc:740] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.223488 26912 consensus_queue.cc:260] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:41.236243 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 50547.2us
W20260928 20:02:41.237452 26739 leader_election.cc:343] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.245462 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 91b11022fc774d18b92e0c694f834375 (DEFAULT_TABLE table=default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.246670 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b11022fc774d18b92e0c694f834375. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.252609 27551 raft_consensus.cc:697] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:41.253805 27536 leader_election.cc:290] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.262357 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.224102 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:41.253378 27541 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 20:02:41.263908 26450 leader_election.cc:343] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.268901 26637 tablet_service.cc:1511] Processing CreateTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f (DEFAULT_TABLE table=default.Table_fa816eb9f57a489f807cdadfb66680b9 [id=d89268285ef14f5dbd9e5d503ecba72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.261451 27476 leader_election.cc:290] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.250995 27531 tablet_replica.cc:333] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:41.269843 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e8ff2ad1f745f88df6e471ed935f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.269651 26638 tablet_service.cc:1511] Processing CreateTablet for tablet fa49943f465f47778ac985cb5f4e6c0f (DEFAULT_TABLE table=default.Table_0ec120567bd34b25a3d9557552e911ea [id=1d18dd75f3d34be3a2e195cf8bed408b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.270509 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa49943f465f47778ac985cb5f4e6c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.270663 27531 raft_consensus.cc:2243] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.271167 27531 raft_consensus.cc:2272] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.272905 27551 consensus_queue.cc:237] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.226683 26912 ts_tablet_manager.cc:1480] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.391s user 0.011s sys 0.000s
I20260928 20:02:41.216090 27318 raft_consensus.cc:493] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.278412 27318 raft_consensus.cc:515] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:41.280737 27318 leader_election.cc:290] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.283818 26916 tablet_bootstrap.cc:654] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.287230 27531 ts_tablet_manager.cc:1962] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:41.288456 26740 leader_election.cc:343] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: afceff93f6f9401f94bab3e376925d12
I20260928 20:02:41.224624 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet fa037333676c4dba93160c5e3337f891 (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]) successfully deleted
W20260928 20:02:41.299373 27565 log.cc:927] Time spent T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.074s user 0.002s sys 0.000s
W20260928 20:02:41.302657 27564 log.cc:927] Time spent T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.076s user 0.000s sys 0.001s
I20260928 20:02:41.302855 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 with delete_type TABLET_DATA_DELETED (replaced by tablet d479a8eabc624569968515684e8acb0c) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:41.303061 26637 tablet_service.cc:1511] Processing CreateTablet for tablet a8b15d2c55d94e64b75da8089a68b6e1 (DEFAULT_TABLE table=default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f [id=6ded8787f37141558c95545a1da78a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.304308 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b15d2c55d94e64b75da8089a68b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.309499 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e7228a68b84f2aab2bfa582fa25ab8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:41.311079 26450 leader_election.cc:304] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:41.311115 27575 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:41.311693 26916 tablet_bootstrap.cc:492] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:41.311618 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afceff93f6f9401f94bab3e376925d12" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.312058 26916 ts_tablet_manager.cc:1449] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.002s
I20260928 20:02:41.312218 26657 raft_consensus.cc:2468] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:41.312467 27476 raft_consensus.cc:2749] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.317589 26739 leader_election.cc:304] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:41.319247 26916 raft_consensus.cc:359] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.319880 26916 raft_consensus.cc:385] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.320132 26916 raft_consensus.cc:740] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.324241 26912 tablet_bootstrap.cc:492] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:41.327754 26916 consensus_queue.cc:260] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.329264 26916 ts_tablet_manager.cc:1480] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.005s sys 0.001s
I20260928 20:02:41.330087 26916 tablet_bootstrap.cc:492] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:41.331437 27476 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.331841 27476 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.336465 27476 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.337934 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.339174 26450 leader_election.cc:343] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.340052 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:41.343194 26450 leader_election.cc:343] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.343590 26450 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:41.344223 27476 raft_consensus.cc:2749] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.347198 26912 tablet_bootstrap.cc:654] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.353915 26916 tablet_bootstrap.cc:654] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.356202 27531 ts_tablet_manager.cc:1975] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.356628 27531 log.cc:1199] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/946f215581734bf591ab05502e5ff4a0
I20260928 20:02:41.357355 27531 ts_tablet_manager.cc:1996] T 946f215581734bf591ab05502e5ff4a0 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:41.360496 27531 tablet_replica.cc:333] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:41.360574 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:41.361475 27531 raft_consensus.cc:2243] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.362018 27531 raft_consensus.cc:2272] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.365041 27531 ts_tablet_manager.cc:1962] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:41.371531 27577 tablet_replica.cc:333] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:41.372406 27577 raft_consensus.cc:2243] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.372848 27577 raft_consensus.cc:2272] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.374235 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:41.375239 27577 ts_tablet_manager.cc:1962] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:41.381253 27578 tablet.cc:1751] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:41.392206 27575 tablet.cc:1751] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:41.401059 27549 raft_consensus.cc:2804] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:41.401441 27549 raft_consensus.cc:493] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:41.401748 27549 raft_consensus.cc:3060] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.406481 27577 ts_tablet_manager.cc:1975] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.410616 27577 log.cc:1199] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/afceff93f6f9401f94bab3e376925d12
I20260928 20:02:41.412097 27577 ts_tablet_manager.cc:1996] T afceff93f6f9401f94bab3e376925d12 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:41.424937 27577 tablet_replica.cc:333] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:41.428612 27577 raft_consensus.cc:2243] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.430799 26916 tablet_bootstrap.cc:492] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:41.431149 27476 raft_consensus.cc:493] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.431291 26916 ts_tablet_manager.cc:1449] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.101s user 0.010s sys 0.016s
I20260928 20:02:41.431568 27476 raft_consensus.cc:515] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.434495 27577 raft_consensus.cc:2272] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.427632 27580 tablet.cc:1751] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:41.435376 27476 leader_election.cc:290] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.436753 27577 ts_tablet_manager.cc:1962] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:41.433616 26916 raft_consensus.cc:359] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.437356 26916 raft_consensus.cc:385] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.437721 26916 raft_consensus.cc:740] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.438522 26916 consensus_queue.cc:260] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.439317 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:41.441529 26450 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.452035 27549 raft_consensus.cc:515] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:41.452534 26913 tablet_bootstrap.cc:654] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.457386 26912 tablet_bootstrap.cc:492] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:41.457976 26912 ts_tablet_manager.cc:1449] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.135s user 0.015s sys 0.001s
I20260928 20:02:41.460163 26912 raft_consensus.cc:359] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.460767 26912 raft_consensus.cc:385] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.461907 27530 ts_tablet_manager.cc:1975] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.464962 27526 consensus_queue.cc:1048] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:41.466526 27530 log.cc:1199] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/d374d592fda8402faac70a923049c9ad
I20260928 20:02:41.467352 27530 ts_tablet_manager.cc:1996] T d374d592fda8402faac70a923049c9ad P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:41.466095 27549 leader_election.cc:290] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.461006 26912 raft_consensus.cc:740] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:41.468353 26739 leader_election.cc:343] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: afceff93f6f9401f94bab3e376925d12
I20260928 20:02:41.468926 26912 consensus_queue.cc:260] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.469730 26916 ts_tablet_manager.cc:1480] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20260928 20:02:41.470649 26916 tablet_bootstrap.cc:492] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:41.473968 26912 ts_tablet_manager.cc:1480] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.016s user 0.004s sys 0.001s
W20260928 20:02:41.475870 26740 leader_election.cc:343] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: afceff93f6f9401f94bab3e376925d12
I20260928 20:02:41.476287 26740 leader_election.cc:304] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:41.481241 27549 raft_consensus.cc:2749] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.481911 27526 raft_consensus.cc:493] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.482340 27526 raft_consensus.cc:515] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.483063 26916 tablet_bootstrap.cc:654] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.484270 27526 leader_election.cc:290] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.485023 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0acdca2ff4dfc9ae5ddc97d7aab24" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:41.485560 26803 raft_consensus.cc:2468] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:41.485575 27577 ts_tablet_manager.cc:1975] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.485939 27577 log.cc:1199] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/4604b0cf7e56457086383c4314814b21
I20260928 20:02:41.488618 27530 tablet_replica.cc:333] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:41.490849 26912 tablet_bootstrap.cc:492] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:41.495623 27476 raft_consensus.cc:493] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.489938 27530 raft_consensus.cc:2243] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.496025 27517 raft_consensus.cc:493] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.496390 27530 raft_consensus.cc:2272] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.496085 27476 raft_consensus.cc:515] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.496466 27517 raft_consensus.cc:515] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.498620 27476 leader_election.cc:290] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.500357 27517 leader_election.cc:290] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.500334 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596a5540716441c49ec8185c8dc6a80c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:41.500694 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38abbc891d9c4268820cb0faba3d08b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:41.501538 26450 leader_election.cc:343] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:41.502804 26450 leader_election.cc:343] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.505632 27541 tablet.cc:1751] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:41.512482 27531 ts_tablet_manager.cc:1975] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.512935 27531 log.cc:1199] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:41.486449 26594 leader_election.cc:304] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:41.500065 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38abbc891d9c4268820cb0faba3d08b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.501691 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596a5540716441c49ec8185c8dc6a80c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.517120 27526 raft_consensus.cc:2804] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:41.517438 27526 raft_consensus.cc:493] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:41.517755 27526 raft_consensus.cc:3060] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.518283 27577 ts_tablet_manager.cc:1996] T 4604b0cf7e56457086383c4314814b21 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:41.513665 27531 ts_tablet_manager.cc:1996] T 8163815661694d70ba4c2e36a424eaa1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
W20260928 20:02:41.523172 26450 leader_election.cc:343] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.523633 26450 leader_election.cc:304] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:41.524309 27517 raft_consensus.cc:2749] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:41.524621 26450 leader_election.cc:343] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.506284 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.524981 26450 leader_election.cc:304] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:41.525796 27517 raft_consensus.cc:2749] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.528820 26912 tablet_bootstrap.cc:654] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.530217 27530 ts_tablet_manager.cc:1962] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:41.536648 26913 tablet_bootstrap.cc:492] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:41.538427 26913 ts_tablet_manager.cc:1449] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.567s user 0.013s sys 0.005s
I20260928 20:02:41.540881 26913 raft_consensus.cc:359] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:41.525943 26450 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.541541 26913 raft_consensus.cc:385] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.541810 26913 raft_consensus.cc:740] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.541915 26450 leader_election.cc:304] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:41.550021 26595 leader_election.cc:343] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24
W20260928 20:02:41.293849 26223 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 69256.8us
I20260928 20:02:41.562863 26912 tablet_bootstrap.cc:492] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:41.563380 26912 ts_tablet_manager.cc:1449] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.009s
I20260928 20:02:41.565774 26912 raft_consensus.cc:359] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.570799 26912 raft_consensus.cc:385] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.571060 26912 raft_consensus.cc:740] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.577975 26912 consensus_queue.cc:260] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.583087 26912 ts_tablet_manager.cc:1480] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260928 20:02:41.589565 26912 tablet_bootstrap.cc:492] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:41.555531 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 16796100116a4fe4a64893f49fb1cad4 consensus state has no leader
I20260928 20:02:41.595469 27530 ts_tablet_manager.cc:1975] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.595824 27530 log.cc:1199] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/03370aeac73549a195a16382aa6f9de3
I20260928 20:02:41.596633 27530 ts_tablet_manager.cc:1996] T 03370aeac73549a195a16382aa6f9de3 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:02:41.559388 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 because the tablet was not found. No further retry: Not found: Tablet not found: bd70ba6c0f1b43fcaa37bce4bf87a5e6
W20260928 20:02:41.603091 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 43914.9us
I20260928 20:02:41.604592 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet afceff93f6f9401f94bab3e376925d12 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]) successfully deleted
I20260928 20:02:41.606217 26912 tablet_bootstrap.cc:654] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.607739 27549 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.608126 27549 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.609941 27549 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.614817 27530 tablet_replica.cc:333] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:41.616233 27530 raft_consensus.cc:2243] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.618422 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 4604b0cf7e56457086383c4314814b21 (table default.Table_8be4bac0846045f1b0438d588fe17c76 [id=b89fadac9a1245d9a401cab84a9d7c90]) successfully deleted
I20260928 20:02:41.618510 27530 raft_consensus.cc:2272] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.621196 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet d374d592fda8402faac70a923049c9ad (table default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]) successfully deleted
I20260928 20:02:41.564296 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0cc6e9ab6483451aadcf7beddfa7058a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:41.622551 27530 ts_tablet_manager.cc:1962] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:41.622974 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cc6e9ab6483451aadcf7beddfa7058a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:41.346390 26229 master_service.cc:960] ReplaceTablet: received request to replace tablet aa4f373a46de433eabd3b35b6ed3d1e3 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:41.626518 26229 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 281) took 1220 ms. Trace:
I20260928 20:02:41.626955 26229 rpcz_store.cc:276] 0928 20:02:40.406274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.346279 (+940005us) service_pool.cc:224] Handling call
0928 20:02:41.626289 (+280010us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:02:41.189682 26231 rpcz_store.cc:269] 0928 20:02:39.395577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:39.395675 (+ 98us) service_pool.cc:224] Handling call
0928 20:02:41.189208 (+1793533us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":17}
I20260928 20:02:41.630872 26231 master_service.cc:960] ReplaceTablet: received request to replace tablet bd3fa371924149fb814c8458488aea61 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:41.631891 26912 tablet_bootstrap.cc:492] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:41.628804 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7a934c9d12fa42cd818bc13a48bfd4ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:41.632354 26912 ts_tablet_manager.cc:1449] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.001s
W20260928 20:02:41.635749 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a934c9d12fa42cd818bc13a48bfd4ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:41.354074 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_060bc0393e4d45c2a1ef08a71894f56d" } modify_external_catalogs: true
W20260928 20:02:41.142274 26235 rpcz_store.cc:269] 0928 20:02:38.993605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:39.159701 (+166096us) service_pool.cc:224] Handling call
0928 20:02:39.210635 (+ 50934us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:41.136815 (+1926180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:40.202449 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:40.202843 (+ 394us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:40.202869 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:40.202882 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:40.203143 (+ 261us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:40.203182 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:40.203207 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:40.203353 (+ 146us) tablet.cc:701] Row locks acquired
0928 20:02:40.203372 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:40.203484 (+ 112us) write_op.cc:270] Start()
0928 20:02:40.203599 (+ 115us) write_op.cc:276] Timestamp: P: 1790625760203436 usec, L: 0
0928 20:02:40.203617 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:40.208614 (+ 4997us) log.cc:844] Serialized 536 byte log entry
0928 20:02:40.209929 (+ 1315us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:40.220026 (+ 10097us) op_driver.cc:464] REPLICATION: finished
0928 20:02:40.220518 (+ 492us) write_op.cc:301] APPLY: starting
0928 20:02:40.220608 (+ 90us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:40.220764 (+ 156us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:40.220796 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:40.221061 (+ 265us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:40.221264 (+ 203us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:40.221336 (+ 72us) write_op.cc:312] APPLY: finished
0928 20:02:40.221647 (+ 311us) log.cc:844] Serialized 23 byte log entry
0928 20:02:40.221861 (+ 214us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:40.221965 (+ 104us) write_op.cc:454] Released schema lock
0928 20:02:40.222014 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:40.222361 (+ 347us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:40.222388 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1863,"reported_tablets":16,"spinlock_wait_cycles":111191424,"child_traces":[["op",{"apply.queue_time_us":254,"apply.run_cpu_time_us":1800,"apply.run_wall_time_us":1799,"num_ops":1,"prepare.queue_time_us":354526,"prepare.run_cpu_time_us":3438,"prepare.run_wall_time_us":7706,"raft.queue_time_us":90,"raft.run_cpu_time_us":740,"raft.run_wall_time_us":1767,"replication_time_us":16256,"spinlock_wait_cycles":10246016}]]}
I20260928 20:02:41.639518 26912 raft_consensus.cc:359] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.641366 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_51d3ebaa7ade42cb81c42d1ff48266b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:41.643321 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51d3ebaa7ade42cb81c42d1ff48266b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:41.640435 26912 raft_consensus.cc:385] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.648162 26912 raft_consensus.cc:740] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.648782 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_060bc0393e4d45c2a1ef08a71894f56d" } modify_external_catalogs: true
I20260928 20:02:41.650169 26912 consensus_queue.cc:260] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.656131 26912 ts_tablet_manager.cc:1480] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.024s user 0.008s sys 0.000s
I20260928 20:02:41.662803 26912 tablet_bootstrap.cc:492] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:41.680763 26912 tablet_bootstrap.cc:654] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.681726 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.683604 26739 leader_election.cc:343] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:41.684713 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 63557.4us
I20260928 20:02:41.684779 27530 ts_tablet_manager.cc:1975] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:41.685325 27530 log.cc:1199] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:41.685964 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 03370aeac73549a195a16382aa6f9de3 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]) successfully deleted
W20260928 20:02:41.686993 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 because the tablet was not found. No further retry: Not found: Tablet not found: bd70ba6c0f1b43fcaa37bce4bf87a5e6
W20260928 20:02:41.294361 26236 rpcz_store.cc:269] 0928 20:02:38.792664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:38.850787 (+ 58123us) service_pool.cc:224] Handling call
0928 20:02:38.998539 (+147752us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:41.213846 (+2215307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:39.981679 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:39.982139 (+ 460us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:39.982169 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:02:39.982186 (+ 17us) tablet.cc:662] Decoding operations
0928 20:02:39.982472 (+ 286us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:39.982515 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:39.982544 (+ 29us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:40.038436 (+ 55892us) tablet.cc:701] Row locks acquired
0928 20:02:40.038450 (+ 14us) write_op.cc:260] PREPARE: finished
0928 20:02:40.038585 (+ 135us) write_op.cc:270] Start()
0928 20:02:40.038684 (+ 99us) write_op.cc:276] Timestamp: P: 1790625760038495 usec, L: 0
0928 20:02:40.038704 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 20:02:40.054311 (+ 15607us) log.cc:844] Serialized 356 byte log entry
0928 20:02:40.087623 (+ 33312us) op_driver.cc:464] REPLICATION: finished
0928 20:02:40.088198 (+ 575us) write_op.cc:301] APPLY: starting
0928 20:02:40.088290 (+ 92us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:40.088429 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:40.088566 (+ 137us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:40.088832 (+ 266us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:40.089034 (+ 202us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:40.089119 (+ 85us) write_op.cc:312] APPLY: finished
0928 20:02:40.089383 (+ 264us) log.cc:844] Serialized 23 byte log entry
0928 20:02:40.089632 (+ 249us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:40.089727 (+ 95us) write_op.cc:454] Released schema lock
0928 20:02:40.089775 (+ 48us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:40.090141 (+ 366us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:40.090172 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":21,"spinlock_wait_cycles":85777152,"child_traces":[["op",{"apply.queue_time_us":362,"apply.run_cpu_time_us":1850,"apply.run_wall_time_us":1849,"num_ops":1,"prepare.queue_time_us":400405,"prepare.run_cpu_time_us":2352,"prepare.run_wall_time_us":79385,"raft.queue_time_us":338,"raft.run_cpu_time_us":774,"raft.run_wall_time_us":774,"replication_time_us":48773}]]}
W20260928 20:02:41.561980 26227 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 69) took 1543 ms (client timeout 1000 ms). Trace:
W20260928 20:02:41.690986 26227 rpcz_store.cc:269] 0928 20:02:40.018779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:40.207321 (+188542us) service_pool.cc:224] Handling call
0928 20:02:41.561735 (+1354414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3978,"reported_tablets":23}
W20260928 20:02:41.698208 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet bd70ba6c0f1b43fcaa37bce4bf87a5e6 because the tablet was not found. No further retry: Not found: Tablet not found: bd70ba6c0f1b43fcaa37bce4bf87a5e6
I20260928 20:02:41.699200 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 946f215581734bf591ab05502e5ff4a0 (table default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd [id=78b4f1c42b7347169b12fd63aad7323e]) successfully deleted
I20260928 20:02:41.700398 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 8163815661694d70ba4c2e36a424eaa1 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]) successfully deleted
I20260928 20:02:41.702976 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_666ecf839a52492eaf418528a9d9f2cb" } new_table_name: "default.Table_be6662ebcd184f55b04530bf6cab44a6" modify_external_catalogs: true
I20260928 20:02:41.704079 27530 ts_tablet_manager.cc:1996] T cb970d91179e48cdbbb1e32a3ca3171c P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:02:41.706964 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 159010us
I20260928 20:02:41.537225 27531 tablet_replica.cc:333] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:41.710942 27517 raft_consensus.cc:2749] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.731031 27476 raft_consensus.cc:493] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.731673 27476 raft_consensus.cc:515] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:41.734181 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:41.734965 26511 raft_consensus.cc:2468] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:41.736783 26740 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:41.739604 27476 leader_election.cc:290] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:41.739765 27549 raft_consensus.cc:2804] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:41.740247 27549 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:41.740695 27549 raft_consensus.cc:3060] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.741334 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70df4ddf0f9430980c967d798ed6c50" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:41.743088 26450 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.750562 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70df4ddf0f9430980c967d798ed6c50" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.754060 26450 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.754703 26450 leader_election.cc:304] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:41.755131 26916 tablet_bootstrap.cc:492] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:41.755555 26916 ts_tablet_manager.cc:1449] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.285s user 0.037s sys 0.087s
I20260928 20:02:41.756755 27476 raft_consensus.cc:2749] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.762868 26916 raft_consensus.cc:359] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.765658 26916 raft_consensus.cc:385] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.765918 26916 raft_consensus.cc:740] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.766670 26916 consensus_queue.cc:260] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.768018 26916 ts_tablet_manager.cc:1480] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260928 20:02:41.768826 26916 tablet_bootstrap.cc:492] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:41.769488 27526 raft_consensus.cc:515] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.772655 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0acdca2ff4dfc9ae5ddc97d7aab24" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:41.773236 26800 raft_consensus.cc:3060] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.778668 26913 consensus_queue.cc:260] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.779204 26916 tablet_bootstrap.cc:654] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:41.780429 26595 leader_election.cc:343] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:41.794729 27531 raft_consensus.cc:2243] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.795017 26916 tablet_bootstrap.cc:492] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:41.795246 27531 raft_consensus.cc:2272] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:41.795397 26916 ts_tablet_manager.cc:1449] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.000s
I20260928 20:02:41.796089 26913 ts_tablet_manager.cc:1480] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.257s user 0.005s sys 0.000s
I20260928 20:02:41.796142 27551 raft_consensus.cc:493] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.796589 27551 raft_consensus.cc:515] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.798796 27551 leader_election.cc:290] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.800863 26913 tablet_bootstrap.cc:492] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:41.801183 26740 leader_election.cc:343] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa037333676c4dba93160c5e3337f891
I20260928 20:02:41.803550 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa037333676c4dba93160c5e3337f891" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.804354 26657 raft_consensus.cc:2468] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:41.806295 26739 leader_election.cc:304] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:41.807714 26916 raft_consensus.cc:359] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.808298 26916 raft_consensus.cc:385] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.808547 26916 raft_consensus.cc:740] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.808811 27531 ts_tablet_manager.cc:1962] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:41.809109 26916 consensus_queue.cc:260] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.813135 27551 raft_consensus.cc:2804] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:41.813476 27551 raft_consensus.cc:493] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:41.813792 27551 raft_consensus.cc:3060] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.814004 26916 ts_tablet_manager.cc:1480] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260928 20:02:41.814859 26916 tablet_bootstrap.cc:492] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:41.819274 27526 leader_election.cc:290] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.830358 26916 tablet_bootstrap.cc:654] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.865489 26916 tablet_bootstrap.cc:492] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:41.867309 27589 raft_consensus.cc:493] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.867815 27589 raft_consensus.cc:515] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.865929 26916 ts_tablet_manager.cc:1449] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.003s
I20260928 20:02:41.870654 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:41.872016 26450 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.872543 27557 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.789633 27549 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.873420 27557 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.873955 26916 raft_consensus.cc:359] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.878175 26916 raft_consensus.cc:385] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:41.878463 26916 raft_consensus.cc:740] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:41.879106 26916 consensus_queue.cc:260] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:41.884523 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.887326 26739 leader_election.cc:343] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.888016 27557 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.888940 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:41.894197 26916 ts_tablet_manager.cc:1480] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260928 20:02:41.896562 26916 tablet_bootstrap.cc:492] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:41.908143 27557 raft_consensus.cc:493] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.908982 26916 tablet_bootstrap.cc:654] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.889747 26512 raft_consensus.cc:2468] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:41.910696 26740 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:41.917932 27551 raft_consensus.cc:515] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.908905 27557 raft_consensus.cc:515] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.921406 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:41.922610 27557 leader_election.cc:290] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.923090 27557 raft_consensus.cc:2804] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:41.923401 27557 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:41.923704 27557 raft_consensus.cc:3060] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.924659 27551 leader_election.cc:290] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.923830 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:41.930536 26511 raft_consensus.cc:2468] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:41.932250 26512 raft_consensus.cc:3060] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:41.939196 27557 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.941125 27557 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.946194 27476 raft_consensus.cc:493] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.946722 27476 raft_consensus.cc:515] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.947316 26913 tablet_bootstrap.cc:654] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:41.924404 26800 raft_consensus.cc:2468] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:41.948762 27476 leader_election.cc:290] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:41.949641 27549 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:41.950404 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:41.952188 27530 tablet_replica.cc:333] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:02:41.952421 26450 leader_election.cc:343] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.953541 27530 raft_consensus.cc:2243] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:41.956126 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.957613 26450 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:41.958010 26450 leader_election.cc:304] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:41.958734 27476 raft_consensus.cc:2749] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:41.959129 27517 raft_consensus.cc:493] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:41.959769 27517 raft_consensus.cc:515] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.971073 27589 leader_election.cc:290] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:41.970245 26912 tablet_bootstrap.cc:492] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:41.971690 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d (DEFAULT_TABLE table=default.Table_29313cec5adc47e1af7bd7a25a0ce4ef [id=073a59d0af1e49fdb2b47f2530f7f65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.972676 26912 ts_tablet_manager.cc:1449] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.311s user 0.012s sys 0.001s
I20260928 20:02:41.972816 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292eef7bab904a7ea5ef6dbdaba1d37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.974349 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d (DEFAULT_TABLE table=default.Table_29313cec5adc47e1af7bd7a25a0ce4ef [id=073a59d0af1e49fdb2b47f2530f7f65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.975531 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292eef7bab904a7ea5ef6dbdaba1d37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.975981 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 626a876a51d04095b5dd54726bb995f3 (DEFAULT_TABLE table=default.Table_487262bf721f4183a8850da9cac26908 [id=285085385d554cffa937cbcaa74294a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.977118 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626a876a51d04095b5dd54726bb995f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:41.989509 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:41.992853 26912 raft_consensus.cc:359] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:41.995874 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 626a876a51d04095b5dd54726bb995f3 (DEFAULT_TABLE table=default.Table_487262bf721f4183a8850da9cac26908 [id=285085385d554cffa937cbcaa74294a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.996197 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:41.996928 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626a876a51d04095b5dd54726bb995f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.000999 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:42.002362 26450 leader_election.cc:343] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.002931 27517 leader_election.cc:290] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.014292 27530 raft_consensus.cc:2272] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:42.017176 27530 ts_tablet_manager.cc:1962] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:42.028644 26229 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 282) took 1615 ms. Trace:
I20260928 20:02:41.993847 26912 raft_consensus.cc:385] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.030452 26912 raft_consensus.cc:740] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.030067 26916 tablet_bootstrap.cc:492] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:42.031380 26916 ts_tablet_manager.cc:1449] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.135s user 0.032s sys 0.017s
I20260928 20:02:42.029001 26229 rpcz_store.cc:276] 0928 20:02:40.412846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.628324 (+1215478us) service_pool.cc:224] Handling call
0928 20:02:41.636346 (+ 8022us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:41.638305 (+ 1959us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:42.028035 (+389730us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:42.028322 (+ 287us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:42.028570 (+ 248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:41.708241 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:41.709903 (+ 1662us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:41.709938 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:02:41.709957 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:41.710333 (+ 376us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:41.710382 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:41.710415 (+ 33us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:41.710655 (+ 240us) tablet.cc:701] Row locks acquired
0928 20:02:41.710674 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:41.710802 (+ 128us) write_op.cc:270] Start()
0928 20:02:41.710903 (+ 101us) write_op.cc:276] Timestamp: P: 1790625761710715 usec, L: 0
0928 20:02:41.710924 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:41.839019 (+128095us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400030fa0. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d1aab20 00007ff79d2343d2 00007ff79d2297f7 00007ff79d229634 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231
0928 20:02:41.839505 (+ 486us) log.cc:844] Serialized 433 byte log entry
0928 20:02:42.012074 (+172569us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.015485 (+ 3411us) write_op.cc:301] APPLY: starting
0928 20:02:42.015549 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.015688 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.015718 (+ 30us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.026529 (+ 10811us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.026677 (+ 148us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:42.026720 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:42.027023 (+ 303us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.027607 (+ 584us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.027678 (+ 71us) write_op.cc:454] Released schema lock
0928 20:02:42.027709 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3212,"num_ops":2,"prepare.queue_time_us":68319,"prepare.run_cpu_time_us":15664,"prepare.run_wall_time_us":151196,"raft.queue_time_us":19468,"raft.run_cpu_time_us":20,"raft.run_wall_time_us":21,"replication_time_us":297264,"spinlock_wait_cycles":281554816,"thread_start_us":19580,"threads_started":1}]]}
I20260928 20:02:42.031476 26912 consensus_queue.cc:260] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.033083 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7f275a96cadb4937b6e221953176c523" } modify_external_catalogs: true
I20260928 20:02:42.033761 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7f275a96cadb4937b6e221953176c523" } modify_external_catalogs: true
I20260928 20:02:42.035626 26916 raft_consensus.cc:359] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.036247 26916 raft_consensus.cc:385] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.036509 26916 raft_consensus.cc:740] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.039083 26512 raft_consensus.cc:2468] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:42.040326 26916 consensus_queue.cc:260] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.044423 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 40942986095446f8a1b13da12315e804 (DEFAULT_TABLE table=default.Table_b6d3e2c8a9994b19b860b97f44a72785 [id=8f0c2c2f5bb74283976e75d6bcca7ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.045535 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40942986095446f8a1b13da12315e804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.046092 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 40942986095446f8a1b13da12315e804 (DEFAULT_TABLE table=default.Table_b6d3e2c8a9994b19b860b97f44a72785 [id=8f0c2c2f5bb74283976e75d6bcca7ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:41.997305 26232 catalog_manager.cc:5838] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:42.047470 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:42.048727 26916 ts_tablet_manager.cc:1480] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.004s sys 0.001s
I20260928 20:02:42.048257 26232 catalog_manager.cc:5838] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:42.049188 26912 ts_tablet_manager.cc:1480] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.076s user 0.004s sys 0.003s
I20260928 20:02:42.064674 26912 tablet_bootstrap.cc:492] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:42.074013 27531 ts_tablet_manager.cc:1975] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:42.076707 27531 log.cc:1199] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:42.079671 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40942986095446f8a1b13da12315e804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.080010 26916 tablet_bootstrap.cc:492] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:42.085351 27531 ts_tablet_manager.cc:1996] T 018497a652234fbdb04cf6c034bcc5d3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:42.087353 26913 tablet_bootstrap.cc:492] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:42.087800 26913 ts_tablet_manager.cc:1449] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.287s user 0.007s sys 0.002s
I20260928 20:02:42.085458 26916 tablet_bootstrap.cc:654] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.089257 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 018497a652234fbdb04cf6c034bcc5d3 (table default.Table_438a2bd078e04a3e87064ca81d283559 [id=e27528ba702740e7a7aaae54dc8503fb]) successfully deleted
I20260928 20:02:42.103236 27531 tablet_replica.cc:333] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:42.103176 26913 raft_consensus.cc:359] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.103832 26913 raft_consensus.cc:385] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.104880 27531 raft_consensus.cc:2243] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:42.105610 27531 raft_consensus.cc:2272] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:42.104090 26913 raft_consensus.cc:740] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.105785 26916 tablet_bootstrap.cc:492] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:42.107374 26916 ts_tablet_manager.cc:1449] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.007s
I20260928 20:02:42.108063 26232 catalog_manager.cc:5838] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:42.109629 26916 raft_consensus.cc:359] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:42.110245 26916 raft_consensus.cc:385] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.110529 26916 raft_consensus.cc:740] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.112587 26916 consensus_queue.cc:260] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:42.114701 26916 ts_tablet_manager.cc:1480] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260928 20:02:42.115566 26916 tablet_bootstrap.cc:492] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:42.111817 26913 consensus_queue.cc:260] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.121022 26913 ts_tablet_manager.cc:1480] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.033s user 0.004s sys 0.003s
I20260928 20:02:42.123400 26913 tablet_bootstrap.cc:492] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:42.115455 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:42.134124 26913 tablet_bootstrap.cc:654] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.140133 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 2d9ca77e114c4d06bde1bcd862c8eccf (table default.Table_07fc7a223812466d8d63a0097bbbd86b [id=bfbc8f3e5a924682a1dd0a5996898e28]). Expected version 3 got 2
I20260928 20:02:42.148427 26916 tablet_bootstrap.cc:654] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.147730 26913 tablet_bootstrap.cc:492] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:42.152926 27531 ts_tablet_manager.cc:1962] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:42.153115 26913 ts_tablet_manager.cc:1449] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.000s
I20260928 20:02:42.155529 26913 raft_consensus.cc:359] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.156229 26913 raft_consensus.cc:385] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.165021 26916 tablet_bootstrap.cc:492] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:42.165539 26916 ts_tablet_manager.cc:1449] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.007s
I20260928 20:02:42.168046 26916 raft_consensus.cc:359] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.168709 26916 raft_consensus.cc:385] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.168999 26916 raft_consensus.cc:740] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.163009 26913 raft_consensus.cc:740] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.171164 26913 consensus_queue.cc:260] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.183246 26916 consensus_queue.cc:260] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.184712 26916 ts_tablet_manager.cc:1480] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260928 20:02:42.181893 26913 ts_tablet_manager.cc:1480] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260928 20:02:42.185806 26913 tablet_bootstrap.cc:492] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:42.192744 26916 tablet_bootstrap.cc:492] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:42.202610 26913 tablet_bootstrap.cc:654] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.208002 26916 tablet_bootstrap.cc:654] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.215791 27517 raft_consensus.cc:493] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.216270 27517 raft_consensus.cc:515] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:42.218348 27517 leader_election.cc:290] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:42.220253 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86e8a782b3e46d09a45bbb7025546af" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:42.221822 26450 leader_election.cc:343] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.224853 26913 tablet_bootstrap.cc:492] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:42.226051 26913 ts_tablet_manager.cc:1449] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.001s
I20260928 20:02:42.231217 26657 raft_consensus.cc:3060] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.232649 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:42.233386 26651 raft_consensus.cc:2468] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:42.234499 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:42.234795 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:42.236299 26594 leader_election.cc:304] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:42.237668 27517 raft_consensus.cc:493] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.237718 27526 raft_consensus.cc:2804] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:42.240432 27526 raft_consensus.cc:697] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:42.237390 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa037333676c4dba93160c5e3337f891" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:42.241286 27526 consensus_queue.cc:237] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.242205 26652 raft_consensus.cc:3060] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.247977 26739 leader_election.cc:304] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:42.238130 27517 raft_consensus.cc:515] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:42.249394 26739 leader_election.cc:343] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.250802 27517 leader_election.cc:290] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:42.250912 26739 leader_election.cc:343] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.253846 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23636443834932852f21092be1d1ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:41.926540 26740 leader_election.cc:343] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa037333676c4dba93160c5e3337f891
W20260928 20:02:42.256692 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 330067us
W20260928 20:02:42.257838 26450 leader_election.cc:343] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.259917 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:42.260525 26511 raft_consensus.cc:3060] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.264493 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d (DEFAULT_TABLE table=default.Table_29313cec5adc47e1af7bd7a25a0ce4ef [id=073a59d0af1e49fdb2b47f2530f7f65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.267443 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292eef7bab904a7ea5ef6dbdaba1d37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.277841 26652 raft_consensus.cc:2468] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:42.277601 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23636443834932852f21092be1d1ac" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.277935 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 626a876a51d04095b5dd54726bb995f3 (DEFAULT_TABLE table=default.Table_487262bf721f4183a8850da9cac26908 [id=285085385d554cffa937cbcaa74294a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.279382 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626a876a51d04095b5dd54726bb995f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:42.279769 26450 leader_election.cc:343] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.280191 26450 leader_election.cc:304] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.281359 27517 raft_consensus.cc:2749] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:42.282727 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.283140 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 40942986095446f8a1b13da12315e804 (DEFAULT_TABLE table=default.Table_b6d3e2c8a9994b19b860b97f44a72785 [id=8f0c2c2f5bb74283976e75d6bcca7ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.284194 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40942986095446f8a1b13da12315e804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.285006 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.286716 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86e8a782b3e46d09a45bbb7025546af" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.288836 26511 raft_consensus.cc:2468] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:42.290719 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet cb970d91179e48cdbbb1e32a3ca3171c (table default.Table_e37f5f95bc984b27b7fb29e83e336618 [id=cc2e9040c8104d3195750b14c727965d]) successfully deleted
I20260928 20:02:42.301190 26235 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 284) took 1829 ms. Trace:
I20260928 20:02:42.301638 26235 rpcz_store.cc:276] 0928 20:02:40.471335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.640788 (+1169453us) service_pool.cc:224] Handling call
0928 20:02:41.643816 (+ 3028us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:41.645729 (+ 1913us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:42.172795 (+527066us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:42.300713 (+127918us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:42.301089 (+ 376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:41.859554 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:41.860014 (+ 460us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:41.860050 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:41.860070 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:41.860409 (+ 339us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:41.860470 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:41.860503 (+ 33us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:41.860746 (+ 243us) tablet.cc:701] Row locks acquired
0928 20:02:41.860765 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:41.860890 (+ 125us) write_op.cc:270] Start()
0928 20:02:41.860992 (+ 102us) write_op.cc:276] Timestamp: P: 1790625761860793 usec, L: 0
0928 20:02:41.861014 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:02:41.998738 (+137724us) log.cc:844] Serialized 433 byte log entry
0928 20:02:41.999554 (+ 816us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:42.154210 (+154656us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.170366 (+ 16156us) write_op.cc:301] APPLY: starting
0928 20:02:42.170463 (+ 97us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.170623 (+ 160us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.170654 (+ 31us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.171151 (+ 497us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.171293 (+ 142us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:42.171335 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:42.171524 (+ 189us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.171690 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.171753 (+ 63us) write_op.cc:454] Released schema lock
0928 20:02:42.171865 (+ 112us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.175022 (+ 3157us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.177472 (+ 2450us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1582,"apply.run_cpu_time_us":1702,"apply.run_wall_time_us":2897,"mutex_wait_us":32308,"num_ops":2,"prepare.queue_time_us":183913,"prepare.run_cpu_time_us":4196,"prepare.run_wall_time_us":140116,"replication_time_us":293094,"spinlock_wait_cycles":315662592}]]}
I20260928 20:02:42.306875 26228 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 280) took 2046 ms. Trace:
I20260928 20:02:42.311820 27531 ts_tablet_manager.cc:1975] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:42.312282 27531 log.cc:1199] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:42.313429 27531 ts_tablet_manager.cc:1996] T aa4f373a46de433eabd3b35b6ed3d1e3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:42.316103 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 234) took 1102 ms. Trace:
I20260928 20:02:42.261982 26740 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:42.330271 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet bd3fa371924149fb814c8458488aea61
I20260928 20:02:42.331903 26231 catalog_manager.cc:6934] ReplaceTablet: tablet bd3fa371924149fb814c8458488aea61 deleted and replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278
I20260928 20:02:42.332309 26231 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 283) took 1887 ms. Trace:
I20260928 20:02:42.332679 26739 leader_election.cc:304] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:42.316330 26916 tablet_bootstrap.cc:492] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:42.324452 27517 raft_consensus.cc:493] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.333873 27517 raft_consensus.cc:515] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.335126 27551 raft_consensus.cc:2804] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:42.335587 27551 raft_consensus.cc:493] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:42.335784 27517 leader_election.cc:290] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:42.335887 27551 raft_consensus.cc:3060] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.337656 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:42.338835 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0308d824cf401c8cca0cf7a950fd53" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:42.340919 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45872.8us
W20260928 20:02:42.341029 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 79247.8us
I20260928 20:02:42.342495 27557 raft_consensus.cc:2804] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:42.342669 27599 raft_consensus.cc:2804] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:42.332114 27531 rpcz_store.cc:276] 0928 20:02:41.213455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.213548 (+ 93us) service_pool.cc:224] Handling call
0928 20:02:42.095931 (+882383us) ts_tablet_manager.cc:1197] Deleting tablet aa4f373a46de433eabd3b35b6ed3d1e3
0928 20:02:42.103103 (+ 7172us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:42.203966 (+100863us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.311663 (+107697us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.316048 (+ 4385us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":881058}
I20260928 20:02:42.332639 26231 rpcz_store.cc:276] 0928 20:02:40.444892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.630595 (+1185703us) service_pool.cc:224] Handling call
0928 20:02:42.332227 (+701632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.007478 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.007841 (+ 363us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.007862 (+ 21us) write_op.cc:435] Acquired schema lock
0928 20:02:42.007874 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:42.008139 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.008169 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.008190 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:42.008364 (+ 174us) tablet.cc:701] Row locks acquired
0928 20:02:42.008375 (+ 11us) write_op.cc:260] PREPARE: finished
0928 20:02:42.008495 (+ 120us) write_op.cc:270] Start()
0928 20:02:42.008568 (+ 73us) write_op.cc:276] Timestamp: P: 1790625762008395 usec, L: 0
0928 20:02:42.008584 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.014510 (+ 5926us) log.cc:844] Serialized 631 byte log entry
0928 20:02:42.015187 (+ 677us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:42.327485 (+312298us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.328103 (+ 618us) write_op.cc:301] APPLY: starting
0928 20:02:42.328170 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.328269 (+ 99us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.328298 (+ 29us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.328675 (+ 377us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.328873 (+ 198us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:42.328916 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:42.329079 (+ 163us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.329210 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.329265 (+ 55us) write_op.cc:454] Released schema lock
0928 20:02:42.329300 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.329507 (+ 207us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.329534 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":460,"apply.run_cpu_time_us":1378,"apply.run_wall_time_us":1379,"num_ops":2,"prepare.queue_time_us":16066,"prepare.run_cpu_time_us":2565,"prepare.run_wall_time_us":7823,"replication_time_us":318810,"spinlock_wait_cycles":12290816}]]}
I20260928 20:02:42.347064 27531 tablet_replica.cc:333] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:42.347348 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet aa4f373a46de433eabd3b35b6ed3d1e3 (table default.Table_53b73d543aa74f4190223084e9c487af [id=2c0cba9356064ab29bd837a988ab4921]) successfully deleted
I20260928 20:02:42.348594 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:42.351233 27531 raft_consensus.cc:2243] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:42.355368 27531 raft_consensus.cc:2272] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:42.355513 27549 consensus_queue.cc:1048] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:42.358008 27531 ts_tablet_manager.cc:1962] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:42.363523 26912 tablet_bootstrap.cc:654] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.307189 26228 rpcz_store.cc:276] 0928 20:02:40.260302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.327683 (+1067381us) service_pool.cc:224] Handling call
0928 20:02:41.564050 (+236367us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab616 00007ff79cc52034 00007ff79cc51fc2 00007ff79cc51ef1 00007ff79cc51e6c 00007ff79cc51122 00007ff79aefc15c 00007ff79aefb596
0928 20:02:41.623530 (+ 59480us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:41.679565 (+ 56035us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:42.194584 (+515019us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:42.306561 (+111977us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:42.306823 (+ 262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:41.999787 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.000124 (+ 337us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.000148 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:42.000160 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:42.000414 (+ 254us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.000468 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.000494 (+ 26us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:42.000676 (+ 182us) tablet.cc:701] Row locks acquired
0928 20:02:42.000689 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:42.000799 (+ 110us) write_op.cc:270] Start()
0928 20:02:42.000874 (+ 75us) write_op.cc:276] Timestamp: P: 1790625762000696 usec, L: 0
0928 20:02:42.000889 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.001321 (+ 432us) log.cc:844] Serialized 433 byte log entry
0928 20:02:42.154454 (+153133us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.175220 (+ 20766us) write_op.cc:301] APPLY: starting
0928 20:02:42.175307 (+ 87us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.175480 (+ 173us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.175617 (+ 137us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.177333 (+ 1716us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.178555 (+ 1222us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:42.178761 (+ 206us) write_op.cc:312] APPLY: finished
0928 20:02:42.180304 (+ 1543us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.193471 (+ 13167us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.193745 (+ 274us) write_op.cc:454] Released schema lock
0928 20:02:42.194003 (+ 258us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.291489 (+ 97486us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.291736 (+ 247us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":539629440,"child_traces":[["op",{"apply.queue_time_us":14618,"apply.run_cpu_time_us":2251,"apply.run_wall_time_us":42621,"mutex_wait_us":26809,"num_ops":2,"prepare.queue_time_us":318500,"prepare.run_cpu_time_us":1724,"prepare.run_wall_time_us":1724,"replication_time_us":153492}]]}
I20260928 20:02:42.380420 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_82c8c6d1d671463f91831833219aa073" } new_table_name: "default.Table_31b3759a2ab04669a085898c9806347b" modify_external_catalogs: true
I20260928 20:02:42.394456 26913 raft_consensus.cc:359] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.395985 26913 raft_consensus.cc:385] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.396366 26913 raft_consensus.cc:740] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.398187 27557 raft_consensus.cc:697] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:42.399217 27530 ts_tablet_manager.cc:1975] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:42.401665 27530 log.cc:1199] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b087dcc9d5be4a9e89c35c359a18ca5c
I20260928 20:02:42.404711 27530 ts_tablet_manager.cc:1996] T b087dcc9d5be4a9e89c35c359a18ca5c P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:42.396311 26916 ts_tablet_manager.cc:1449] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.204s user 0.011s sys 0.000s
W20260928 20:02:42.397392 26450 leader_election.cc:343] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.406786 26450 leader_election.cc:304] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:42.407981 26450 leader_election.cc:343] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.408349 26450 leader_election.cc:304] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.403697 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0308d824cf401c8cca0cf7a950fd53" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.409592 27476 raft_consensus.cc:2749] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:42.410912 26450 leader_election.cc:343] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.399392 27557 consensus_queue.cc:237] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.413998 27476 raft_consensus.cc:2749] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:42.414191 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet bd3fa371924149fb814c8458488aea61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd3fa371924149fb814c8458488aea61 already in progress: creating tablet
I20260928 20:02:42.411232 26450 leader_election.cc:304] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.415351 27517 raft_consensus.cc:2749] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:42.417027 26450 leader_election.cc:343] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.420317 27599 raft_consensus.cc:697] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:42.421175 27599 consensus_queue.cc:237] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.419924 26916 raft_consensus.cc:359] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.422722 26916 raft_consensus.cc:385] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.423022 26916 raft_consensus.cc:740] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.423794 26916 consensus_queue.cc:260] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.431680 26227 catalog_manager.cc:5838] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:42.438227 27517 raft_consensus.cc:493] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.438750 27517 raft_consensus.cc:515] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.441025 27517 leader_election.cc:290] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:42.403283 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 61396us
I20260928 20:02:42.459937 26740 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:42.462136 26916 ts_tablet_manager.cc:1480] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260928 20:02:42.433620 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:42.465458 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:42.470332 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655fc043b9468ea51ce5ae983e8f06" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.472744 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
W20260928 20:02:42.478185 26450 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.480067 26913 consensus_queue.cc:260] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.481206 27517 raft_consensus.cc:493] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.481877 27517 raft_consensus.cc:515] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.482270 27549 raft_consensus.cc:2804] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:42.482725 27549 raft_consensus.cc:697] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:42.483299 26913 ts_tablet_manager.cc:1480] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.257s user 0.008s sys 0.000s
I20260928 20:02:42.483489 27549 consensus_queue.cc:237] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.484118 26913 tablet_bootstrap.cc:492] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:42.484130 27517 leader_election.cc:290] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.488585 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:42.489682 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:42.494037 26740 consensus_peers.cc:597] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:42.496912 26450 leader_election.cc:343] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.497298 26450 leader_election.cc:304] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.497947 27517 raft_consensus.cc:2749] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:42.503104 26450 leader_election.cc:343] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.504905 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655fc043b9468ea51ce5ae983e8f06" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:42.506259 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:42.514369 26916 tablet_bootstrap.cc:492] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:42.496076 26739 consensus_peers.cc:597] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:42.527323 27551 raft_consensus.cc:515] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:42.528385 26450 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.529304 27551 leader_election.cc:290] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:42.528820 26450 leader_election.cc:304] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.530232 27517 raft_consensus.cc:2749] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:42.535830 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b667a45712c1449384e1a288f55fd062 consensus state has no leader
I20260928 20:02:42.536698 27530 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 228) took 1368 ms. Trace:
I20260928 20:02:42.537067 27530 rpcz_store.cc:276] 0928 20:02:41.168507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.169249 (+ 742us) service_pool.cc:224] Handling call
0928 20:02:41.951915 (+782666us) ts_tablet_manager.cc:1197] Deleting tablet b087dcc9d5be4a9e89c35c359a18ca5c
0928 20:02:41.951989 (+ 74us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:42.092126 (+140137us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.398939 (+306813us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.536629 (+137690us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":782196}
W20260928 20:02:42.538606 26450 leader_election.cc:343] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.538425 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_28cdbc10adcb4b9da604e5bab2dda740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:42.538971 26450 leader_election.cc:304] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.539592 27517 raft_consensus.cc:2749] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:42.540246 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28cdbc10adcb4b9da604e5bab2dda740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:42.544473 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:42.545037 26658 raft_consensus.cc:3060] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.548839 27530 tablet_replica.cc:333] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:42.549937 27530 raft_consensus.cc:2243] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:42.550634 27530 raft_consensus.cc:2272] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:42.560591 26913 tablet_bootstrap.cc:654] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.563516 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:42.564054 26512 raft_consensus.cc:3060] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:42.568099 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b667a45712c1449384e1a288f55fd062 (table default.Table_31b3759a2ab04669a085898c9806347b [id=e2819060d01546218e8b53248ca6decd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b667a45712c1449384e1a288f55fd062 consensus state has no leader
I20260928 20:02:42.571215 26512 raft_consensus.cc:2468] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:42.572086 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet b087dcc9d5be4a9e89c35c359a18ca5c (table default.Table_75d3d3007f5b4c929142c1ec075e54f0 [id=3ceaf958c5e445639a07fa279736ee9d]) successfully deleted
I20260928 20:02:42.579869 26912 tablet_bootstrap.cc:492] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:42.580281 26912 ts_tablet_manager.cc:1449] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.516s user 0.022s sys 0.016s
I20260928 20:02:42.582085 26658 raft_consensus.cc:2468] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:42.582710 26912 raft_consensus.cc:359] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.583288 26912 raft_consensus.cc:385] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.583528 26912 raft_consensus.cc:740] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.584187 26912 consensus_queue.cc:260] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.582659 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:42.587105 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d9ca77e114c4d06bde1bcd862c8eccf (table default.Table_07fc7a223812466d8d63a0097bbbd86b [id=bfbc8f3e5a924682a1dd0a5996898e28]). Expected version 3 got 2
I20260928 20:02:42.592265 26912 ts_tablet_manager.cc:1480] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260928 20:02:42.593168 26912 tablet_bootstrap.cc:492] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:42.596383 26739 leader_election.cc:304] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:42.597389 27557 raft_consensus.cc:2804] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:42.597949 27557 raft_consensus.cc:697] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:42.598891 27557 consensus_queue.cc:237] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.599617 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:42.602748 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:42.624097 27530 ts_tablet_manager.cc:1962] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:42.630359 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_d91523ef25e54050a873a70bbc0c787a [id=0c98275433a24292b35617002df2cf6b]). Expected version 1 got 0
I20260928 20:02:42.631294 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105]). Expected version 1 got 0
I20260928 20:02:42.634634 26912 tablet_bootstrap.cc:654] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.639348 26916 tablet_bootstrap.cc:654] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.648471 26228 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 288) took 1091 ms. Trace:
I20260928 20:02:42.649376 26228 rpcz_store.cc:276] 0928 20:02:41.557552 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:42.537841 (+980289us) service_pool.cc:224] Handling call
0928 20:02:42.540692 (+ 2851us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:42.555540 (+ 14848us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:42.647855 (+ 92315us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:42.648158 (+ 303us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:42.648402 (+ 244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.604926 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.605420 (+ 494us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.605453 (+ 33us) write_op.cc:435] Acquired schema lock
0928 20:02:42.605472 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:42.605783 (+ 311us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.605841 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.605875 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:42.606141 (+ 266us) tablet.cc:701] Row locks acquired
0928 20:02:42.606160 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:42.606297 (+ 137us) write_op.cc:270] Start()
0928 20:02:42.606393 (+ 96us) write_op.cc:276] Timestamp: P: 1790625762606250 usec, L: 0
0928 20:02:42.606415 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.607029 (+ 614us) log.cc:844] Serialized 433 byte log entry
0928 20:02:42.644436 (+ 37407us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.644882 (+ 446us) write_op.cc:301] APPLY: starting
0928 20:02:42.644967 (+ 85us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.645120 (+ 153us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.645256 (+ 136us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.645921 (+ 665us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.646147 (+ 226us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:42.646190 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:42.646347 (+ 157us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.646469 (+ 122us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.646561 (+ 92us) write_op.cc:454] Released schema lock
0928 20:02:42.646592 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.646820 (+ 228us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.646843 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":262,"apply.run_cpu_time_us":1918,"apply.run_wall_time_us":1918,"num_ops":2,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":2335,"prepare.run_wall_time_us":2335,"replication_time_us":37904}]]}
I20260928 20:02:42.654625 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet e5e8ff2ad1f745f88df6e471ed935f2f from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:42.655874 26912 tablet_bootstrap.cc:492] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:42.656378 26912 ts_tablet_manager.cc:1449] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.001s
I20260928 20:02:42.658876 26912 raft_consensus.cc:359] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:42.666221 26912 raft_consensus.cc:385] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.666635 26912 raft_consensus.cc:740] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.667315 26912 consensus_queue.cc:260] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:42.672297 27517 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.672430 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:42.672924 27517 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.674083 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:42.675448 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:42.674980 27517 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.675861 27549 consensus_queue.cc:1048] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:42.680117 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.680868 26913 tablet_bootstrap.cc:492] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
W20260928 20:02:42.681376 26450 leader_election.cc:343] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.682386 27517 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.683041 27517 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.683665 26912 ts_tablet_manager.cc:1480] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260928 20:02:42.684991 27517 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.686493 26912 tablet_bootstrap.cc:492] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:42.682132 26913 ts_tablet_manager.cc:1449] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.198s user 0.004s sys 0.009s
I20260928 20:02:42.688670 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.689248 26804 raft_consensus.cc:2468] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:42.690539 26450 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:42.695084 27517 raft_consensus.cc:2804] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:42.695418 27517 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:42.696738 27517 raft_consensus.cc:3060] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.718154 26916 tablet_bootstrap.cc:492] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:42.723626 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:02:42.726550 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:42.727111 26912 tablet_bootstrap.cc:654] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.727178 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:42.726667 27517 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:42.728560 26450 leader_election.cc:343] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.728933 26450 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.729202 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:42.729590 27476 raft_consensus.cc:2749] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:42.727862 26916 ts_tablet_manager.cc:1449] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.262s user 0.011s sys 0.001s
I20260928 20:02:42.730443 26913 raft_consensus.cc:359] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.731045 26913 raft_consensus.cc:385] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.731287 26913 raft_consensus.cc:740] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.731977 26916 raft_consensus.cc:359] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.732590 26916 raft_consensus.cc:385] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.732812 26916 raft_consensus.cc:740] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.732736 26913 consensus_queue.cc:260] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.733453 26228 catalog_manager.cc:6934] ReplaceTablet: tablet e5e8ff2ad1f745f88df6e471ed935f2f deleted and replaced by tablet 8cbffea517e2438d90ca234b9f72f733
I20260928 20:02:42.733644 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:42.735055 26913 ts_tablet_manager.cc:1480] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260928 20:02:42.735682 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:42.735929 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet e5e8ff2ad1f745f88df6e471ed935f2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5e8ff2ad1f745f88df6e471ed935f2f already in progress: creating tablet
W20260928 20:02:42.740494 26450 leader_election.cc:343] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.744964 26913 tablet_bootstrap.cc:492] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:42.775815 26912 tablet_bootstrap.cc:492] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:42.775965 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:42.776222 26912 ts_tablet_manager.cc:1449] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.090s user 0.009s sys 0.000s
I20260928 20:02:42.776475 26804 raft_consensus.cc:3060] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:42.782612 26912 raft_consensus.cc:359] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.783246 26912 raft_consensus.cc:385] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.783509 26912 raft_consensus.cc:740] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.783411 26916 consensus_queue.cc:260] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.784135 26912 consensus_queue.cc:260] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.784485 26804 raft_consensus.cc:2468] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:42.785795 26450 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:42.786664 27476 raft_consensus.cc:2804] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:42.786828 26912 ts_tablet_manager.cc:1480] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260928 20:02:42.787097 27476 raft_consensus.cc:697] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:42.787675 26912 tablet_bootstrap.cc:492] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:42.787889 27476 consensus_queue.cc:237] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.789512 27531 ts_tablet_manager.cc:1975] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:42.789886 27531 log.cc:1199] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:42.790243 27530 ts_tablet_manager.cc:1975] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:42.790656 27530 log.cc:1199] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/c0fd24cd5adf4774a13aeac30315f6f9
I20260928 20:02:42.791392 27530 ts_tablet_manager.cc:1996] T c0fd24cd5adf4774a13aeac30315f6f9 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:42.793568 26916 ts_tablet_manager.cc:1480] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.063s user 0.005s sys 0.000s
I20260928 20:02:42.796209 26913 tablet_bootstrap.cc:654] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.790571 27531 ts_tablet_manager.cc:1996] T a0dd3080d50748d2ad79f472d3c17673 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:42.807263 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 233) took 1596 ms. Trace:
I20260928 20:02:42.808118 27531 rpcz_store.cc:276] 0928 20:02:41.211312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.223956 (+ 12644us) service_pool.cc:224] Handling call
0928 20:02:42.346893 (+1122937us) ts_tablet_manager.cc:1197] Deleting tablet a0dd3080d50748d2ad79f472d3c17673
0928 20:02:42.346943 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:42.666611 (+319668us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.775575 (+108964us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.807199 (+ 31624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079040}
I20260928 20:02:42.809707 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet a0dd3080d50748d2ad79f472d3c17673 (table default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]) successfully deleted
I20260928 20:02:42.807857 26916 tablet_bootstrap.cc:492] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:42.812259 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:42.814905 26450 leader_election.cc:343] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.815476 26916 tablet_bootstrap.cc:654] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.815771 27530 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 230) took 1616 ms. Trace:
W20260928 20:02:42.819130 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet bd3fa371924149fb814c8458488aea61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd3fa371924149fb814c8458488aea61 already in progress: creating tablet
I20260928 20:02:42.819659 27517 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.819551 27530 rpcz_store.cc:276] 0928 20:02:41.199034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.199134 (+ 100us) service_pool.cc:224] Handling call
0928 20:02:42.548594 (+1349460us) ts_tablet_manager.cc:1197] Deleting tablet c0fd24cd5adf4774a13aeac30315f6f9
0928 20:02:42.548700 (+ 106us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:42.723713 (+175013us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.790093 (+ 66380us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:42.815705 (+ 25612us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1348904}
W20260928 20:02:42.820827 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet e5e8ff2ad1f745f88df6e471ed935f2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5e8ff2ad1f745f88df6e471ed935f2f already in progress: creating tablet
I20260928 20:02:42.821746 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet c0fd24cd5adf4774a13aeac30315f6f9 (table default.Table_0dfdabdeae0a4bf1ba4dd59d4bbc98ca [id=11d2d52bae424e51b5379df798890e4f]) successfully deleted
I20260928 20:02:42.830549 26912 tablet_bootstrap.cc:654] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.835836 26913 tablet_bootstrap.cc:492] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:42.836242 26913 ts_tablet_manager.cc:1449] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.000s
W20260928 20:02:42.853356 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet bd3fa371924149fb814c8458488aea61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd3fa371924149fb814c8458488aea61 already in progress: creating tablet
W20260928 20:02:42.855273 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet e5e8ff2ad1f745f88df6e471ed935f2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5e8ff2ad1f745f88df6e471ed935f2f already in progress: creating tablet
I20260928 20:02:42.860618 26916 tablet_bootstrap.cc:492] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:42.861812 26916 ts_tablet_manager.cc:1449] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.067s user 0.011s sys 0.000s
I20260928 20:02:42.867772 26638 tablet_service.cc:1511] Processing CreateTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 (DEFAULT_TABLE table=default.Table_7a934c9d12fa42cd818bc13a48bfd4ea [id=b4e172d4e9864aaf844a0dcf07165e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.868738 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.874153 26916 raft_consensus.cc:359] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.879362 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:42.880347 26912 tablet_bootstrap.cc:492] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:42.880628 26916 raft_consensus.cc:385] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.880730 26912 ts_tablet_manager.cc:1449] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.093s user 0.008s sys 0.001s
I20260928 20:02:42.882892 26912 raft_consensus.cc:359] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.883494 26912 raft_consensus.cc:385] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.883742 26912 raft_consensus.cc:740] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.883569 26916 raft_consensus.cc:740] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.884317 26913 raft_consensus.cc:359] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.885016 26913 raft_consensus.cc:385] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:42.885273 26913 raft_consensus.cc:740] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:42.885607 26916 consensus_queue.cc:260] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.884538 26228 catalog_manager.cc:5838] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:42.887110 26913 consensus_queue.cc:260] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.889268 26913 ts_tablet_manager.cc:1480] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20260928 20:02:42.898386 26775 tablet_service.cc:1511] Processing CreateTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 (DEFAULT_TABLE table=default.Table_7a934c9d12fa42cd818bc13a48bfd4ea [id=b4e172d4e9864aaf844a0dcf07165e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.899335 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.901733 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:42.902640 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:42.903424 26228 catalog_manager.cc:5838] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:42.904776 26228 catalog_manager.cc:5838] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:42.907716 26916 ts_tablet_manager.cc:1480] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.046s user 0.005s sys 0.000s
I20260928 20:02:42.908550 26916 tablet_bootstrap.cc:492] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:42.894358 26912 consensus_queue.cc:260] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.924105 26912 ts_tablet_manager.cc:1480] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.043s user 0.005s sys 0.001s
I20260928 20:02:42.924382 26487 tablet_service.cc:1511] Processing CreateTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 (DEFAULT_TABLE table=default.Table_7a934c9d12fa42cd818bc13a48bfd4ea [id=b4e172d4e9864aaf844a0dcf07165e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.925345 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.925557 26916 tablet_bootstrap.cc:654] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.928085 26912 tablet_bootstrap.cc:492] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:42.933218 26912 tablet_bootstrap.cc:654] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.905877 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:42.938687 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:42.948274 26913 tablet_bootstrap.cc:492] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:42.955037 26783 tablet_service.cc:1511] Processing CreateTablet for tablet d13562e920244194969520df564a949d (DEFAULT_TABLE table=default.Table_a443f94d7c7c4e60b56e3c9fdebecac4 [id=4b0f8fae05494c8087442a15e25109aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.956048 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13562e920244194969520df564a949d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.957149 27476 raft_consensus.cc:493] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.958003 26483 tablet_service.cc:1511] Processing CreateTablet for tablet d13562e920244194969520df564a949d (DEFAULT_TABLE table=default.Table_a443f94d7c7c4e60b56e3c9fdebecac4 [id=4b0f8fae05494c8087442a15e25109aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.957578 27476 raft_consensus.cc:515] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.959093 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13562e920244194969520df564a949d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.959873 27476 leader_election.cc:290] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.961223 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.961614 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:42.962580 26450 leader_election.cc:343] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:42.963210 26450 leader_election.cc:343] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:42.963553 26450 leader_election.cc:304] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:42.964591 27476 raft_consensus.cc:2749] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:42.966609 26913 tablet_bootstrap.cc:654] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:42.982899 26638 tablet_service.cc:1511] Processing CreateTablet for tablet d13562e920244194969520df564a949d (DEFAULT_TABLE table=default.Table_a443f94d7c7c4e60b56e3c9fdebecac4 [id=4b0f8fae05494c8087442a15e25109aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:42.984092 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13562e920244194969520df564a949d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:42.988411 27522 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.988839 27522 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:42.990942 27522 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:42.991856 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:42.993005 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:42.993772 26512 raft_consensus.cc:2393] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:42.994719 27476 raft_consensus.cc:493] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:42.995152 27476 raft_consensus.cc:515] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:42.996932 27476 leader_election.cc:290] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:42.998699 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:42.999903 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6544b7b405c4831900f37e052892409" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.000447 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:43.001034 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:43.001768 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:43.002489 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6544b7b405c4831900f37e052892409" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:43.002023 26450 leader_election.cc:343] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:43.003947 26450 leader_election.cc:343] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.004253 26450 leader_election.cc:304] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:43.005170 26913 tablet_bootstrap.cc:492] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:43.005564 26913 ts_tablet_manager.cc:1449] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.002s
I20260928 20:02:43.005602 27476 raft_consensus.cc:2749] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:43.007963 26595 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:43.007773 27522 consensus_queue.cc:1048] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:43.009254 27522 raft_consensus.cc:3060] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:43.014721 26916 tablet_bootstrap.cc:492] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:43.015161 26916 ts_tablet_manager.cc:1449] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.107s user 0.009s sys 0.000s
I20260928 20:02:43.017549 26916 raft_consensus.cc:359] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.019369 27522 raft_consensus.cc:2749] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:43.020309 26595 consensus_peers.cc:597] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:43.032823 26913 raft_consensus.cc:359] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.035130 26913 raft_consensus.cc:385] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.037359 26913 raft_consensus.cc:740] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.018333 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_d91523ef25e54050a873a70bbc0c787a [id=0c98275433a24292b35617002df2cf6b]). Expected version 1 got 0
I20260928 20:02:43.033233 27476 raft_consensus.cc:493] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.038703 27476 raft_consensus.cc:515] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:43.038756 26913 consensus_queue.cc:260] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.041689 27476 leader_election.cc:290] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:43.042308 26916 raft_consensus.cc:385] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.042793 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0a362efb68408d8dce96dce0130035" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:43.044652 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
W20260928 20:02:43.044173 26450 leader_election.cc:343] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.046716 26916 raft_consensus.cc:740] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.051209 26913 ts_tablet_manager.cc:1480] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20260928 20:02:43.051734 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0a362efb68408d8dce96dce0130035" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.054171 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:43.047513 26916 consensus_queue.cc:260] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.059652 26916 ts_tablet_manager.cc:1480] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260928 20:02:43.060494 26916 tablet_bootstrap.cc:492] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:43.062373 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:43.063906 26233 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 279) took 2981 ms. Trace:
I20260928 20:02:43.064697 27612 raft_consensus.cc:493] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.065203 27612 raft_consensus.cc:515] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.067123 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.067247 27612 leader_election.cc:290] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.067304 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.068183 27531 tablet_replica.cc:333] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:43.068871 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet e70df4ddf0f9430980c967d798ed6c50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e70df4ddf0f9430980c967d798ed6c50 already in progress: creating tablet
I20260928 20:02:43.069024 27531 raft_consensus.cc:2243] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.069449 27531 raft_consensus.cc:2272] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.049983 26912 tablet_bootstrap.cc:492] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:43.070466 26912 ts_tablet_manager.cc:1449] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.005s
W20260928 20:02:43.072064 26740 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:43.073386 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "946f215581734bf591ab05502e5ff4a0" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.074648 27531 ts_tablet_manager.cc:1962] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:43.081740 26450 leader_election.cc:343] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.082170 26450 leader_election.cc:304] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:43.088266 27476 raft_consensus.cc:2749] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:43.110695 26913 tablet_bootstrap.cc:492] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:43.114804 26227 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_07fc7a223812466d8d63a0097bbbd86b [id=bfbc8f3e5a924682a1dd0a5996898e28] alter complete (version 3)
I20260928 20:02:43.072798 26912 raft_consensus.cc:359] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.116505 26912 raft_consensus.cc:385] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.116791 26912 raft_consensus.cc:740] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.117161 26230 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_e3405e57e5f24f9897ccba60b873c071 [id=474b74c08e6348da8e5de4405064735f] alter complete (version 3)
I20260928 20:02:43.117751 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:43.117559 26912 consensus_queue.cc:260] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.119192 26229 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 286) took 2412 ms. Trace:
W20260928 20:02:43.077867 26739 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.120193 26739 leader_election.cc:304] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:43.120910 27612 raft_consensus.cc:2749] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:43.121371 26236 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 285) took 2635 ms. Trace:
I20260928 20:02:43.121634 26236 rpcz_store.cc:276] 0928 20:02:40.485824 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.702433 (+1216609us) service_pool.cc:224] Handling call
0928 20:02:41.703905 (+ 1472us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:41.704841 (+ 936us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:41.705631 (+ 790us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:41.705909 (+ 278us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:42.292867 (+586958us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:43.121295 (+828428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.001626 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.001958 (+ 332us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.001979 (+ 21us) write_op.cc:435] Acquired schema lock
0928 20:02:42.001991 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:42.002241 (+ 250us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.002272 (+ 31us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.002293 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:42.002414 (+ 121us) tablet.cc:701] Row locks acquired
0928 20:02:42.002425 (+ 11us) write_op.cc:260] PREPARE: finished
0928 20:02:42.002524 (+ 99us) write_op.cc:270] Start()
0928 20:02:42.002590 (+ 66us) write_op.cc:276] Timestamp: P: 1790625762002426 usec, L: 0
0928 20:02:42.002604 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.002971 (+ 367us) log.cc:844] Serialized 405 byte log entry
0928 20:02:42.155563 (+152592us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.179310 (+ 23747us) write_op.cc:301] APPLY: starting
0928 20:02:42.179727 (+ 417us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.181260 (+ 1533us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.193198 (+ 11938us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.194348 (+ 1150us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.217631 (+ 23283us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:42.217685 (+ 54us) write_op.cc:312] APPLY: finished
0928 20:02:42.291540 (+ 73855us) log.cc:844] Serialized 23 byte log entry
0928 20:02:42.291745 (+ 205us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.291817 (+ 72us) write_op.cc:454] Released schema lock
0928 20:02:42.291847 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.292101 (+ 254us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.292128 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3479,"child_traces":[["op",{"apply.queue_time_us":23055,"apply.run_cpu_time_us":1777,"apply.run_wall_time_us":112917,"num_ops":1,"prepare.queue_time_us":233627,"prepare.run_cpu_time_us":1494,"prepare.run_wall_time_us":2307,"replication_time_us":151974,"thread_start_us":64462,"threads_started":1}]]}
I20260928 20:02:43.124686 27612 raft_consensus.cc:493] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.125066 27612 raft_consensus.cc:515] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.125463 26235 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_d9dd76f902a14b1eb291e720ba17dd9a [id=ec32368ba1694873892ec3f1a5140105] alter complete (version 1)
I20260928 20:02:43.127053 27612 leader_election.cc:290] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.127357 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:42 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.129593 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:43.130213 26511 raft_consensus.cc:2468] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:43.131289 26740 leader_election.cc:304] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:43.132616 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.133253 27530 tablet_replica.cc:333] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:43.133315 27599 raft_consensus.cc:2804] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:43.133659 27599 raft_consensus.cc:493] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:43.133970 27599 raft_consensus.cc:3060] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:43.134227 27530 raft_consensus.cc:2243] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.134733 27530 raft_consensus.cc:2272] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.136812 27530 ts_tablet_manager.cc:1962] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.119488 26229 rpcz_store.cc:276] 0928 20:02:40.707293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:42.032644 (+1325351us) service_pool.cc:224] Handling call
0928 20:02:42.035669 (+ 3025us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:42.036317 (+ 648us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:42.036445 (+ 128us) catalog_manager.cc:2863] Locking tablets
0928 20:02:42.037242 (+ 797us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:42.334871 (+297629us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:42.335068 (+ 197us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:43.117669 (+782601us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:43.119138 (+ 1469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.039789 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.040212 (+ 423us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.040248 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:42.040269 (+ 21us) tablet.cc:662] Decoding operations
0928 20:02:42.040580 (+ 311us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.040616 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.040637 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:42.040895 (+ 258us) tablet.cc:701] Row locks acquired
0928 20:02:42.040907 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:42.041026 (+ 119us) write_op.cc:270] Start()
0928 20:02:42.041104 (+ 78us) write_op.cc:276] Timestamp: P: 1790625762040918 usec, L: 0
0928 20:02:42.041119 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.041579 (+ 460us) log.cc:844] Serialized 734 byte log entry
0928 20:02:42.327711 (+286132us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.329692 (+ 1981us) write_op.cc:301] APPLY: starting
0928 20:02:42.329737 (+ 45us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.329836 (+ 99us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.329926 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.330979 (+ 1053us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.331110 (+ 131us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:42.331154 (+ 44us) write_op.cc:312] APPLY: finished
0928 20:02:42.331311 (+ 157us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.331429 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.331487 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:42.331514 (+ 27us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.331726 (+ 212us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.331757 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1872,"apply.run_cpu_time_us":1298,"apply.run_wall_time_us":2000,"num_ops":2,"prepare.queue_time_us":268,"prepare.run_cpu_time_us":1983,"prepare.run_wall_time_us":1984,"replication_time_us":286527}]]}
I20260928 20:02:43.138491 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet c0fd24cd5adf4774a13aeac30315f6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.132323 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:42 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.139621 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet d374d592fda8402faac70a923049c9ad with delete_type TABLET_DATA_DELETED (replaced by tablet 7cda7651d4cf4c7e82c7329735e6bdcc) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.064181 26233 rpcz_store.cc:276] 0928 20:02:40.082817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.265336 (+1182519us) service_pool.cc:224] Handling call
0928 20:02:41.353950 (+ 88614us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:41.649612 (+295662us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:41.650397 (+ 785us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:41.650629 (+ 232us) catalog_manager.cc:2863] Locking tablets
0928 20:02:41.966799 (+316170us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:42.330329 (+363530us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:42.330526 (+ 197us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:43.062263 (+731737us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:43.063850 (+ 1587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.004120 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.004494 (+ 374us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.004523 (+ 29us) write_op.cc:435] Acquired schema lock
0928 20:02:42.004535 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:42.004829 (+ 294us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.004866 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.004887 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:42.005137 (+ 250us) tablet.cc:701] Row locks acquired
0928 20:02:42.005150 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:42.005244 (+ 94us) write_op.cc:270] Start()
0928 20:02:42.005341 (+ 97us) write_op.cc:276] Timestamp: P: 1790625762005144 usec, L: 0
0928 20:02:42.005357 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.006760 (+ 1403us) spinlock_profiling.cc:243] Waited 900 us on lock 0x7b5400030fa0. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d1aab20 00007ff79d2343d2 00007ff79d2297f7 00007ff79d229634 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231
0928 20:02:42.007165 (+ 405us) log.cc:844] Serialized 765 byte log entry
0928 20:02:42.327185 (+320020us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.327961 (+ 776us) write_op.cc:301] APPLY: starting
0928 20:02:42.328017 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.328136 (+ 119us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.328150 (+ 14us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.328551 (+ 401us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.328699 (+ 148us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:42.328742 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:42.328917 (+ 175us) log.cc:844] Serialized 29 byte log entry
0928 20:02:42.329064 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.329128 (+ 64us) write_op.cc:454] Released schema lock
0928 20:02:42.329159 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.329415 (+ 256us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.329440 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":200917376,"child_traces":[["op",{"apply.queue_time_us":568,"apply.run_cpu_time_us":1411,"apply.run_wall_time_us":1411,"num_ops":2,"prepare.queue_time_us":35055,"prepare.run_cpu_time_us":2431,"prepare.run_wall_time_us":3261,"replication_time_us":321710,"spinlock_wait_cycles":2069248}]]}
I20260928 20:02:43.142892 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3c29918c975a40a694cdc5554d5c8a2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:43.144824 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c29918c975a40a694cdc5554d5c8a2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.145562 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet cb970d91179e48cdbbb1e32a3ca3171c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:29 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.151759 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.152387 26658 raft_consensus.cc:2468] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:43.149689 27599 raft_consensus.cc:515] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.158766 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:43.159289 26511 raft_consensus.cc:3060] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:43.160611 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet b087dcc9d5be4a9e89c35c359a18ca5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:30 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.160791 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:42 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.161500 27615 tablet_replica.cc:333] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:43.162545 27615 raft_consensus.cc:2243] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.163009 27615 raft_consensus.cc:2272] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.158136 26912 ts_tablet_manager.cc:1480] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.087s user 0.005s sys 0.000s
I20260928 20:02:43.165108 27615 ts_tablet_manager.cc:1962] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.166244 27612 raft_consensus.cc:493] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.166728 27612 raft_consensus.cc:515] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.168612 27612 leader_election.cc:290] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.170037 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:43.160607 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 03370aeac73549a195a16382aa6f9de3 with delete_type TABLET_DATA_DELETED (replaced by tablet 718a2abfe21b4a2986b77e14e4e52152) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.170619 26516 raft_consensus.cc:2468] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:43.171810 26740 leader_election.cc:304] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:43.172204 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a367ac8973bb4ec4a752434bf59cd2a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:43.173161 26912 tablet_bootstrap.cc:492] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:43.173295 27612 raft_consensus.cc:2804] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:43.173645 27612 raft_consensus.cc:493] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:43.173825 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.174000 27612 raft_consensus.cc:3060] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:43.174170 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a367ac8973bb4ec4a752434bf59cd2a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.175125 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cda7651d4cf4c7e82c7329735e6bdcc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:43.176417 26739 leader_election.cc:343] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:43.177227 26739 leader_election.cc:343] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: Tablet not RUNNING: STOPPED
I20260928 20:02:43.072891 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.180485 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.184163 26913 tablet_bootstrap.cc:654] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:43.186488 26740 consensus_peers.cc:597] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa037333676c4dba93160c5e3337f891. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:43.192003 27557 raft_consensus.cc:493] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.192405 27557 raft_consensus.cc:515] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:43.194255 27557 leader_election.cc:290] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:43.195921 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70df4ddf0f9430980c967d798ed6c50" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.196488 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70df4ddf0f9430980c967d798ed6c50" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:02:43.197227 26739 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:43.198061 26740 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Illegal state: Tablet not RUNNING: STOPPED
I20260928 20:02:43.198459 26740 leader_election.cc:304] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:43.199059 27557 raft_consensus.cc:2749] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:43.213047 26230 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 52) took 2789 ms (client timeout 1000 ms). Trace:
I20260928 20:02:43.217013 26912 tablet_bootstrap.cc:654] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:43.213578 26230 rpcz_store.cc:269] 0928 20:02:40.423785 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:40.505377 (+ 81592us) service_pool.cc:224] Handling call
0928 20:02:43.212944 (+2707567us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:40.995648 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:40.996178 (+ 530us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:40.996214 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:40.996234 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:40.996544 (+ 310us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:40.996600 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:40.996633 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:40.996809 (+ 176us) tablet.cc:701] Row locks acquired
0928 20:02:40.996828 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:40.996955 (+ 127us) write_op.cc:270] Start()
0928 20:02:40.997063 (+ 108us) write_op.cc:276] Timestamp: P: 1790625760996878 usec, L: 0
0928 20:02:40.997085 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:02:40.997655 (+ 570us) log.cc:844] Serialized 536 byte log entry
0928 20:02:41.007083 (+ 9428us) op_driver.cc:464] REPLICATION: finished
0928 20:02:41.007411 (+ 328us) write_op.cc:301] APPLY: starting
0928 20:02:41.007472 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:41.007559 (+ 87us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:41.007648 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:41.007812 (+ 164us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:41.007955 (+ 143us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:41.008012 (+ 57us) write_op.cc:312] APPLY: finished
0928 20:02:41.008211 (+ 199us) log.cc:844] Serialized 23 byte log entry
0928 20:02:41.008355 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:41.008413 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:41.008445 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:41.008647 (+ 202us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:41.008676 (+ 29us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 20:02:41.568248 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:41.568923 (+ 675us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:41.568976 (+ 53us) write_op.cc:435] Acquired schema lock
0928 20:02:41.569001 (+ 25us) tablet.cc:662] Decoding operations
0928 20:02:41.569441 (+ 440us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:41.569512 (+ 71us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:41.569550 (+ 38us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:41.569847 (+ 297us) tablet.cc:701] Row locks acquired
0928 20:02:41.569877 (+ 30us) write_op.cc:260] PREPARE: finished
0928 20:02:41.570037 (+ 160us) write_op.cc:270] Start()
0928 20:02:41.570217 (+ 180us) write_op.cc:276] Timestamp: P: 1790625761569945 usec, L: 0
0928 20:02:41.570248 (+ 31us) op_driver.cc:348] REPLICATION: starting
0928 20:02:41.571338 (+ 1090us) log.cc:844] Serialized 356 byte log entry
0928 20:02:41.845989 (+274651us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b580005f9d0. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d1879cc 00007ff79d18e2e3 00007ff79d18e269 00007ff79d18e1f9 00007ff79d18e1c1 00007ff79d18d38d 00000000005bd5a4 00000000005bd3d9 00007ff7960ca5c5 00007ff7960cc931
0928 20:02:41.885211 (+ 39222us) op_driver.cc:464] REPLICATION: finished
0928 20:02:41.968234 (+ 83023us) write_op.cc:301] APPLY: starting
0928 20:02:41.968325 (+ 91us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:41.968477 (+ 152us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:41.968509 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:41.968844 (+ 335us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.003517 (+ 34673us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:42.003560 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:42.003745 (+ 185us) log.cc:844] Serialized 23 byte log entry
0928 20:02:42.004278 (+ 533us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.004341 (+ 63us) write_op.cc:454] Released schema lock
0928 20:02:42.004373 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.004672 (+ 299us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.004695 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":117600,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":183,"apply.run_cpu_time_us":1204,"apply.run_wall_time_us":1204,"num_ops":1,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":2338,"prepare.run_wall_time_us":2339,"raft.queue_time_us":487,"raft.run_cpu_time_us":666,"raft.run_wall_time_us":14826,"replication_time_us":9894}],["op",{"apply.queue_time_us":82777,"apply.run_cpu_time_us":1542,"apply.run_wall_time_us":36409,"mutex_wait_us":210803,"num_ops":1,"prepare.queue_time_us":213140,"prepare.run_cpu_time_us":3569,"prepare.run_wall_time_us":5486,"raft.queue_time_us":12745,"raft.run_cpu_time_us":3640,"raft.run_wall_time_us":259745,"replication_time_us":314875,"spinlock_wait_cycles":595515136,"thread_start_us":112778,"threads_started":1}]]}
I20260928 20:02:43.221390 27530 ts_tablet_manager.cc:1975] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.221807 27530 log.cc:1199] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/afceff93f6f9401f94bab3e376925d12
I20260928 20:02:43.225400 27530 ts_tablet_manager.cc:1996] T afceff93f6f9401f94bab3e376925d12 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:43.227993 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.229421 27599 leader_election.cc:290] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.230908 26511 raft_consensus.cc:2468] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:43.239030 26913 tablet_bootstrap.cc:492] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:43.239421 26913 ts_tablet_manager.cc:1449] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.129s user 0.007s sys 0.003s
I20260928 20:02:43.245728 27530 tablet_replica.cc:333] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:43.246871 27530 raft_consensus.cc:2243] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.247397 27530 raft_consensus.cc:2272] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.255566 27530 ts_tablet_manager.cc:1962] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.259648 27615 ts_tablet_manager.cc:1975] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.261299 27615 log.cc:1199] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:43.278491 26740 leader_election.cc:304] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
W20260928 20:02:43.279099 26740 raft_consensus.cc:2686] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:43.272876 26913 raft_consensus.cc:359] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.294354 26913 raft_consensus.cc:385] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.294689 26913 raft_consensus.cc:740] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.295339 26913 consensus_queue.cc:260] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.305176 27599 consensus_queue.cc:1048] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:43.307475 27655 tablet.cc:1751] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:43.275420 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 152323us
I20260928 20:02:43.313061 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.313534 27615 ts_tablet_manager.cc:1996] T 7cda7651d4cf4c7e82c7329735e6bdcc P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:43.314016 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.291656 27654 tablet.cc:1751] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:43.318832 26912 tablet_bootstrap.cc:492] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:43.319314 26912 ts_tablet_manager.cc:1449] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.146s user 0.014s sys 0.008s
I20260928 20:02:43.319669 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.319746 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.320199 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.322327 26912 raft_consensus.cc:359] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.322906 26912 raft_consensus.cc:385] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.323122 26912 raft_consensus.cc:740] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.247844 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet afceff93f6f9401f94bab3e376925d12 (table default.Table_dc5f631b1b5f4fd6a7f769b2c68069fa [id=c486fcc978ac4403a4fde5327a8e3f42]) successfully deleted
W20260928 20:02:43.324568 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 76758.7us
W20260928 20:02:43.252084 26232 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 51) took 2226 ms (client timeout 1000 ms). Trace:
W20260928 20:02:43.270813 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 52) took 1223 ms (client timeout 1000 ms). Trace:
I20260928 20:02:43.274441 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_30de384ddce34033879e39169006114f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:43.332469 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30de384ddce34033879e39169006114f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.302306 26229 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 290) took 1011 ms. Trace:
I20260928 20:02:43.336019 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 7cda7651d4cf4c7e82c7329735e6bdcc (table default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]) successfully deleted
W20260928 20:02:43.337107 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet c0fd24cd5adf4774a13aeac30315f6f9 because the tablet was not found. No further retry: Not found: Tablet not found: c0fd24cd5adf4774a13aeac30315f6f9
W20260928 20:02:43.327593 26232 rpcz_store.cc:269] 0928 20:02:41.025201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.168742 (+143541us) service_pool.cc:224] Handling call
0928 20:02:43.252008 (+2083266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.302404 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.303000 (+ 596us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.303036 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:02:42.303057 (+ 21us) tablet.cc:662] Decoding operations
0928 20:02:42.303681 (+ 624us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.303738 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.303774 (+ 36us) tablet.cc:685] Acquiring locks for 3 operations
0928 20:02:42.304143 (+ 369us) tablet.cc:701] Row locks acquired
0928 20:02:42.304163 (+ 20us) write_op.cc:260] PREPARE: finished
0928 20:02:42.304324 (+ 161us) write_op.cc:270] Start()
0928 20:02:42.304453 (+ 129us) write_op.cc:276] Timestamp: P: 1790625762304260 usec, L: 0
0928 20:02:42.304476 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.305275 (+ 799us) log.cc:844] Serialized 1302 byte log entry
0928 20:02:42.408847 (+103572us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.409234 (+ 387us) write_op.cc:301] APPLY: starting
0928 20:02:42.409284 (+ 50us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.409422 (+ 138us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.409509 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.409875 (+ 366us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.410035 (+ 160us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0928 20:02:42.410078 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:42.410331 (+ 253us) log.cc:844] Serialized 35 byte log entry
0928 20:02:42.410502 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.410593 (+ 91us) write_op.cc:454] Released schema lock
0928 20:02:42.410641 (+ 48us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.410898 (+ 257us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.410923 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":117453,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":1639,"apply.run_wall_time_us":1638,"num_ops":3,"prepare.queue_time_us":4741,"prepare.run_cpu_time_us":3204,"prepare.run_wall_time_us":3204,"replication_time_us":104251}]]}
I20260928 20:02:43.340101 26232 master_service.cc:960] ReplaceTablet: received request to replace tablet 0216c99dfd8f498595f3f7dbadf8a79b from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:43.308079 27656 raft_consensus.cc:493] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.341507 27656 raft_consensus.cc:515] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:43.342456 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_557ff1874c914338876196686cfd7c4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:43.344091 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_557ff1874c914338876196686cfd7c4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.346274 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.346644 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.346994 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.348893 27660 tablet.cc:1751] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:43.353247 27612 raft_consensus.cc:515] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:43.355425 26234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 70) took 2302 ms (client timeout 1000 ms). Trace:
W20260928 20:02:43.355794 26234 rpcz_store.cc:269] 0928 20:02:41.053139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.206796 (+153657us) service_pool.cc:224] Handling call
0928 20:02:41.398876 (+192080us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:43.355340 (+1956464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24773,"reported_tablets":28,"spinlock_wait_cycles":177766656}
I20260928 20:02:43.359978 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.360522 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.356791 27517 raft_consensus.cc:493] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.362531 27517 raft_consensus.cc:515] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.364477 27517 leader_election.cc:290] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:43.375077 26916 tablet_bootstrap.cc:654] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.379773 27531 ts_tablet_manager.cc:1975] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.380326 27531 log.cc:1199] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:43.381276 27531 ts_tablet_manager.cc:1996] T e70df4ddf0f9430980c967d798ed6c50 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:43.358628 27656 leader_election.cc:290] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:43.358700 26912 consensus_queue.cc:260] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.398983 26912 ts_tablet_manager.cc:1480] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
W20260928 20:02:43.364192 26740 leader_election.cc:343] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:43.370468 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c267b42754dbca8eb5ebec2d66a23" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:43.400450 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:43.400938 26516 raft_consensus.cc:3060] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:43.401710 26450 leader_election.cc:343] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.407015 26912 tablet_bootstrap.cc:492] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:43.412499 26912 tablet_bootstrap.cc:654] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.416196 26516 raft_consensus.cc:2468] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:43.417533 26740 leader_election.cc:304] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:43.418308 27656 raft_consensus.cc:2804] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:43.418866 27656 raft_consensus.cc:697] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:43.419708 27656 consensus_queue.cc:237] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.376667 27530 ts_tablet_manager.cc:1975] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.422390 27530 log.cc:1199] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:43.423094 26913 ts_tablet_manager.cc:1480] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.183s user 0.007s sys 0.000s
I20260928 20:02:43.423417 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet afceff93f6f9401f94bab3e376925d12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:32 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:43.423838 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 80160.2us
I20260928 20:02:43.425081 27530 ts_tablet_manager.cc:1996] T 7cda7651d4cf4c7e82c7329735e6bdcc P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:43.428885 27530 tablet_replica.cc:333] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:43.430781 27531 tablet_replica.cc:333] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:43.431542 27531 raft_consensus.cc:2243] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.431978 27531 raft_consensus.cc:2272] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.433622 27531 ts_tablet_manager.cc:1962] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:43.280099 26227 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 53) took 1626 ms (client timeout 1000 ms). Trace:
I20260928 20:02:43.397305 27612 leader_election.cc:290] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:43.330236 26235 rpcz_store.cc:269] 0928 20:02:42.047274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:42.310514 (+263240us) service_pool.cc:224] Handling call
0928 20:02:42.463108 (+152594us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:43.270711 (+807603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.739719 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.740145 (+ 426us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.740172 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:42.740185 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:42.740445 (+ 260us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.740486 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.740506 (+ 20us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:42.740649 (+ 143us) tablet.cc:701] Row locks acquired
0928 20:02:42.740665 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:42.740771 (+ 106us) write_op.cc:270] Start()
0928 20:02:42.740860 (+ 89us) write_op.cc:276] Timestamp: P: 1790625762740719 usec, L: 0
0928 20:02:42.740874 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.741345 (+ 471us) log.cc:844] Serialized 356 byte log entry
0928 20:02:42.764879 (+ 23534us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.765310 (+ 431us) write_op.cc:301] APPLY: starting
0928 20:02:42.765363 (+ 53us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.765458 (+ 95us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.765548 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.765723 (+ 175us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.765846 (+ 123us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:42.765900 (+ 54us) write_op.cc:312] APPLY: finished
0928 20:02:42.766066 (+ 166us) log.cc:844] Serialized 23 byte log entry
0928 20:02:42.766226 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.766284 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:42.766317 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.766532 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.766556 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":89296,"reported_tablets":18,"spinlock_wait_cycles":41516416,"child_traces":[["op",{"apply.queue_time_us":270,"apply.run_cpu_time_us":1207,"apply.run_wall_time_us":1207,"mutex_wait_us":868,"num_ops":1,"prepare.queue_time_us":15441,"prepare.run_cpu_time_us":1994,"prepare.run_wall_time_us":2849,"raft.queue_time_us":1056,"raft.run_cpu_time_us":673,"raft.run_wall_time_us":675,"replication_time_us":23914}]]}
I20260928 20:02:43.440683 27530 raft_consensus.cc:2243] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.440997 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet 12a86cd5167c43a4beb51cd3138cdef8 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:43.441102 27530 raft_consensus.cc:2272] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.316097 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fa816eb9f57a489f807cdadfb66680b9" } new_table_name: "default.Table_f77e79769ec14ab0ace5b45b517ec34d" modify_external_catalogs: true
I20260928 20:02:43.335752 26229 rpcz_store.cc:276] 0928 20:02:42.290446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.138000 (+847554us) service_pool.cc:224] Handling call
0928 20:02:43.174532 (+ 36532us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:43.211155 (+ 36623us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:43.301700 (+ 90545us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:43.301969 (+ 269us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:43.302238 (+ 269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:43.280551 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:43.280946 (+ 395us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:43.280984 (+ 38us) write_op.cc:435] Acquired schema lock
0928 20:02:43.281003 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:43.281295 (+ 292us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:43.281335 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:43.281360 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:43.281564 (+ 204us) tablet.cc:701] Row locks acquired
0928 20:02:43.281580 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:43.281682 (+ 102us) write_op.cc:270] Start()
0928 20:02:43.281768 (+ 86us) write_op.cc:276] Timestamp: P: 1790625763281632 usec, L: 0
0928 20:02:43.281783 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:43.282263 (+ 480us) log.cc:844] Serialized 433 byte log entry
0928 20:02:43.291324 (+ 9061us) op_driver.cc:464] REPLICATION: finished
0928 20:02:43.291646 (+ 322us) write_op.cc:301] APPLY: starting
0928 20:02:43.291694 (+ 48us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:43.291790 (+ 96us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:43.291873 (+ 83us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:43.292256 (+ 383us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:43.292387 (+ 131us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:43.292433 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:02:43.292616 (+ 183us) log.cc:844] Serialized 29 byte log entry
0928 20:02:43.292758 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:43.292828 (+ 70us) write_op.cc:454] Released schema lock
0928 20:02:43.292861 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:43.293070 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:43.293097 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":1393,"apply.run_wall_time_us":1392,"num_ops":2,"prepare.queue_time_us":68020,"prepare.run_cpu_time_us":1986,"prepare.run_wall_time_us":2727,"raft.queue_time_us":89,"raft.run_cpu_time_us":567,"raft.run_wall_time_us":567,"replication_time_us":9466}]]}
I20260928 20:02:43.442625 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c94837fc38444486aa0a38bb0653aab2" } new_table_name: "default.Table_feca5d3c0a9648ce92c983a608eb7cda" modify_external_catalogs: true
I20260928 20:02:43.444252 27530 ts_tablet_manager.cc:1962] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.427680 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 7cda7651d4cf4c7e82c7329735e6bdcc (table default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]) successfully deleted
W20260928 20:02:43.447489 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet d374d592fda8402faac70a923049c9ad because the tablet was not found. No further retry: Not found: Tablet not found: d374d592fda8402faac70a923049c9ad
W20260928 20:02:43.448402 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet cb970d91179e48cdbbb1e32a3ca3171c because the tablet was not found. No further retry: Not found: Tablet not found: cb970d91179e48cdbbb1e32a3ca3171c
I20260928 20:02:43.430577 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet e70df4ddf0f9430980c967d798ed6c50 (table default.Table_060bc0393e4d45c2a1ef08a71894f56d [id=14b35dc03a724a6d9062137acac612cc]) successfully deleted
W20260928 20:02:43.451392 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet b087dcc9d5be4a9e89c35c359a18ca5c because the tablet was not found. No further retry: Not found: Tablet not found: b087dcc9d5be4a9e89c35c359a18ca5c
W20260928 20:02:43.452041 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 03370aeac73549a195a16382aa6f9de3 because the tablet was not found. No further retry: Not found: Tablet not found: 03370aeac73549a195a16382aa6f9de3
I20260928 20:02:43.458339 27612 consensus_queue.cc:1048] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:43.469791 26912 tablet_bootstrap.cc:492] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:43.470396 26912 ts_tablet_manager.cc:1449] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.064s user 0.010s sys 0.000s
I20260928 20:02:43.472234 27530 ts_tablet_manager.cc:1975] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.476665 27530 log.cc:1199] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:43.477056 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.479014 27661 tablet.cc:1751] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:43.434356 26227 rpcz_store.cc:269] 0928 20:02:41.689689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:41.692068 (+ 2379us) service_pool.cc:224] Handling call
0928 20:02:43.280030 (+1587962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:42.488511 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.488892 (+ 381us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.488919 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:42.488932 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:42.489192 (+ 260us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.489232 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.489253 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:42.489411 (+ 158us) tablet.cc:701] Row locks acquired
0928 20:02:42.489427 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:42.489538 (+ 111us) write_op.cc:270] Start()
0928 20:02:42.489621 (+ 83us) write_op.cc:276] Timestamp: P: 1790625762489474 usec, L: 0
0928 20:02:42.489638 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.490090 (+ 452us) log.cc:844] Serialized 536 byte log entry
0928 20:02:42.556002 (+ 65912us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.556340 (+ 338us) write_op.cc:301] APPLY: starting
0928 20:02:42.556394 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.556501 (+ 107us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.556591 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.556788 (+ 197us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.556925 (+ 137us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:42.556983 (+ 58us) write_op.cc:312] APPLY: finished
0928 20:02:42.557167 (+ 184us) log.cc:844] Serialized 23 byte log entry
0928 20:02:42.557325 (+ 158us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.557402 (+ 77us) write_op.cc:454] Released schema lock
0928 20:02:42.557451 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.557751 (+ 300us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.557787 (+ 36us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 20:02:42.569263 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:42.569643 (+ 380us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:42.569667 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:42.569681 (+ 14us) tablet.cc:662] Decoding operations
0928 20:02:42.569943 (+ 262us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:42.569982 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:42.570006 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:42.570167 (+ 161us) tablet.cc:701] Row locks acquired
0928 20:02:42.570180 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:42.570283 (+ 103us) write_op.cc:270] Start()
0928 20:02:42.570361 (+ 78us) write_op.cc:276] Timestamp: P: 1790625762570245 usec, L: 0
0928 20:02:42.570376 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:42.570830 (+ 454us) log.cc:844] Serialized 356 byte log entry
0928 20:02:42.644060 (+ 73230us) op_driver.cc:464] REPLICATION: finished
0928 20:02:42.644379 (+ 319us) write_op.cc:301] APPLY: starting
0928 20:02:42.644443 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:42.644539 (+ 96us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:42.644631 (+ 92us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:42.644815 (+ 184us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:42.644944 (+ 129us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:42.645006 (+ 62us) write_op.cc:312] APPLY: finished
0928 20:02:42.645175 (+ 169us) log.cc:844] Serialized 23 byte log entry
0928 20:02:42.645343 (+ 168us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.645407 (+ 64us) write_op.cc:454] Released schema lock
0928 20:02:42.645437 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:42.645662 (+ 225us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:42.645684 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82353,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":197,"apply.run_cpu_time_us":1360,"apply.run_wall_time_us":1360,"num_ops":1,"prepare.queue_time_us":8048,"prepare.run_cpu_time_us":1796,"prepare.run_wall_time_us":1796,"replication_time_us":66248}],["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":1255,"apply.run_wall_time_us":1256,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":1750,"prepare.run_wall_time_us":1750,"replication_time_us":73539}]]}
W20260928 20:02:43.471705 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8cbffea517e2438d90ca234b9f72f733 has no consensus state
W20260928 20:02:43.473779 26229 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3e2de7890874892be6ae5a2008d8a12 consensus state has no leader
I20260928 20:02:43.482527 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.484020 26913 tablet_bootstrap.cc:492] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:43.485705 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.483014 27657 tablet.cc:1751] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:43.494369 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8163815661694d70ba4c2e36a424eaa1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.495910 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c267b42754dbca8eb5ebec2d66a23" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.497148 26912 raft_consensus.cc:359] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.498987 27615 tablet_replica.cc:333] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:43.501438 26651 raft_consensus.cc:3060] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:43.502833 26450 leader_election.cc:343] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.503216 26450 leader_election.cc:304] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:43.503818 27517 raft_consensus.cc:2749] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:43.505075 26739 leader_election.cc:343] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.505496 26739 leader_election.cc:304] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:43.505812 27530 ts_tablet_manager.cc:1996] T e70df4ddf0f9430980c967d798ed6c50 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:43.504781 26912 raft_consensus.cc:385] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.507119 26912 raft_consensus.cc:740] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.507725 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7b71cef2215d4ba9a0d4cdb625664604" } modify_external_catalogs: true
I20260928 20:02:43.508281 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7b71cef2215d4ba9a0d4cdb625664604" } modify_external_catalogs: true
I20260928 20:02:43.509936 26227 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_82491753b5fc4f5290c7b0ffaef58075" } modify_external_catalogs: true
I20260928 20:02:43.510502 26227 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_82491753b5fc4f5290c7b0ffaef58075" } modify_external_catalogs: true
W20260928 20:02:43.514657 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet afceff93f6f9401f94bab3e376925d12 because the tablet was not found. No further retry: Not found: Tablet not found: afceff93f6f9401f94bab3e376925d12
I20260928 20:02:43.514822 27526 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:43.515452 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4604b0cf7e56457086383c4314814b21 because the tablet was not found. No further retry: Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21
I20260928 20:02:43.515305 27526 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.515487 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_04d639a37e4b44ce9a3c670fc1bf41b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:43.517138 27526 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:43.517102 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.518850 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:43.519754 27517 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.520174 27517 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.521893 27612 raft_consensus.cc:2749] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:43.522325 27517 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:43.524683 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:43.493063 26916 tablet_bootstrap.cc:492] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:02:43.526207 26450 leader_election.cc:343] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.526386 26916 ts_tablet_manager.cc:1449] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.466s user 0.007s sys 0.003s
I20260928 20:02:43.527693 27612 consensus_queue.cc:1048] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:43.529100 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:43.529237 26916 raft_consensus.cc:359] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.529605 26516 raft_consensus.cc:2468] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:43.529881 26916 raft_consensus.cc:385] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.531059 26595 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:43.531787 26913 tablet_bootstrap.cc:654] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.541282 27526 raft_consensus.cc:2804] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:02:43.541646 27526 raft_consensus.cc:493] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:43.541966 27526 raft_consensus.cc:3060] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:43.558753 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.559079 27615 raft_consensus.cc:2243] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.559582 27615 raft_consensus.cc:2272] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.561728 27615 ts_tablet_manager.cc:1962] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.481031 27662 tablet.cc:1751] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:43.552760 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.554003 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.567015 27531 ts_tablet_manager.cc:1975] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.568729 27530 tablet_replica.cc:333] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:43.569482 27530 raft_consensus.cc:2243] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.578552 26912 consensus_queue.cc:260] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:43.581826 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 71) took 1436 ms (client timeout 1000 ms). Trace:
I20260928 20:02:43.568934 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet e70df4ddf0f9430980c967d798ed6c50 (table default.Table_060bc0393e4d45c2a1ef08a71894f56d [id=14b35dc03a724a6d9062137acac612cc]) successfully deleted
W20260928 20:02:43.590356 26231 rpcz_store.cc:269] 0928 20:02:42.145933 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:42.351493 (+205560us) service_pool.cc:224] Handling call
0928 20:02:43.581756 (+1230263us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":34}
I20260928 20:02:43.595881 27530 raft_consensus.cc:2272] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:43.597591 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_f77e79769ec14ab0ace5b45b517ec34d [id=d89268285ef14f5dbd9e5d503ecba72f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8cbffea517e2438d90ca234b9f72f733 has no consensus state
I20260928 20:02:43.605192 27530 ts_tablet_manager.cc:1962] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.610251 26912 ts_tablet_manager.cc:1480] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.140s user 0.005s sys 0.001s
W20260928 20:02:43.612514 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 99034.4us
I20260928 20:02:43.620136 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_92b4d9ef87464f9b9b5582e6d529ac49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:43.621790 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:43.621994 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92b4d9ef87464f9b9b5582e6d529ac49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.622361 26801 raft_consensus.cc:2468] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:43.628252 27531 log.cc:1199] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:43.628714 26912 tablet_bootstrap.cc:492] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:43.652097 27645 raft_consensus.cc:493] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.655371 27531 ts_tablet_manager.cc:1996] T 7cda7651d4cf4c7e82c7329735e6bdcc P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:43.582651 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.582777 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.583428 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.585177 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.567705 26916 raft_consensus.cc:740] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.661352 26916 consensus_queue.cc:260] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.652585 27645 raft_consensus.cc:515] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.646522 27517 raft_consensus.cc:493] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.663923 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 7cda7651d4cf4c7e82c7329735e6bdcc (table default.Table_7f275a96cadb4937b6e221953176c523 [id=e9fc07cf825b44bc89d5fbfc1f2fa18a]) successfully deleted
I20260928 20:02:43.664515 27517 raft_consensus.cc:515] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.671844 27517 leader_election.cc:290] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:43.673432 26912 tablet_bootstrap.cc:654] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.673239 27557 consensus_queue.cc:1048] T edc62660134e45f8bc958e95f4e56906 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:43.673400 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:43.675261 26450 leader_election.cc:343] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.675892 26916 ts_tablet_manager.cc:1480] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.149s user 0.007s sys 0.000s
I20260928 20:02:43.676750 26916 tablet_bootstrap.cc:492] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:43.677892 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet fa037333676c4dba93160c5e3337f891 because the tablet was not found. No further retry: Not found: Tablet not found: fa037333676c4dba93160c5e3337f891
I20260928 20:02:43.678735 27531 tablet_replica.cc:333] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:43.682397 27531 raft_consensus.cc:2243] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:43.682873 27531 raft_consensus.cc:2272] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.685464 27531 ts_tablet_manager.cc:1962] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.695883 27522 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.696352 27522 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.698136 26912 tablet_bootstrap.cc:492] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:43.698514 26912 ts_tablet_manager.cc:1449] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.073s user 0.008s sys 0.003s
I20260928 20:02:43.704641 26912 raft_consensus.cc:359] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.706961 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:43.707674 27645 leader_election.cc:290] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.708813 26916 tablet_bootstrap.cc:654] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.709709 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:43.710222 26515 raft_consensus.cc:2468] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:43.711184 26595 leader_election.cc:304] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:43.725816 26912 raft_consensus.cc:385] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.726671 26912 raft_consensus.cc:740] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.728156 26912 consensus_queue.cc:260] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.729097 27530 ts_tablet_manager.cc:1975] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:43.735177 27530 log.cc:1199] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:43.735954 27530 ts_tablet_manager.cc:1996] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:43.736380 26912 ts_tablet_manager.cc:1480] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.034s user 0.004s sys 0.001s
I20260928 20:02:43.745519 27647 raft_consensus.cc:2804] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:43.745906 27647 raft_consensus.cc:493] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:43.746241 27647 raft_consensus.cc:3060] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:43.747174 27530 tablet_replica.cc:333] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:43.748423 26912 tablet_bootstrap.cc:492] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:43.710158 27522 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.749315 27530 raft_consensus.cc:2243] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:43.750676 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]) successfully deleted
I20260928 20:02:43.752157 27530 pending_rounds.cc:70] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Trying to abort 1 pending ops.
I20260928 20:02:43.752897 27530 pending_rounds.cc:77] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403122845822976 op_type: NO_OP noop_request { }
I20260928 20:02:43.753899 27646 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.754350 27646 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.757887 26638 tablet_service.cc:1511] Processing CreateTablet for tablet fec512104cb6418db320e072476c2874 (DEFAULT_TABLE table=default.Table_28cdbc10adcb4b9da604e5bab2dda740 [id=44c95fceecbd42a38a0e6b240cc4b680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.756117 26775 tablet_service.cc:1511] Processing CreateTablet for tablet fec512104cb6418db320e072476c2874 (DEFAULT_TABLE table=default.Table_28cdbc10adcb4b9da604e5bab2dda740 [id=44c95fceecbd42a38a0e6b240cc4b680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.758971 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec512104cb6418db320e072476c2874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.758992 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec512104cb6418db320e072476c2874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.768051 26487 tablet_service.cc:1511] Processing CreateTablet for tablet fec512104cb6418db320e072476c2874 (DEFAULT_TABLE table=default.Table_28cdbc10adcb4b9da604e5bab2dda740 [id=44c95fceecbd42a38a0e6b240cc4b680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.768582 27647 raft_consensus.cc:515] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.769095 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec512104cb6418db320e072476c2874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.771560 27530 raft_consensus.cc:2889] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:43.771915 27530 raft_consensus.cc:2272] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:43.772162 26630 tablet_service.cc:1511] Processing CreateTablet for tablet ed48087b59c744f9a928c8d529b69211 (DEFAULT_TABLE table=default.Table_51d3ebaa7ade42cb81c42d1ff48266b9 [id=0599e8ff6ce546c8aab3a9b26b632e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.773286 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed48087b59c744f9a928c8d529b69211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.777032 27646 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.777194 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:43.778575 27526 raft_consensus.cc:515] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.780524 26781 tablet_service.cc:1511] Processing CreateTablet for tablet ed48087b59c744f9a928c8d529b69211 (DEFAULT_TABLE table=default.Table_51d3ebaa7ade42cb81c42d1ff48266b9 [id=0599e8ff6ce546c8aab3a9b26b632e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.781821 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed48087b59c744f9a928c8d529b69211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.799257 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 90b887f248114c1fbe539769daac776d (DEFAULT_TABLE table=default.Table_0cc6e9ab6483451aadcf7beddfa7058a [id=8c9cbf00a11841bca0bd04b6e73dfdbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.800298 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b887f248114c1fbe539769daac776d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.801607 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 1 got 0
I20260928 20:02:43.802948 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
W20260928 20:02:43.803686 26739 leader_election.cc:343] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.803977 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
W20260928 20:02:43.804327 26450 leader_election.cc:343] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.804688 26450 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:43.804980 27557 consensus_queue.cc:1048] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:43.811720 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 90b887f248114c1fbe539769daac776d (DEFAULT_TABLE table=default.Table_0cc6e9ab6483451aadcf7beddfa7058a [id=8c9cbf00a11841bca0bd04b6e73dfdbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.812728 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b887f248114c1fbe539769daac776d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.815289 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:43.829308 26912 tablet_bootstrap.cc:654] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.839210 27530 ts_tablet_manager.cc:1962] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.839437 27526 leader_election.cc:290] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:43.840003 26450 leader_election.cc:343] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:43.840389 26450 leader_election.cc:304] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:43.844570 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 0abf33cd0d114c25a729bd0eb8ae1278 (DEFAULT_TABLE table=default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.845548 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abf33cd0d114c25a729bd0eb8ae1278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.848407 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0e324d2ffadb4e90871cc056c736bd27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:43.850805 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f49f112093074642a3c3e1c6aed06c49" } new_table_name: "default.Table_8d26e012313e4a30b824a5f081aa548d" modify_external_catalogs: true
W20260928 20:02:43.849874 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e324d2ffadb4e90871cc056c736bd27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.863436 27656 consensus_queue.cc:1048] T 1d016129c3a140518cf310089360c7b7 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:43.865995 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 0abf33cd0d114c25a729bd0eb8ae1278 (DEFAULT_TABLE table=default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.866153 26483 tablet_service.cc:1511] Processing CreateTablet for tablet ed48087b59c744f9a928c8d529b69211 (DEFAULT_TABLE table=default.Table_51d3ebaa7ade42cb81c42d1ff48266b9 [id=0599e8ff6ce546c8aab3a9b26b632e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.867646 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 90b887f248114c1fbe539769daac776d (DEFAULT_TABLE table=default.Table_0cc6e9ab6483451aadcf7beddfa7058a [id=8c9cbf00a11841bca0bd04b6e73dfdbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.863709 27517 raft_consensus.cc:2749] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:43.879288 26913 tablet_bootstrap.cc:492] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:43.879709 26913 ts_tablet_manager.cc:1449] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.396s user 0.012s sys 0.004s
I20260928 20:02:43.879824 27647 leader_election.cc:290] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.869091 27476 raft_consensus.cc:2749] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:43.882417 26913 raft_consensus.cc:359] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.883031 26913 raft_consensus.cc:385] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.883257 26913 raft_consensus.cc:740] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:43.883867 26913 consensus_queue.cc:260] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.884495 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:43.885077 26512 raft_consensus.cc:3060] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:43.887431 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:43.888111 26801 raft_consensus.cc:2393] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:02:43.890254 26913 ts_tablet_manager.cc:1480] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260928 20:02:43.890754 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:43.891470 26913 tablet_bootstrap.cc:492] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:43.891515 26513 raft_consensus.cc:3060] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:43.895505 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abf33cd0d114c25a729bd0eb8ae1278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.897511 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 0216c99dfd8f498595f3f7dbadf8a79b
I20260928 20:02:43.898674 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b887f248114c1fbe539769daac776d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.900413 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed48087b59c744f9a928c8d529b69211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.901571 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:43.901715 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 0abf33cd0d114c25a729bd0eb8ae1278 (DEFAULT_TABLE table=default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.902139 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:43.902288 27557 raft_consensus.cc:493] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:43.903004 26232 catalog_manager.cc:6934] ReplaceTablet: tablet 0216c99dfd8f498595f3f7dbadf8a79b deleted and replaced by tablet 9db52eb6b080457583b0a59291995843
I20260928 20:02:43.902832 27557 raft_consensus.cc:515] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.903314 26232 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 294) took 1072 ms. Trace:
I20260928 20:02:43.905102 27557 leader_election.cc:290] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:43.906330 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 0de800a9344d4507b7903d08fcf8e988 (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:02:43.906535 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 8cbffea517e2438d90ca234b9f72f733 (DEFAULT_TABLE table=default.Table_f77e79769ec14ab0ace5b45b517ec34d [id=d89268285ef14f5dbd9e5d503ecba72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:43.907405 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbffea517e2438d90ca234b9f72f733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.907491 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:43.907968 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:43.903587 26232 rpcz_store.cc:276] 0928 20:02:42.830670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.339999 (+509329us) service_pool.cc:224] Handling call
0928 20:02:43.903261 (+563262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:43.741267 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:43.744397 (+ 3130us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:43.744423 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:43.744435 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:43.744735 (+ 300us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:43.744770 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:43.744793 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:43.745004 (+ 211us) tablet.cc:701] Row locks acquired
0928 20:02:43.745023 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:43.745136 (+ 113us) write_op.cc:270] Start()
0928 20:02:43.745212 (+ 76us) write_op.cc:276] Timestamp: P: 1790625763745097 usec, L: 0
0928 20:02:43.745227 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:43.845349 (+100122us) log.cc:844] Serialized 631 byte log entry
0928 20:02:43.845929 (+ 580us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d2296b8 00007ff79d6baeb1 00007ff79d6ba688 00007ff79d6bf321 00007ff79d6bf2d9 00007ff79d6bf269 00007ff79d6bf231 00007ff79d6be45d 00000000005bd5a4 00000000005bd3d9
0928 20:02:43.855851 (+ 9922us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b18000678a0. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79efc9c31 00007ff79efd6621 00007ff7960ca6a7 00007ff7960cc931 00007ff7960cc8e9 00007ff7960cc879 00007ff7960cc841 00007ff7960cbb3d 00000000005bd5a4 00000000005bd3d9 00007ff7960ad9fa
0928 20:02:43.894316 (+ 38465us) op_driver.cc:464] REPLICATION: finished
0928 20:02:43.894540 (+ 224us) write_op.cc:301] APPLY: starting
0928 20:02:43.894592 (+ 52us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:43.894750 (+ 158us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:43.894777 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:43.895240 (+ 463us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:43.895518 (+ 278us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:43.895584 (+ 66us) write_op.cc:312] APPLY: finished
0928 20:02:43.895843 (+ 259us) log.cc:844] Serialized 29 byte log entry
0928 20:02:43.896021 (+ 178us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:43.896105 (+ 84us) write_op.cc:454] Released schema lock
0928 20:02:43.896152 (+ 47us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:43.896439 (+ 287us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:43.896487 (+ 48us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":1845,"apply.run_wall_time_us":1844,"num_ops":2,"prepare.queue_time_us":8802,"prepare.run_cpu_time_us":3406,"prepare.run_wall_time_us":104868,"raft.queue_time_us":80,"raft.run_cpu_time_us":1121,"raft.run_wall_time_us":1121,"replication_time_us":149004,"spinlock_wait_cycles":247809920}]]}
W20260928 20:02:43.921209 26740 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:43.921178 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.926020 26652 raft_consensus.cc:3060] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:43.927804 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:43.928433 26801 raft_consensus.cc:2468] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:43.929989 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d4ea23c18e04819b28d3428d584f3ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:43.930459 26804 raft_consensus.cc:3060] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:02:43.934152 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abf33cd0d114c25a729bd0eb8ae1278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:43.936586 26804 raft_consensus.cc:2468] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:02:43.937584 26513 raft_consensus.cc:2468] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:43.938024 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:43.945581 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:42 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:43.946643 26913 tablet_bootstrap.cc:654] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:43.955621 27530 ts_tablet_manager.cc:1975] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260928 20:02:43.957646 26236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 53) took 841 ms (client timeout 1000 ms). Trace:
W20260928 20:02:43.957976 26236 rpcz_store.cc:269] 0928 20:02:43.116176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.125021 (+ 8845us) service_pool.cc:224] Handling call
0928 20:02:43.957583 (+832562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114763,"reported_tablets":24}
I20260928 20:02:43.963299 27531 ts_tablet_manager.cc:1975] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.975885 26595 leader_election.cc:304] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:43.978194 27526 raft_consensus.cc:2804] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:43.979036 27526 raft_consensus.cc:697] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:43.979890 27531 log.cc:1199] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:43.980031 27526 consensus_queue.cc:237] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.966825 26512 raft_consensus.cc:2468] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:02:43.981922 26595 leader_election.cc:304] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:02:43.983366 27675 raft_consensus.cc:2804] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:02:43.983776 27675 raft_consensus.cc:697] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:43.984480 27675 consensus_queue.cc:237] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:43.984972 27531 ts_tablet_manager.cc:1996] T 93fb4e1fd0584a42a4de9eab14d5578c P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:43.989048 26913 tablet_bootstrap.cc:492] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:43.989439 26913 ts_tablet_manager.cc:1449] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.098s user 0.018s sys 0.011s
I20260928 20:02:43.992511 26913 raft_consensus.cc:359] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:43.993008 27615 ts_tablet_manager.cc:1975] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:43.993446 27615 log.cc:1199] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/fa037333676c4dba93160c5e3337f891
I20260928 20:02:43.994211 27615 ts_tablet_manager.cc:1996] T fa037333676c4dba93160c5e3337f891 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:43.974059 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4de78b7781d43458cbf2d3e889357fc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:43.996016 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_007ea4b1225442a2b70ad99fa3bafe73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:43.996315 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 93fb4e1fd0584a42a4de9eab14d5578c (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]) successfully deleted
I20260928 20:02:43.996724 26801 raft_consensus.cc:3060] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:43.997539 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_007ea4b1225442a2b70ad99fa3bafe73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:43.986649 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 8cbffea517e2438d90ca234b9f72f733 (DEFAULT_TABLE table=default.Table_f77e79769ec14ab0ace5b45b517ec34d [id=d89268285ef14f5dbd9e5d503ecba72f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:43.998489 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet a0dd3080d50748d2ad79f472d3c17673 because the tablet was not found. No further retry: Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:43.998737 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbffea517e2438d90ca234b9f72f733. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:43.999970 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet aa4f373a46de433eabd3b35b6ed3d1e3 because the tablet was not found. No further retry: Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:44.000685 27531 tablet_replica.cc:333] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:44.000871 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_9ef30a62591542edab5ee1be742ee4b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:44.001439 27531 raft_consensus.cc:2243] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:44.001839 27531 raft_consensus.cc:2272] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:44.002265 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ef30a62591542edab5ee1be742ee4b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.003389 27531 ts_tablet_manager.cc:1962] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:43.995829 26912 tablet_bootstrap.cc:492] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:44.010412 26912 ts_tablet_manager.cc:1449] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.262s user 0.005s sys 0.015s
I20260928 20:02:44.013310 26912 raft_consensus.cc:359] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.013938 26912 raft_consensus.cc:385] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.013968 26916 tablet_bootstrap.cc:492] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:44.014231 26912 raft_consensus.cc:740] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.014405 26916 ts_tablet_manager.cc:1449] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.338s user 0.013s sys 0.004s
I20260928 20:02:44.014968 26912 consensus_queue.cc:260] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.017010 26916 raft_consensus.cc:359] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.017602 26916 raft_consensus.cc:385] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.017853 26916 raft_consensus.cc:740] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.018863 27530 log.cc:1199] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/fa037333676c4dba93160c5e3337f891
I20260928 20:02:44.019971 27530 ts_tablet_manager.cc:1996] T fa037333676c4dba93160c5e3337f891 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:44.028282 26232 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_feca5d3c0a9648ce92c983a608eb7cda" } new_table_name: "default.Table_510d412b30ab4062a23624ee27c50764" modify_external_catalogs: true
I20260928 20:02:44.029613 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet fa037333676c4dba93160c5e3337f891 (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]) successfully deleted
I20260928 20:02:44.024358 27688 consensus_queue.cc:1048] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:44.036065 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:02:44.036159 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:02:44.037387 26235 catalog_manager.cc:6934] ReplaceTablet: tablet 12a86cd5167c43a4beb51cd3138cdef8 deleted and replaced by tablet 30ef26307b9a459f8634d59b1ca373ef
I20260928 20:02:44.039312 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.039260 26916 consensus_queue.cc:260] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.040853 26801 raft_consensus.cc:2468] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:44.042013 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:44.042662 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:44.043265 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
I20260928 20:02:44.044945 26233 catalog_manager.cc:5838] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:44.048090 26916 ts_tablet_manager.cc:1480] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260928 20:02:44.051332 26912 ts_tablet_manager.cc:1480] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260928 20:02:44.054709 26912 tablet_bootstrap.cc:492] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:44.056272 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:44.056957 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:44.057492 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:44.058319 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_d91523ef25e54050a873a70bbc0c787a [id=0c98275433a24292b35617002df2cf6b]). Expected version 1 got 0
I20260928 20:02:44.059165 26916 tablet_bootstrap.cc:492] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:44.059067 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 0de800a9344d4507b7903d08fcf8e988 (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:02:44.059798 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]). Expected version 1 got 0
I20260928 20:02:44.060492 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:44.061059 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:44.062471 27530 tablet_replica.cc:333] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:44.077277 27476 raft_consensus.cc:493] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.077741 27476 raft_consensus.cc:515] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.079564 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.079655 27476 leader_election.cc:290] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:44.080137 27476 consensus_queue.cc:1048] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:44.082834 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.083361 26804 raft_consensus.cc:2468] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:44.085021 26450 leader_election.cc:304] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:44.087569 27688 raft_consensus.cc:2804] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:44.087898 27688 raft_consensus.cc:493] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:44.088225 27688 raft_consensus.cc:3060] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:44.092754 27530 raft_consensus.cc:2243] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:44.093218 27530 raft_consensus.cc:2272] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:44.093453 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet fa037333676c4dba93160c5e3337f891 (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]) successfully deleted
I20260928 20:02:43.993108 26913 raft_consensus.cc:385] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:43.997455 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:44.094715 26913 raft_consensus.cc:740] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.094880 27530 ts_tablet_manager.cc:1962] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:44.018931 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 8cbffea517e2438d90ca234b9f72f733 (DEFAULT_TABLE table=default.Table_f77e79769ec14ab0ace5b45b517ec34d [id=d89268285ef14f5dbd9e5d503ecba72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:44.095709 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbffea517e2438d90ca234b9f72f733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:44.095497 26913 consensus_queue.cc:260] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.097623 26913 ts_tablet_manager.cc:1480] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.108s user 0.002s sys 0.005s
I20260928 20:02:44.043290 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:44.098464 26913 tablet_bootstrap.cc:492] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:44.098582 27688 raft_consensus.cc:515] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.103824 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:44.104405 26804 raft_consensus.cc:3060] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:44.105427 27476 raft_consensus.cc:493] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.105988 27476 raft_consensus.cc:515] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.108980 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.111821 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_feca5d3c0a9648ce92c983a608eb7cda [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 2 got 0
W20260928 20:02:44.112557 26450 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.113065 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:44.113696 27476 leader_election.cc:290] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:44.045001 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:44.066381 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 90247.4us
I20260928 20:02:44.115350 26594 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.116376 27645 raft_consensus.cc:2749] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.118314 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:44.119020 26594 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.120496 26804 raft_consensus.cc:2468] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:44.122040 26450 leader_election.cc:304] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:44.123099 27517 raft_consensus.cc:2804] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:44.123821 27517 raft_consensus.cc:697] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:44.124621 27517 consensus_queue.cc:237] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.126721 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_22b94739706d4bcabfd2fe1c283c4ab9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.128688 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22b94739706d4bcabfd2fe1c283c4ab9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:44.129663 26739 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.130043 26739 leader_election.cc:304] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:44.130681 27656 raft_consensus.cc:2749] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.132326 27688 leader_election.cc:290] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:44.133388 26916 tablet_bootstrap.cc:654] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.140355 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.147294 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:44.150920 27531 ts_tablet_manager.cc:1975] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:44.151383 27531 log.cc:1199] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:44.163280 27531 ts_tablet_manager.cc:1996] T 38abbc891d9c4268820cb0faba3d08b5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:44.163774 27656 raft_consensus.cc:493] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.164202 27656 raft_consensus.cc:515] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.164559 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 38abbc891d9c4268820cb0faba3d08b5 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]) successfully deleted
I20260928 20:02:44.166189 27656 leader_election.cc:290] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:44.168267 26740 leader_election.cc:343] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:44.183524 26916 tablet_bootstrap.cc:492] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:44.184012 26916 ts_tablet_manager.cc:1449] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.125s user 0.009s sys 0.003s
I20260928 20:02:44.165693 26912 tablet_bootstrap.cc:654] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.196167 27703 tablet.cc:1751] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:44.197835 27702 tablet.cc:1751] T e6b8e89ff26a439c8f6d7784cd179698 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:44.197942 26916 raft_consensus.cc:359] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.198792 26916 raft_consensus.cc:385] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.199110 26916 raft_consensus.cc:740] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.199378 26234 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
W20260928 20:02:44.201447 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 946f215581734bf591ab05502e5ff4a0 because the tablet was not found. No further retry: Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:44.202867 26234 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_d9d394d2c0e641a98b38ba0ac3678399 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 1 got 0
W20260928 20:02:44.207007 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because the tablet was not found. No further retry: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
W20260928 20:02:44.209167 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 018497a652234fbdb04cf6c034bcc5d3 because the tablet was not found. No further retry: Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:44.211966 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:44.093209 27615 tablet_replica.cc:333] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:44.218696 27531 tablet_replica.cc:333] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:44.215188 26450 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.219089 26450 leader_election.cc:304] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.219388 27531 raft_consensus.cc:2243] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:44.220127 26916 consensus_queue.cc:260] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.220876 27517 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.216002 27688 raft_consensus.cc:493] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.221254 27517 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.221433 27688 raft_consensus.cc:515] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:44.214897 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 53756.5us
I20260928 20:02:44.223488 27688 leader_election.cc:290] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:44.224314 27517 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:44.224682 26232 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3e2de7890874892be6ae5a2008d8a12 consensus state has no leader
I20260928 20:02:44.229038 27699 raft_consensus.cc:2749] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.229177 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.229557 27699 raft_consensus.cc:493] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.229930 27699 raft_consensus.cc:515] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.232203 27699 leader_election.cc:290] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:44.232836 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:44.235432 26450 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.236367 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.190934 27526 raft_consensus.cc:2749] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:02:44.237447 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dd3080d50748d2ad79f472d3c17673" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:44.238348 26450 leader_election.cc:343] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:44.239341 26450 leader_election.cc:343] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.241536 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:44.244918 26916 ts_tablet_manager.cc:1480] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.061s user 0.005s sys 0.000s
I20260928 20:02:44.250864 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:44.258579 26232 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9383c6792e2d433ab615717932fa897e" } modify_external_catalogs: true
I20260928 20:02:44.259197 26232 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_9383c6792e2d433ab615717932fa897e" } modify_external_catalogs: true
I20260928 20:02:44.260360 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d9d394d2c0e641a98b38ba0ac3678399" } new_table_name: "default.Table_00cb1b06e60548f9af6ede2d5ded2429" modify_external_catalogs: true
I20260928 20:02:44.260519 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ccf4e77806ac4d888aa9b68621ef381d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:44.271451 26912 tablet_bootstrap.cc:492] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:44.271891 26912 ts_tablet_manager.cc:1449] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.217s user 0.004s sys 0.005s
I20260928 20:02:44.274739 26912 raft_consensus.cc:359] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:44.277112 26739 leader_election.cc:343] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.277529 26739 leader_election.cc:304] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:44.284303 26450 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.284811 26450 leader_election.cc:304] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.285597 27699 raft_consensus.cc:2749] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:44.286062 26450 leader_election.cc:343] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.286540 26450 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.290746 26916 tablet_bootstrap.cc:492] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:44.291178 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccf4e77806ac4d888aa9b68621ef381d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.291255 27557 raft_consensus.cc:2749] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:44.283237 26594 consensus_peers.cc:597] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:44.241110 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:44.313045 27696 log.cc:927] Time spent T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260928 20:02:44.305023 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:44.318638 27615 raft_consensus.cc:2243] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:44.318758 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_487262bf721f4183a8850da9cac26908" } modify_external_catalogs: true
I20260928 20:02:44.319262 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_487262bf721f4183a8850da9cac26908" } modify_external_catalogs: true
I20260928 20:02:44.319839 27615 raft_consensus.cc:2272] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:44.321923 27615 ts_tablet_manager.cc:1962] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:44.328627 26739 consensus_peers.cc:597] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:44.275367 26912 raft_consensus.cc:385] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.334403 26912 raft_consensus.cc:740] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.337142 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:42 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.337394 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.338811 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.335222 26912 consensus_queue.cc:260] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.340626 26912 ts_tablet_manager.cc:1480] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260928 20:02:44.345597 27530 ts_tablet_manager.cc:1975] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:44.346248 27530 log.cc:1199] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/946f215581734bf591ab05502e5ff4a0
I20260928 20:02:44.350919 27530 ts_tablet_manager.cc:1996] T 946f215581734bf591ab05502e5ff4a0 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:44.318002 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:44.349815 26916 tablet_bootstrap.cc:654] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.364099 26913 tablet_bootstrap.cc:654] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.367547 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 626a876a51d04095b5dd54726bb995f3
I20260928 20:02:44.367501 27699 raft_consensus.cc:2749] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:44.368314 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 82285.4us
I20260928 20:02:44.370239 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.374562 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:44.382483 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:44.389348 26916 tablet_bootstrap.cc:492] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:44.389765 26916 ts_tablet_manager.cc:1449] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.099s user 0.011s sys 0.000s
I20260928 20:02:44.390002 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet a86e8a782b3e46d09a45bbb7025546af from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:44.392166 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.397717 27699 raft_consensus.cc:493] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.398197 27699 raft_consensus.cc:515] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.398268 26916 raft_consensus.cc:359] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.399262 26916 raft_consensus.cc:385] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.399546 26916 raft_consensus.cc:740] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.400445 27699 leader_election.cc:290] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:44.402148 26450 leader_election.cc:343] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:44.403940 26450 leader_election.cc:343] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:44.404631 26450 leader_election.cc:343] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.404927 26450 leader_election.cc:304] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.418358 26916 consensus_queue.cc:260] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.421118 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:44.422941 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:44.425483 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:44.426307 26228 catalog_manager.cc:6934] ReplaceTablet: tablet a86e8a782b3e46d09a45bbb7025546af deleted and replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa
I20260928 20:02:44.426946 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:44.430657 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_219a0fee5c63431b9c6f80e4c01e0f05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:44.431660 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d91523ef25e54050a873a70bbc0c787a" } new_table_name: "default.Table_c381dba3a9c141fe9a2aa9dfec973fbd" modify_external_catalogs: true
W20260928 20:02:44.434055 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_219a0fee5c63431b9c6f80e4c01e0f05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:44.443648 26192 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5440 after lost signal to thread 26129
W20260928 20:02:44.444422 26192 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9a20 after lost signal to thread 26195
I20260928 20:02:44.445886 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c3320acca4da439bb957f8a82adbd8a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.449996 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3320acca4da439bb957f8a82adbd8a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.464668 26913 tablet_bootstrap.cc:492] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:44.465090 26913 ts_tablet_manager.cc:1449] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.367s user 0.005s sys 0.003s
I20260928 20:02:44.476858 27557 consensus_queue.cc:1048] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:44.478735 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3e3854f997f64d7d910310d5a64f929d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.480166 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e3854f997f64d7d910310d5a64f929d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.481824 27702 tablet.cc:1751] T 34d91ea748a94cb7a75cbbd2f39f49f6 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:44.503934 26912 tablet_bootstrap.cc:492] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:44.509135 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:44.509428 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 72) took 1106 ms (client timeout 1000 ms). Trace:
I20260928 20:02:44.512365 27703 tablet.cc:1751] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:44.515969 26913 raft_consensus.cc:359] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.516644 26913 raft_consensus.cc:385] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.516903 26913 raft_consensus.cc:740] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.517513 26913 consensus_queue.cc:260] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:44.529481 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 77435.4us
I20260928 20:02:44.504609 27530 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 252) took 1158 ms. Trace:
I20260928 20:02:44.531515 27530 rpcz_store.cc:276] 0928 20:02:43.346412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.346517 (+ 105us) service_pool.cc:224] Handling call
0928 20:02:44.062323 (+715806us) ts_tablet_manager.cc:1197] Deleting tablet 946f215581734bf591ab05502e5ff4a0
0928 20:02:44.062368 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:44.245942 (+183574us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.345481 (+ 99539us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.504554 (+159073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":715289}
I20260928 20:02:44.531952 27711 tablet.cc:1751] T e6b8e89ff26a439c8f6d7784cd179698 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:44.532770 27530 tablet_replica.cc:333] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:44.533499 27530 raft_consensus.cc:2243] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:44.534427 27530 pending_rounds.cc:70] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Trying to abort 1 pending ops.
I20260928 20:02:44.534633 27530 pending_rounds.cc:77] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403118289575936 op_type: NO_OP noop_request { }
I20260928 20:02:44.534935 27530 raft_consensus.cc:2889] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:44.535238 27530 raft_consensus.cc:2272] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:44.537492 27530 ts_tablet_manager.cc:1962] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:44.538589 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 946f215581734bf591ab05502e5ff4a0 (table default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd [id=78b4f1c42b7347169b12fd63aad7323e]) successfully deleted
I20260928 20:02:44.539332 27699 raft_consensus.cc:2749] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.532027 26913 ts_tablet_manager.cc:1480] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.067s user 0.006s sys 0.001s
I20260928 20:02:44.541682 26916 ts_tablet_manager.cc:1480] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.152s user 0.006s sys 0.001s
I20260928 20:02:44.541932 26913 tablet_bootstrap.cc:492] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:44.542270 27531 raft_consensus.cc:2272] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:44.543993 27531 ts_tablet_manager.cc:1962] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:44.545550 26916 tablet_bootstrap.cc:492] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:44.552136 26916 tablet_bootstrap.cc:654] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.556738 27699 raft_consensus.cc:493] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.557325 27699 raft_consensus.cc:515] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.559662 27676 raft_consensus.cc:493] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.560128 27699 leader_election.cc:290] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:44.560110 27676 raft_consensus.cc:515] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.562057 27676 leader_election.cc:290] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:44.509760 26233 rpcz_store.cc:269] 0928 20:02:43.402842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.408919 (+ 6077us) service_pool.cc:224] Handling call
0928 20:02:44.509360 (+1100441us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:44.149851 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:44.150249 (+ 398us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:44.150275 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:44.150289 (+ 14us) tablet.cc:662] Decoding operations
0928 20:02:44.150542 (+ 253us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:44.150577 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:44.150599 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:44.150740 (+ 141us) tablet.cc:701] Row locks acquired
0928 20:02:44.150752 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:44.150854 (+ 102us) write_op.cc:270] Start()
0928 20:02:44.150931 (+ 77us) write_op.cc:276] Timestamp: P: 1790625764150783 usec, L: 0
0928 20:02:44.150946 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:44.151403 (+ 457us) log.cc:844] Serialized 536 byte log entry
0928 20:02:44.187553 (+ 36150us) op_driver.cc:464] REPLICATION: finished
0928 20:02:44.188578 (+ 1025us) write_op.cc:301] APPLY: starting
0928 20:02:44.188628 (+ 50us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:44.188710 (+ 82us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:44.188826 (+ 116us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:44.188971 (+ 145us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:44.189087 (+ 116us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:44.189126 (+ 39us) write_op.cc:312] APPLY: finished
0928 20:02:44.189270 (+ 144us) log.cc:844] Serialized 23 byte log entry
0928 20:02:44.189376 (+ 106us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:44.189431 (+ 55us) write_op.cc:454] Released schema lock
0928 20:02:44.189461 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:44.189676 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:44.189702 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":872,"apply.run_cpu_time_us":1065,"apply.run_wall_time_us":1065,"num_ops":1,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":1758,"prepare.run_wall_time_us":1757,"replication_time_us":36533,"spinlock_wait_cycles":7424}]]}
W20260928 20:02:44.565732 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 161108us
I20260928 20:02:44.566309 26913 tablet_bootstrap.cc:654] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.566030 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_505b4c5717db4fc4941b68e6271305a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.567559 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_505b4c5717db4fc4941b68e6271305a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.570827 27676 raft_consensus.cc:493] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:44.571242 27676 raft_consensus.cc:515] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.573191 27676 leader_election.cc:290] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:44.580044 26594 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:44.587545 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8163815661694d70ba4c2e36a424eaa1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.588125 26803 raft_consensus.cc:2468] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:44.597061 26594 leader_election.cc:304] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:44.597898 27676 raft_consensus.cc:2804] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:44.598292 27676 raft_consensus.cc:493] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:44.598680 27676 raft_consensus.cc:3060] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:44.599566 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6" } modify_external_catalogs: true
I20260928 20:02:44.605262 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6" } modify_external_catalogs: true
I20260928 20:02:44.605506 27676 raft_consensus.cc:515] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:44.606768 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bba200d6ef33438187dd643fe3ded009 consensus state has no leader
I20260928 20:02:44.614287 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b09ea4c7a617469e9e4de4fc21c34fa3" } new_table_name: "default.Table_c3352b560595410bbc6649fd418a6cc9" modify_external_catalogs: true
I20260928 20:02:44.631263 27530 ts_tablet_manager.cc:1975] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:44.631726 27530 log.cc:1199] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4604b0cf7e56457086383c4314814b21
I20260928 20:02:44.642275 27530 ts_tablet_manager.cc:1996] T 4604b0cf7e56457086383c4314814b21 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:44.642652 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.650327 26916 tablet_bootstrap.cc:492] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:44.650810 26916 ts_tablet_manager.cc:1449] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.105s user 0.008s sys 0.003s
W20260928 20:02:44.655381 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87024e1a4f184c669ff78efc918a9eef consensus state has no leader
I20260928 20:02:44.656414 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet ee4c267b42754dbca8eb5ebec2d66a23 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:44.675788 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775b9a076bf048bea39423d3554babf7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:44.680450 26916 raft_consensus.cc:359] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:44.681185 26916 raft_consensus.cc:385] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.681496 26916 raft_consensus.cc:740] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.684072 26912 tablet_bootstrap.cc:654] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.618340 26913 tablet_bootstrap.cc:492] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:44.687019 26913 ts_tablet_manager.cc:1449] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.145s user 0.010s sys 0.000s
I20260928 20:02:44.689033 27530 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 250) took 1343 ms. Trace:
I20260928 20:02:44.689352 27530 rpcz_store.cc:276] 0928 20:02:43.345601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.346874 (+ 1273us) service_pool.cc:224] Handling call
0928 20:02:44.532626 (+1185752us) ts_tablet_manager.cc:1197] Deleting tablet 4604b0cf7e56457086383c4314814b21
0928 20:02:44.532668 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:44.602067 (+ 69399us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.631115 (+ 29048us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.688967 (+ 57852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185190}
I20260928 20:02:44.691887 27530 tablet_replica.cc:333] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:44.693331 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 4604b0cf7e56457086383c4314814b21 (table default.Table_8be4bac0846045f1b0438d588fe17c76 [id=b89fadac9a1245d9a401cab84a9d7c90]) successfully deleted
W20260928 20:02:44.694016 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 0216c99dfd8f498595f3f7dbadf8a79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0216c99dfd8f498595f3f7dbadf8a79b already in progress: creating tablet
W20260928 20:02:44.694924 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 already in progress: creating tablet
W20260928 20:02:44.695485 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 12a86cd5167c43a4beb51cd3138cdef8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12a86cd5167c43a4beb51cd3138cdef8 already in progress: creating tablet
I20260928 20:02:44.696379 27530 raft_consensus.cc:2243] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:44.696852 27530 raft_consensus.cc:2272] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:44.698645 27530 ts_tablet_manager.cc:1962] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:44.708015 26450 leader_election.cc:343] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:44.708606 26450 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.715042 26916 consensus_queue.cc:260] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:44.704519 27682 log.cc:927] Time spent T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260928 20:02:44.724332 26595 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:44.724725 26595 leader_election.cc:304] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:44.725613 26595 leader_election.cc:343] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:44.727105 27645 raft_consensus.cc:2749] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.735740 26916 ts_tablet_manager.cc:1480] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.085s user 0.004s sys 0.001s
I20260928 20:02:44.737922 26916 tablet_bootstrap.cc:492] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:44.744236 26913 raft_consensus.cc:359] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.745013 26913 raft_consensus.cc:385] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.745312 26913 raft_consensus.cc:740] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.745946 26913 consensus_queue.cc:260] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:44.752978 27530 ts_tablet_manager.cc:1975] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:44.753311 27530 log.cc:1199] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:44.753906 27530 ts_tablet_manager.cc:1996] T c4de78b7781d43458cbf2d3e889357fc P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:44.754351 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775b9a076bf048bea39423d3554babf7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:44.762406 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:44.768405 26594 consensus_peers.cc:597] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:44.777132 26913 ts_tablet_manager.cc:1480] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.090s user 0.004s sys 0.001s
I20260928 20:02:44.789294 26913 tablet_bootstrap.cc:492] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:44.805174 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e4aa863223cc477b9b0ce2f8de2397d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.806896 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4aa863223cc477b9b0ce2f8de2397d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.807436 27676 leader_election.cc:290] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:44.808660 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8163815661694d70ba4c2e36a424eaa1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:44.809151 26803 raft_consensus.cc:3060] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:44.812265 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet c4de78b7781d43458cbf2d3e889357fc (table default.Table_7b71cef2215d4ba9a0d4cdb625664604 [id=f55e212e2f97427fba3f983fb0ff2cdf]) successfully deleted
W20260928 20:02:44.819187 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 626a876a51d04095b5dd54726bb995f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 626a876a51d04095b5dd54726bb995f3 already in progress: creating tablet
I20260928 20:02:44.820704 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_09a9a6797bd34617aff7f0c93964e903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.822181 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09a9a6797bd34617aff7f0c93964e903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:44.823173 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet a86e8a782b3e46d09a45bbb7025546af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a86e8a782b3e46d09a45bbb7025546af already in progress: creating tablet
I20260928 20:02:44.825230 27615 ts_tablet_manager.cc:1975] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:44.825641 27615 log.cc:1199] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:44.827814 27711 tablet.cc:1751] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:44.835201 26803 raft_consensus.cc:2468] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:44.836282 26594 leader_election.cc:304] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:44.837092 27676 raft_consensus.cc:2804] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:44.837792 27676 raft_consensus.cc:697] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:44.840853 27676 consensus_queue.cc:237] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.849100 26913 tablet_bootstrap.cc:654] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:44.863408 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_77549b4ee8db495692f2cc830dc826b2" } new_table_name: "default.Table_e9366f63d75e44b7b35246b02b57e643" modify_external_catalogs: true
I20260928 20:02:44.866714 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_5bc7581e446f47e49ffb90ba4d9c2520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.868333 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bc7581e446f47e49ffb90ba4d9c2520 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.870649 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet 5d4ea23c18e04819b28d3428d584f3ac from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:44.881484 26912 tablet_bootstrap.cc:492] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:44.881956 26912 ts_tablet_manager.cc:1449] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.378s user 0.011s sys 0.000s
I20260928 20:02:44.895092 26912 raft_consensus.cc:359] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.909516 26516 raft_consensus.cc:1275] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260928 20:02:44.909968 26450 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.910528 26450 leader_election.cc:304] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.911584 27699 raft_consensus.cc:2749] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.913473 27615 ts_tablet_manager.cc:1996] T 82e0acdca2ff4dfc9ae5ddc97d7aab24 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:44.915669 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 253) took 1430 ms. Trace:
I20260928 20:02:44.938645 27531 ts_tablet_manager.cc:1975] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:44.939146 27531 log.cc:1199] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:44.942618 27531 ts_tablet_manager.cc:1996] T b0655fc043b9468ea51ce5ae983e8f06 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:44.944583 26912 raft_consensus.cc:385] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:44.944958 26912 raft_consensus.cc:740] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:44.945799 26912 consensus_queue.cc:260] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:44.949198 26912 ts_tablet_manager.cc:1480] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.057s user 0.006s sys 0.000s
I20260928 20:02:44.952262 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 2 got 0
W20260928 20:02:44.953006 26450 leader_election.cc:343] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:44.953002 26231 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:44.953960 26450 leader_election.cc:304] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:44.954960 27517 raft_consensus.cc:2749] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:44.929865 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e649baee94ec4fe1a7416023a7b172c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:44.977159 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e649baee94ec4fe1a7416023a7b172c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:44.993599 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 2 got 0
I20260928 20:02:44.957592 27676 consensus_queue.cc:1048] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:44.961982 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 964f7c83a1c048688ea1f3227a88bb8f (DEFAULT_TABLE table=default.Table_0e324d2ffadb4e90871cc056c736bd27 [id=e260025cb2cd435bbb4389922d4a9426]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:44.963886 26595 leader_election.cc:343] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:44.994745 26228 catalog_manager.cc:5838] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:44.996866 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:44.996762 27615 rpcz_store.cc:276] 0928 20:02:43.485498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.485590 (+ 92us) service_pool.cc:224] Handling call
0928 20:02:44.093053 (+607463us) ts_tablet_manager.cc:1197] Deleting tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24
0928 20:02:44.093093 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:44.636421 (+543328us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.825095 (+188674us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.915611 (+ 90516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":606995}
I20260928 20:02:44.997429 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:44.998476 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]) successfully deleted
I20260928 20:02:45.000010 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964f7c83a1c048688ea1f3227a88bb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:44.993371 26913 tablet_bootstrap.cc:492] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:45.011397 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 964f7c83a1c048688ea1f3227a88bb8f (DEFAULT_TABLE table=default.Table_0e324d2ffadb4e90871cc056c736bd27 [id=e260025cb2cd435bbb4389922d4a9426]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.011502 26913 ts_tablet_manager.cc:1449] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.224s user 0.007s sys 0.004s
I20260928 20:02:45.012089 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 78c5918f0c05420b8ed8885c18c63907 (DEFAULT_TABLE table=default.Table_92b4d9ef87464f9b9b5582e6d529ac49 [id=57fa893f8f0f41fdb40c0150e9270d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.012470 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964f7c83a1c048688ea1f3227a88bb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.013057 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c5918f0c05420b8ed8885c18c63907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.025799 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 258) took 1118 ms. Trace:
I20260928 20:02:45.026270 27615 rpcz_store.cc:276] 0928 20:02:43.907298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.921014 (+ 13716us) service_pool.cc:224] Handling call
0928 20:02:44.999215 (+1078201us) ts_tablet_manager.cc:1197] Deleting tablet 0216c99dfd8f498595f3f7dbadf8a79b
0928 20:02:45.025474 (+ 26259us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.025736 (+ 262us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077606}
W20260928 20:02:45.027518 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 0216c99dfd8f498595f3f7dbadf8a79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0216c99dfd8f498595f3f7dbadf8a79b already in progress: creating tablet
I20260928 20:02:45.028079 27517 raft_consensus.cc:493] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.028148 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 259) took 1083 ms. Trace:
I20260928 20:02:45.028438 27615 rpcz_store.cc:276] 0928 20:02:43.945253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.945418 (+ 165us) service_pool.cc:224] Handling call
0928 20:02:45.027621 (+1082203us) ts_tablet_manager.cc:1197] Deleting tablet 7cda7651d4cf4c7e82c7329735e6bdcc
0928 20:02:45.027931 (+ 310us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.028098 (+ 167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1081573}
I20260928 20:02:45.028507 27517 raft_consensus.cc:515] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:45.029536 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 7cda7651d4cf4c7e82c7329735e6bdcc because the tablet was not found. No further retry: Not found: Tablet not found: 7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:45.030414 27517 leader_election.cc:290] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.032572 26916 tablet_bootstrap.cc:654] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.036674 26913 raft_consensus.cc:359] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.037326 26913 raft_consensus.cc:385] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.037575 26913 raft_consensus.cc:740] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.038313 26913 consensus_queue.cc:260] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.003883 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 964f7c83a1c048688ea1f3227a88bb8f (DEFAULT_TABLE table=default.Table_0e324d2ffadb4e90871cc056c736bd27 [id=e260025cb2cd435bbb4389922d4a9426]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.032002 26803 raft_consensus.cc:1275] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:02:45.039763 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964f7c83a1c048688ea1f3227a88bb8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.041015 26912 tablet_bootstrap.cc:492] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:45.042799 27517 raft_consensus.cc:493] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.043232 27517 raft_consensus.cc:515] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.044114 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 3eb8477c5cb74205b4b55eb38d7f9542
I20260928 20:02:45.044479 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 252) took 1492 ms. Trace:
I20260928 20:02:45.044965 27517 leader_election.cc:290] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.046661 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:45.048182 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:45.051203 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:45.044773 27531 rpcz_store.cc:276] 0928 20:02:43.552493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.552624 (+ 131us) service_pool.cc:224] Handling call
0928 20:02:44.218566 (+665942us) ts_tablet_manager.cc:1197] Deleting tablet b0655fc043b9468ea51ce5ae983e8f06
0928 20:02:44.218601 (+ 35us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:44.711391 (+492790us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:44.938509 (+227118us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.044419 (+105910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320164,"tablet-delete.queue_time_us":652081}
W20260928 20:02:45.053167 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 3eb8477c5cb74205b4b55eb38d7f9542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb8477c5cb74205b4b55eb38d7f9542 already in progress: creating tablet
I20260928 20:02:45.053316 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet b0655fc043b9468ea51ce5ae983e8f06 (table default.Table_bed2cb6494a544afb978a8521c702d03 [id=d8c4eedc317c4c5c8a008ab4ee6d94b3]) successfully deleted
I20260928 20:02:45.054183 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 253) took 1500 ms. Trace:
I20260928 20:02:45.054533 27531 rpcz_store.cc:276] 0928 20:02:43.553745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.553853 (+ 108us) service_pool.cc:224] Handling call
0928 20:02:45.053931 (+1500078us) ts_tablet_manager.cc:1197] Deleting tablet e70df4ddf0f9430980c967d798ed6c50
0928 20:02:45.053971 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.054131 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487257}
W20260928 20:02:45.055756 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet e70df4ddf0f9430980c967d798ed6c50 because the tablet was not found. No further retry: Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:45.056072 27656 raft_consensus.cc:493] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.056481 27656 raft_consensus.cc:515] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.057260 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f87f9401517747eb9784b49f2ffce310"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:45.057708 27531 tablet_replica.cc:333] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.058394 27656 leader_election.cc:290] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:45.058780 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f87f9401517747eb9784b49f2ffce310 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:45.062085 26740 leader_election.cc:343] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:45.066174 27531 raft_consensus.cc:2243] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.066622 27531 raft_consensus.cc:2272] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.068374 27531 ts_tablet_manager.cc:1962] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.069048 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.079533 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596a5540716441c49ec8185c8dc6a80c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.085937 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 78c5918f0c05420b8ed8885c18c63907 (DEFAULT_TABLE table=default.Table_92b4d9ef87464f9b9b5582e6d529ac49 [id=57fa893f8f0f41fdb40c0150e9270d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.086987 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c5918f0c05420b8ed8885c18c63907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.088322 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 78c5918f0c05420b8ed8885c18c63907 (DEFAULT_TABLE table=default.Table_92b4d9ef87464f9b9b5582e6d529ac49 [id=57fa893f8f0f41fdb40c0150e9270d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.089330 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c5918f0c05420b8ed8885c18c63907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.096138 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 263) took 1054 ms. Trace:
I20260928 20:02:45.102228 26916 tablet_bootstrap.cc:492] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.104346 27615 rpcz_store.cc:276] 0928 20:02:44.041710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.043131 (+ 1421us) service_pool.cc:224] Handling call
0928 20:02:45.029630 (+986499us) ts_tablet_manager.cc:1197] Deleting tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
0928 20:02:45.029675 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.096054 (+ 66379us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":931055}
I20260928 20:02:45.106282 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 5d4ea23c18e04819b28d3428d584f3ac
I20260928 20:02:45.107613 26235 catalog_manager.cc:6934] ReplaceTablet: tablet 5d4ea23c18e04819b28d3428d584f3ac deleted and replaced by tablet 3ed3cd78c90c42f6a99a92bae2cd5491
I20260928 20:02:45.115979 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac with delete_type TABLET_DATA_DELETED (replaced by tablet 3ed3cd78c90c42f6a99a92bae2cd5491) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:45.116655 27530 tablet_replica.cc:333] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:45.117339 27530 raft_consensus.cc:2243] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.117774 27530 raft_consensus.cc:2272] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.119442 27530 ts_tablet_manager.cc:1962] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.136976 27530 ts_tablet_manager.cc:1975] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.137346 27530 log.cc:1199] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/5d4ea23c18e04819b28d3428d584f3ac
I20260928 20:02:45.143353 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8691e84d63084dd38d8988f4311c83c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:45.145076 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8691e84d63084dd38d8988f4311c83c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:45.150818 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_d91523ef25e54050a873a70bbc0c787a [id=0c98275433a24292b35617002df2cf6b]). Expected version 1 got 0
I20260928 20:02:45.151549 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:45.152283 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:45.153687 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
W20260928 20:02:45.105337 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 65223.9us
I20260928 20:02:45.105777 27526 consensus_queue.cc:1048] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:45.108310 27647 raft_consensus.cc:493] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.157907 27647 raft_consensus.cc:515] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.159806 27647 leader_election.cc:290] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:45.109283 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 (DEFAULT_TABLE table=default.Table_557ff1874c914338876196686cfd7c4d [id=77d16903e74742babbe00ab8a7933795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.161355 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.110400 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018497a652234fbdb04cf6c034bcc5d3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:45.110759 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596a5540716441c49ec8185c8dc6a80c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:45.110406 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:45.137954 27530 ts_tablet_manager.cc:1996] T 5d4ea23c18e04819b28d3428d584f3ac P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:45.113328 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac with delete_type TABLET_DATA_DELETED (replaced by tablet 3ed3cd78c90c42f6a99a92bae2cd5491) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:45.164804 26739 leader_election.cc:343] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.165200 26739 leader_election.cc:304] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:45.166134 27712 raft_consensus.cc:493] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.166519 27712 raft_consensus.cc:515] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.168434 27712 leader_election.cc:290] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.168828 27712 raft_consensus.cc:2749] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:45.174620 26783 tablet_service.cc:1511] Processing CreateTablet for tablet d9f0f9d65836425f966e9ee4f709915c (DEFAULT_TABLE table=default.Table_a367ac8973bb4ec4a752434bf59cd2a0 [id=bc50bdfe400c42fcbe7487dd842368ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.176550 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f0f9d65836425f966e9ee4f709915c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.177222 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.177775 26800 raft_consensus.cc:2468] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:45.179806 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:45.182024 26594 leader_election.cc:304] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:45.184684 27645 raft_consensus.cc:2804] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:45.185007 27645 raft_consensus.cc:493] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:45.185317 27645 raft_consensus.cc:3060] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:45.185590 26638 tablet_service.cc:1511] Processing CreateTablet for tablet d9f0f9d65836425f966e9ee4f709915c (DEFAULT_TABLE table=default.Table_a367ac8973bb4ec4a752434bf59cd2a0 [id=bc50bdfe400c42fcbe7487dd842368ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.186581 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f0f9d65836425f966e9ee4f709915c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:45.194633 26739 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:45.204325 26594 consensus_peers.cc:597] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d4ea23c18e04819b28d3428d584f3ac. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:45.206570 27645 raft_consensus.cc:515] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.211865 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa4f373a46de433eabd3b35b6ed3d1e3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:45.212626 26803 raft_consensus.cc:3060] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:45.214322 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 (DEFAULT_TABLE table=default.Table_557ff1874c914338876196686cfd7c4d [id=77d16903e74742babbe00ab8a7933795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.221487 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 262) took 1180 ms. Trace:
I20260928 20:02:45.221863 27615 rpcz_store.cc:276] 0928 20:02:44.041372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.044862 (+ 3490us) service_pool.cc:224] Handling call
0928 20:02:45.221098 (+1176236us) ts_tablet_manager.cc:1197] Deleting tablet 12a86cd5167c43a4beb51cd3138cdef8
0928 20:02:45.221147 (+ 49us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.221426 (+ 279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1106493}
I20260928 20:02:45.223613 27615 tablet_replica.cc:333] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:45.224937 27615 raft_consensus.cc:2243] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:45.225133 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.225747 27615 pending_rounds.cc:70] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:45.228370 26912 tablet_bootstrap.cc:654] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.172935 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]) successfully deleted
W20260928 20:02:45.230126 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 57181.9us
W20260928 20:02:45.231526 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 already in progress: creating tablet
W20260928 20:02:45.232259 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 12a86cd5167c43a4beb51cd3138cdef8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12a86cd5167c43a4beb51cd3138cdef8 already in progress: creating tablet
I20260928 20:02:45.111364 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac with delete_type TABLET_DATA_DELETED (replaced by tablet 3ed3cd78c90c42f6a99a92bae2cd5491) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:45.119611 27531 ts_tablet_manager.cc:1975] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.232848 27531 log.cc:1199] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:45.200845 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet c6544b7b405c4831900f37e052892409 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:45.233595 27531 ts_tablet_manager.cc:1996] T 4d0308d824cf401c8cca0cf7a950fd53 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:45.181622 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_84ebe3d10b2a47e1b20e07785732df98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:45.151813 27517 consensus_queue.cc:1048] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:45.234238 27645 leader_election.cc:290] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:45.129266 26913 ts_tablet_manager.cc:1480] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.109s user 0.004s sys 0.000s
W20260928 20:02:45.234866 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84ebe3d10b2a47e1b20e07785732df98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:45.236193 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 256) took 1653 ms. Trace:
I20260928 20:02:45.236461 27531 rpcz_store.cc:276] 0928 20:02:43.582401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.582520 (+ 119us) service_pool.cc:224] Handling call
0928 20:02:45.057571 (+1475051us) ts_tablet_manager.cc:1197] Deleting tablet 4d0308d824cf401c8cca0cf7a950fd53
0928 20:02:45.057609 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.076315 (+ 18706us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.119383 (+ 43068us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.236137 (+116754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7678,"tablet-delete.queue_time_us":1397908}
I20260928 20:02:45.237686 26913 tablet_bootstrap.cc:492] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:45.238050 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 4d0308d824cf401c8cca0cf7a950fd53 (table default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]) successfully deleted
I20260928 20:02:45.239600 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:45.232867 26916 ts_tablet_manager.cc:1449] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.495s user 0.012s sys 0.000s
W20260928 20:02:45.152540 26450 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.160637 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 (DEFAULT_TABLE table=default.Table_557ff1874c914338876196686cfd7c4d [id=77d16903e74742babbe00ab8a7933795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.245043 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.249214 26493 tablet_service.cc:1511] Processing CreateTablet for tablet d9f0f9d65836425f966e9ee4f709915c (DEFAULT_TABLE table=default.Table_a367ac8973bb4ec4a752434bf59cd2a0 [id=bc50bdfe400c42fcbe7487dd842368ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.250218 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f0f9d65836425f966e9ee4f709915c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.209605 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:45.253078 26515 raft_consensus.cc:2468] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:45.254241 26740 leader_election.cc:304] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:45.255254 27656 raft_consensus.cc:2804] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:45.255576 27656 raft_consensus.cc:493] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:45.255889 27656 raft_consensus.cc:3060] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:45.259512 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 30ef26307b9a459f8634d59b1ca373ef (DEFAULT_TABLE table=default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.260526 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ef26307b9a459f8634d59b1ca373ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.263645 27656 raft_consensus.cc:515] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.267536 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:45.268129 26515 raft_consensus.cc:3060] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:45.270435 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 30ef26307b9a459f8634d59b1ca373ef (DEFAULT_TABLE table=default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.271544 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ef26307b9a459f8634d59b1ca373ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.273510 27531 tablet_replica.cc:333] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.274348 27531 raft_consensus.cc:2243] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.274784 27531 raft_consensus.cc:2272] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.276363 27531 ts_tablet_manager.cc:1962] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.276193 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e649baee94ec4fe1a7416023a7b172c2" } modify_external_catalogs: true
I20260928 20:02:45.276722 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e649baee94ec4fe1a7416023a7b172c2" } modify_external_catalogs: true
W20260928 20:02:45.279250 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 126732us
W20260928 20:02:45.279901 26450 leader_election.cc:343] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:45.282768 26450 consensus_peers.cc:597] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:45.283247 26450 leader_election.cc:343] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.283738 26450 leader_election.cc:304] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:45.289834 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 30ef26307b9a459f8634d59b1ca373ef (DEFAULT_TABLE table=default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.291209 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ef26307b9a459f8634d59b1ca373ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:45.296291 26229 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d90ce97d3db4bff8b2eea71c530c351 consensus state has no leader
I20260928 20:02:45.297907 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 0e0a362efb68408d8dce96dce0130035
I20260928 20:02:45.301201 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:45.303048 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:45.304692 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:45.305938 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 0e0a362efb68408d8dce96dce0130035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e0a362efb68408d8dce96dce0130035 already in progress: creating tablet
I20260928 20:02:45.307422 27517 raft_consensus.cc:2749] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:45.308594 26450 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.308957 26450 leader_election.cc:304] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:45.309369 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:45.309768 26916 raft_consensus.cc:359] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.310464 26916 raft_consensus.cc:385] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.310715 26916 raft_consensus.cc:740] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:02:45.310895 26739 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.311376 26916 consensus_queue.cc:260] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.312152 27517 raft_consensus.cc:2749] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:45.322521 27656 leader_election.cc:290] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.324544 26803 raft_consensus.cc:2468] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:45.325822 26594 leader_election.cc:304] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:45.326629 27676 raft_consensus.cc:2804] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:45.327380 27676 raft_consensus.cc:697] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:45.330040 27676 consensus_queue.cc:237] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.352017 27517 raft_consensus.cc:493] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.352455 27517 raft_consensus.cc:515] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.355007 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 9db52eb6b080457583b0a59291995843 (DEFAULT_TABLE table=default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.358147 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 9db52eb6b080457583b0a59291995843 (DEFAULT_TABLE table=default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.359365 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db52eb6b080457583b0a59291995843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.365073 26913 tablet_bootstrap.cc:654] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.225988 27615 pending_rounds.cc:77] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403129666494464 op_type: NO_OP noop_request { }
I20260928 20:02:45.380915 27615 raft_consensus.cc:2889] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:45.381295 27615 raft_consensus.cc:2272] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.408866 26235 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 74a4280f2f224cf8a80590b821a21960
I20260928 20:02:45.419485 27517 leader_election.cc:290] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.431358 26912 tablet_bootstrap.cc:492] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:45.430758 26916 ts_tablet_manager.cc:1480] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.188s user 0.012s sys 0.008s
I20260928 20:02:45.433225 26916 tablet_bootstrap.cc:492] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:45.436214 26515 raft_consensus.cc:2468] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:45.446252 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 (DEFAULT_TABLE table=default.Table_30de384ddce34033879e39169006114f [id=dc95367c9241478eb2594eecd28159e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.438808 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 9db52eb6b080457583b0a59291995843 (DEFAULT_TABLE table=default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.447232 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4056bc0590264672bd7c4f6d97050dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.447922 26916 tablet_bootstrap.cc:654] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.450444 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db52eb6b080457583b0a59291995843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.441241 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edf314241784091a603907a43429b28" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.459074 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_1b28541b1dad44e393063e5c45c35050"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:45.460947 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b28541b1dad44e393063e5c45c35050 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:45.463511 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_419bbb75ac2d4717b1cb696825cf70dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:45.465073 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_419bbb75ac2d4717b1cb696825cf70dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:45.465329 26740 leader_election.cc:304] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:45.465981 27712 raft_consensus.cc:2804] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:45.466426 27712 raft_consensus.cc:697] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:45.467178 27712 consensus_queue.cc:237] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.470638 26912 ts_tablet_manager.cc:1449] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.430s user 0.005s sys 0.006s
I20260928 20:02:45.474411 26912 raft_consensus.cc:359] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:45.477144 26450 leader_election.cc:343] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.477484 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3830bee23f7b423ab7799d67ec7eceb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:45.479004 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3830bee23f7b423ab7799d67ec7eceb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:45.498257 26916 tablet_bootstrap.cc:492] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.498648 26916 ts_tablet_manager.cc:1449] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.008s
I20260928 20:02:45.500869 26916 raft_consensus.cc:359] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.437837 26651 raft_consensus.cc:3060] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:45.511716 26916 raft_consensus.cc:385] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.514326 27531 ts_tablet_manager.cc:1975] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.514521 26916 raft_consensus.cc:740] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.514693 27531 log.cc:1199] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4c23636443834932852f21092be1d1ac
I20260928 20:02:45.515295 27531 ts_tablet_manager.cc:1996] T 4c23636443834932852f21092be1d1ac P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:45.515188 26916 consensus_queue.cc:260] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.447788 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db52eb6b080457583b0a59291995843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.461849 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edf314241784091a603907a43429b28" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:45.464037 26595 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3
W20260928 20:02:45.523552 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 59550.3us
W20260928 20:02:45.524312 26595 leader_election.cc:343] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3
W20260928 20:02:45.526470 26450 leader_election.cc:343] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.526860 26450 leader_election.cc:304] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:45.527866 27732 raft_consensus.cc:2749] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:45.532181 26916 ts_tablet_manager.cc:1480] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.033s user 0.005s sys 0.001s
I20260928 20:02:45.393169 27615 ts_tablet_manager.cc:1962] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.553727 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 (DEFAULT_TABLE table=default.Table_30de384ddce34033879e39169006114f [id=dc95367c9241478eb2594eecd28159e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.555111 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4056bc0590264672bd7c4f6d97050dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.565583 26916 tablet_bootstrap.cc:492] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:45.577744 26916 tablet_bootstrap.cc:654] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.585908 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 254) took 2004 ms. Trace:
I20260928 20:02:45.586282 27531 rpcz_store.cc:276] 0928 20:02:43.581587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.582571 (+ 984us) service_pool.cc:224] Handling call
0928 20:02:45.273354 (+1690783us) ts_tablet_manager.cc:1197] Deleting tablet 4c23636443834932852f21092be1d1ac
0928 20:02:45.273400 (+ 46us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.420276 (+146876us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.514210 (+ 93934us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.563236 (+ 49026us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866f1d2 00007f65515e8379 00007f65507f8c18 00007f65508c01b2 00007f65508f2080 00007f65508d84ad 00007f65508d8459 00007f65508d83e9 00007f65508d83b1
0928 20:02:45.585848 (+ 22612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28412672,"tablet-delete.queue_time_us":1613031}
I20260928 20:02:45.587471 27531 tablet_replica.cc:333] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.588202 27531 raft_consensus.cc:2243] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.588605 27531 raft_consensus.cc:2272] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.590144 27531 ts_tablet_manager.cc:1962] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.594753 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 4c23636443834932852f21092be1d1ac (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]) successfully deleted
I20260928 20:02:45.611780 26916 tablet_bootstrap.cc:492] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.612219 26916 ts_tablet_manager.cc:1449] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.000s
I20260928 20:02:45.614400 26916 raft_consensus.cc:359] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:45.615000 26916 raft_consensus.cc:385] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.615259 26916 raft_consensus.cc:740] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.621095 26227 catalog_manager.cc:5838] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:45.622598 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:45.616954 26916 consensus_queue.cc:260] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:45.629042 26916 ts_tablet_manager.cc:1480] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260928 20:02:45.545117 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 (DEFAULT_TABLE table=default.Table_30de384ddce34033879e39169006114f [id=dc95367c9241478eb2594eecd28159e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.638244 26912 raft_consensus.cc:385] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.638523 26912 raft_consensus.cc:740] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.638862 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4056bc0590264672bd7c4f6d97050dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.639034 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdb8870dce541a2afb3be09bcb3c701 (DEFAULT_TABLE table=default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 [id=b4cbe8131b3a4452bf9d0305f6d89940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.639271 26912 consensus_queue.cc:260] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.642871 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdb8870dce541a2afb3be09bcb3c701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.646492 26912 ts_tablet_manager.cc:1480] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.175s user 0.006s sys 0.000s
I20260928 20:02:45.647322 26912 tablet_bootstrap.cc:492] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:45.647409 26916 tablet_bootstrap.cc:492] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:45.648582 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2d90ce97d3db4bff8b2eea71c530c351 consensus state has no leader
I20260928 20:02:45.653559 26916 tablet_bootstrap.cc:654] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.661446 27531 ts_tablet_manager.cc:1975] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.661867 27531 log.cc:1199] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:45.662566 27531 ts_tablet_manager.cc:1996] T 2728c9979bb647a5a8f0a902c299e53d P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:45.675549 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdb8870dce541a2afb3be09bcb3c701 (DEFAULT_TABLE table=default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 [id=b4cbe8131b3a4452bf9d0305f6d89940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.675741 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdb8870dce541a2afb3be09bcb3c701 (DEFAULT_TABLE table=default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 [id=b4cbe8131b3a4452bf9d0305f6d89940]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:45.677752 26125 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48983.1us
I20260928 20:02:45.679690 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 255) took 2097 ms. Trace:
I20260928 20:02:45.637892 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:45.680019 27531 rpcz_store.cc:276] 0928 20:02:43.582002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.583255 (+ 1253us) service_pool.cc:224] Handling call
0928 20:02:45.587334 (+2004079us) ts_tablet_manager.cc:1197] Deleting tablet 2728c9979bb647a5a8f0a902c299e53d
0928 20:02:45.587372 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.599016 (+ 11644us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.661314 (+ 62298us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.679627 (+ 18313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1926590}
I20260928 20:02:45.686250 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 2728c9979bb647a5a8f0a902c299e53d (table default.Table_60b73bf93b434a499c613715e7cd6464 [id=42c910625bf147a08dd2e86593dee01a]) successfully deleted
I20260928 20:02:45.686594 27531 tablet_replica.cc:333] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.681677 26227 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497]). Expected version 2 got 0
I20260928 20:02:45.693212 27676 raft_consensus.cc:493] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.695060 26916 tablet_bootstrap.cc:492] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.695441 26916 ts_tablet_manager.cc:1449] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.054s user 0.009s sys 0.000s
I20260928 20:02:45.694670 27676 raft_consensus.cc:515] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:45.697665 26916 raft_consensus.cc:359] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:45.698318 26916 raft_consensus.cc:385] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.698565 26916 raft_consensus.cc:740] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.699164 27531 raft_consensus.cc:2243] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.699591 27531 raft_consensus.cc:2272] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:45.700963 26595 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:45.701704 27531 ts_tablet_manager.cc:1962] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.714360 26916 consensus_queue.cc:260] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:45.715771 26594 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:45.716331 26594 leader_election.cc:304] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:45.717296 27673 raft_consensus.cc:2749] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:45.719589 27676 leader_election.cc:290] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:45.722812 26595 consensus_peers.cc:597] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:45.727843 27645 consensus_queue.cc:1048] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:45.730484 26916 ts_tablet_manager.cc:1480] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20260928 20:02:45.731410 26916 tablet_bootstrap.cc:492] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:45.718380 26913 tablet_bootstrap.cc:492] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:45.740091 26913 ts_tablet_manager.cc:1449] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.505s user 0.006s sys 0.004s
I20260928 20:02:45.743566 27531 ts_tablet_manager.cc:1975] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.743906 27531 log.cc:1199] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:45.744481 27531 ts_tablet_manager.cc:1996] T 596a5540716441c49ec8185c8dc6a80c P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:45.744982 27732 raft_consensus.cc:493] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.746006 27732 raft_consensus.cc:515] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.748189 27732 leader_election.cc:290] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.750438 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:45.751912 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.755468 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 257) took 2170 ms. Trace:
I20260928 20:02:45.755771 27531 rpcz_store.cc:276] 0928 20:02:43.584852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.585019 (+ 167us) service_pool.cc:224] Handling call
0928 20:02:45.686456 (+2101437us) ts_tablet_manager.cc:1197] Deleting tablet 596a5540716441c49ec8185c8dc6a80c
0928 20:02:45.686494 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.720495 (+ 34001us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.743445 (+ 22950us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.755408 (+ 11963us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11763,"tablet-delete.queue_time_us":2008166}
I20260928 20:02:45.757005 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 596a5540716441c49ec8185c8dc6a80c (table default.Table_1d2bed217f0242aabcfc3979c76a1757 [id=a763bf903e6146868af5e380c2a9df4d]) successfully deleted
I20260928 20:02:45.757653 26916 tablet_bootstrap.cc:654] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:45.759572 26450 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:45.760313 26450 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:45.760676 26450 leader_election.cc:304] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:45.762382 27732 raft_consensus.cc:2749] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:45.766995 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_b59a850776244e54842b25bbddc43283" } new_table_name: "default.Table_c09e6bb3097d44b893bed32fd069330c" modify_external_catalogs: true
I20260928 20:02:45.776475 27531 tablet_replica.cc:333] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.777343 27531 raft_consensus.cc:2243] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.777771 27531 raft_consensus.cc:2272] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.779395 27531 ts_tablet_manager.cc:1962] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.792196 26916 tablet_bootstrap.cc:492] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.792610 26916 ts_tablet_manager.cc:1449] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.000s
I20260928 20:02:45.797835 26636 tablet_service.cc:1511] Processing CreateTablet for tablet b97ad3f841f54aa38bbb312c50db384e (DEFAULT_TABLE table=default.Table_3c29918c975a40a694cdc5554d5c8a2c [id=bc94898784194a9295a9b2ae98e39091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.798642 26916 raft_consensus.cc:359] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.799252 26916 raft_consensus.cc:385] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.799485 26916 raft_consensus.cc:740] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.799595 26783 tablet_service.cc:1511] Processing CreateTablet for tablet b97ad3f841f54aa38bbb312c50db384e (DEFAULT_TABLE table=default.Table_3c29918c975a40a694cdc5554d5c8a2c [id=bc94898784194a9295a9b2ae98e39091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.800164 26916 consensus_queue.cc:260] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.800711 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdb8870dce541a2afb3be09bcb3c701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.802388 26916 ts_tablet_manager.cc:1480] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260928 20:02:45.803231 26916 tablet_bootstrap.cc:492] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:45.811676 27531 ts_tablet_manager.cc:1975] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.812026 27531 log.cc:1199] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/0216c99dfd8f498595f3f7dbadf8a79b
I20260928 20:02:45.812589 27531 ts_tablet_manager.cc:1996] T 0216c99dfd8f498595f3f7dbadf8a79b P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:45.818668 26916 tablet_bootstrap.cc:654] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:45.829692 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260928 20:02:45.841518 26913 raft_consensus.cc:359] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.842386 26913 raft_consensus.cc:385] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.842646 26913 raft_consensus.cc:740] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:02:45.848585 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 161398us
W20260928 20:02:45.851702 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260928 20:02:45.857218 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 262) took 1955 ms. Trace:
I20260928 20:02:45.857570 27531 rpcz_store.cc:276] 0928 20:02:43.901588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.902003 (+ 415us) service_pool.cc:224] Handling call
0928 20:02:45.776325 (+1874322us) ts_tablet_manager.cc:1197] Deleting tablet 0216c99dfd8f498595f3f7dbadf8a79b
0928 20:02:45.776367 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.788237 (+ 11870us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.811569 (+ 23332us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.857160 (+ 45591us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873796}
I20260928 20:02:45.858747 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 0216c99dfd8f498595f3f7dbadf8a79b (table default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]) successfully deleted
I20260928 20:02:45.859822 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 265) took 1820 ms. Trace:
I20260928 20:02:45.860162 27531 rpcz_store.cc:276] 0928 20:02:44.039034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.039175 (+ 141us) service_pool.cc:224] Handling call
0928 20:02:45.859509 (+1820334us) ts_tablet_manager.cc:1197] Deleting tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
0928 20:02:45.859552 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.859773 (+ 221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1819727}
W20260928 20:02:45.861357 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 already in progress: creating tablet
I20260928 20:02:45.862345 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 264) took 1823 ms. Trace:
I20260928 20:02:45.862848 27531 rpcz_store.cc:276] 0928 20:02:44.038741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.079418 (+ 40677us) service_pool.cc:224] Handling call
0928 20:02:45.862042 (+1782624us) ts_tablet_manager.cc:1197] Deleting tablet 12a86cd5167c43a4beb51cd3138cdef8
0928 20:02:45.862078 (+ 36us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.862302 (+ 224us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782039}
W20260928 20:02:45.864584 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 12a86cd5167c43a4beb51cd3138cdef8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12a86cd5167c43a4beb51cd3138cdef8 already in progress: creating tablet
I20260928 20:02:45.865681 27531 tablet_replica.cc:333] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.866263 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdb8870dce541a2afb3be09bcb3c701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.866842 27531 raft_consensus.cc:2243] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.867228 27531 raft_consensus.cc:2272] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.868753 27531 ts_tablet_manager.cc:1962] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:45.878880 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97ad3f841f54aa38bbb312c50db384e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.894707 26916 tablet_bootstrap.cc:492] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.895247 26916 ts_tablet_manager.cc:1449] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.092s user 0.009s sys 0.005s
I20260928 20:02:45.897976 26916 raft_consensus.cc:359] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.902168 26916 raft_consensus.cc:385] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.902477 26916 raft_consensus.cc:740] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.903210 26916 consensus_queue.cc:260] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.907102 26916 ts_tablet_manager.cc:1480] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260928 20:02:45.907923 26916 tablet_bootstrap.cc:492] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:45.913445 26916 tablet_bootstrap.cc:654] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:45.920555 27732 raft_consensus.cc:493] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.921003 27732 raft_consensus.cc:515] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:45.922755 27732 leader_election.cc:290] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.931860 27531 ts_tablet_manager.cc:1975] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:45.932192 27531 log.cc:1199] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:45.932757 27531 ts_tablet_manager.cc:1996] T c4de78b7781d43458cbf2d3e889357fc P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:45.934504 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 266) took 1819 ms. Trace:
I20260928 20:02:45.934788 27531 rpcz_store.cc:276] 0928 20:02:44.115184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.140214 (+ 25030us) service_pool.cc:224] Handling call
0928 20:02:45.865556 (+1725342us) ts_tablet_manager.cc:1197] Deleting tablet c4de78b7781d43458cbf2d3e889357fc
0928 20:02:45.865590 (+ 34us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.916355 (+ 50765us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.931747 (+ 15392us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:45.934449 (+ 2702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1723291}
I20260928 20:02:45.935961 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet c4de78b7781d43458cbf2d3e889357fc (table default.Table_7b71cef2215d4ba9a0d4cdb625664604 [id=f55e212e2f97427fba3f983fb0ff2cdf]) successfully deleted
I20260928 20:02:45.941064 27732 raft_consensus.cc:493] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:45.941490 27732 raft_consensus.cc:515] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.943248 27732 leader_election.cc:290] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:45.943694 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:45.949757 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.951699 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:45.955687 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 267) took 1619 ms. Trace:
I20260928 20:02:45.956024 27531 rpcz_store.cc:276] 0928 20:02:44.336799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.336949 (+ 150us) service_pool.cc:224] Handling call
0928 20:02:45.955451 (+1618502us) ts_tablet_manager.cc:1197] Deleting tablet 7cda7651d4cf4c7e82c7329735e6bdcc
0928 20:02:45.955493 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.955635 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617791}
W20260928 20:02:45.957211 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 7cda7651d4cf4c7e82c7329735e6bdcc because the tablet was not found. No further retry: Not found: Tablet not found: 7cda7651d4cf4c7e82c7329735e6bdcc
I20260928 20:02:45.959920 27531 tablet_replica.cc:333] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:45.961036 27531 raft_consensus.cc:2243] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:45.971423 26916 tablet_bootstrap.cc:492] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:45.972004 26916 ts_tablet_manager.cc:1449] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.002s
I20260928 20:02:45.974264 26916 raft_consensus.cc:359] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.974941 26916 raft_consensus.cc:385] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:45.975644 26916 raft_consensus.cc:740] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:45.976289 26916 consensus_queue.cc:260] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:45.975387 27531 raft_consensus.cc:2272] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:45.977238 26496 tablet_service.cc:1511] Processing CreateTablet for tablet b97ad3f841f54aa38bbb312c50db384e (DEFAULT_TABLE table=default.Table_3c29918c975a40a694cdc5554d5c8a2c [id=bc94898784194a9295a9b2ae98e39091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:45.978245 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97ad3f841f54aa38bbb312c50db384e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.982687 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97ad3f841f54aa38bbb312c50db384e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:45.985249 26916 ts_tablet_manager.cc:1480] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260928 20:02:45.986079 26916 tablet_bootstrap.cc:492] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:45.990195 27531 ts_tablet_manager.cc:1962] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.002614 26913 consensus_queue.cc:260] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.005771 26913 ts_tablet_manager.cc:1480] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.265s user 0.006s sys 0.000s
I20260928 20:02:46.010390 26916 tablet_bootstrap.cc:654] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.020437 27531 ts_tablet_manager.cc:1975] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:46.020825 27531 log.cc:1199] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/c6544b7b405c4831900f37e052892409
I20260928 20:02:46.021421 27531 ts_tablet_manager.cc:1996] T c6544b7b405c4831900f37e052892409 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:46.023166 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 268) took 1686 ms. Trace:
I20260928 20:02:46.023473 27531 rpcz_store.cc:276] 0928 20:02:44.337111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.337237 (+ 126us) service_pool.cc:224] Handling call
0928 20:02:45.959785 (+1622548us) ts_tablet_manager.cc:1197] Deleting tablet c6544b7b405c4831900f37e052892409
0928 20:02:45.959821 (+ 36us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:45.997281 (+ 37460us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.020308 (+ 23027us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.023110 (+ 2802us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380,"tablet-delete.queue_time_us":1621985}
I20260928 20:02:46.024747 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet c6544b7b405c4831900f37e052892409 (table default.Table_9a00e08127ea41d988decb4e501ae54c [id=4ef471359f6a44ec8e83d75b99cf05c5]) successfully deleted
W20260928 20:02:46.024344 26125 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 100212us
I20260928 20:02:46.029656 27729 raft_consensus.cc:493] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.030270 27729 raft_consensus.cc:515] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.031855 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 269) took 1693 ms. Trace:
I20260928 20:02:46.032145 27531 rpcz_store.cc:276] 0928 20:02:44.338560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.338676 (+ 116us) service_pool.cc:224] Handling call
0928 20:02:46.031596 (+1692920us) ts_tablet_manager.cc:1197] Deleting tablet 93fb4e1fd0584a42a4de9eab14d5578c
0928 20:02:46.031639 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.031801 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1692376}
I20260928 20:02:46.032414 27729 leader_election.cc:290] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:46.033329 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 93fb4e1fd0584a42a4de9eab14d5578c because the tablet was not found. No further retry: Not found: Tablet not found: 93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:46.035300 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:46.036804 26739 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.038656 26740 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:46.039009 26740 leader_election.cc:304] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:46.039532 26916 tablet_bootstrap.cc:492] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.039927 26916 ts_tablet_manager.cc:1449] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.007s
I20260928 20:02:46.039873 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 270) took 1670 ms. Trace:
I20260928 20:02:46.040014 27729 raft_consensus.cc:2749] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.040268 27531 rpcz_store.cc:276] 0928 20:02:44.369909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.370052 (+ 143us) service_pool.cc:224] Handling call
0928 20:02:46.039581 (+1669529us) ts_tablet_manager.cc:1197] Deleting tablet 626a876a51d04095b5dd54726bb995f3
0928 20:02:46.039619 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.039823 (+ 204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668955}
W20260928 20:02:46.041437 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 626a876a51d04095b5dd54726bb995f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 626a876a51d04095b5dd54726bb995f3 already in progress: creating tablet
I20260928 20:02:46.042387 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 271) took 1650 ms. Trace:
I20260928 20:02:46.042708 27531 rpcz_store.cc:276] 0928 20:02:44.391744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.391931 (+ 187us) service_pool.cc:224] Handling call
0928 20:02:46.042169 (+1650238us) ts_tablet_manager.cc:1197] Deleting tablet 38abbc891d9c4268820cb0faba3d08b5
0928 20:02:46.042203 (+ 34us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.042328 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649425}
I20260928 20:02:46.042779 26916 raft_consensus.cc:359] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.043491 26916 raft_consensus.cc:385] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.043741 26916 raft_consensus.cc:740] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:02:46.044023 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 38abbc891d9c4268820cb0faba3d08b5 because the tablet was not found. No further retry: Not found: Tablet not found: 38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:46.044327 26916 consensus_queue.cc:260] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.044807 27531 tablet_replica.cc:333] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:46.051257 26916 ts_tablet_manager.cc:1480] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20260928 20:02:46.052110 26916 tablet_bootstrap.cc:492] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.052491 27531 raft_consensus.cc:2243] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:46.052968 27531 raft_consensus.cc:2272] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:46.054669 27531 ts_tablet_manager.cc:1962] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.063256 26916 tablet_bootstrap.cc:654] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.068732 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:46.071049 26450 leader_election.cc:343] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.071754 26450 leader_election.cc:343] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.072402 26450 leader_election.cc:343] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.072917 26450 leader_election.cc:304] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.085842 26230 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:46.087504 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5bc7581e446f47e49ffb90ba4d9c2520" } modify_external_catalogs: true
I20260928 20:02:46.088472 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5bc7581e446f47e49ffb90ba4d9c2520" } modify_external_catalogs: true
I20260928 20:02:46.094705 26230 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:46.103873 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:46.104738 26232 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:46.133422 26913 tablet_bootstrap.cc:492] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:46.089998 27531 ts_tablet_manager.cc:1975] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:46.117489 26916 tablet_bootstrap.cc:492] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.154417 27531 log.cc:1199] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:46.154553 26916 ts_tablet_manager.cc:1449] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.103s user 0.008s sys 0.002s
I20260928 20:02:46.155109 27531 ts_tablet_manager.cc:1996] T a86e8a782b3e46d09a45bbb7025546af P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:46.131197 27732 raft_consensus.cc:493] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.157253 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 272) took 1734 ms. Trace:
I20260928 20:02:46.139961 27733 raft_consensus.cc:493] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.157285 26916 raft_consensus.cc:359] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.157567 27531 rpcz_store.cc:276] 0928 20:02:44.422657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.422787 (+ 130us) service_pool.cc:224] Handling call
0928 20:02:46.044679 (+1621892us) ts_tablet_manager.cc:1197] Deleting tablet a86e8a782b3e46d09a45bbb7025546af
0928 20:02:46.044714 (+ 35us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.083275 (+ 38561us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.089880 (+ 6605us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.157195 (+ 67315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1621323}
I20260928 20:02:46.158530 26916 raft_consensus.cc:385] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.158788 26916 raft_consensus.cc:740] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.159354 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet a86e8a782b3e46d09a45bbb7025546af (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]) successfully deleted
I20260928 20:02:46.157667 27732 raft_consensus.cc:515] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.157850 27733 raft_consensus.cc:515] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:46.161168 27732 leader_election.cc:290] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.161603 27732 raft_consensus.cc:2749] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.161654 27733 leader_election.cc:290] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:46.162423 27531 tablet_replica.cc:333] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:46.162458 26916 consensus_queue.cc:260] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.163483 27531 raft_consensus.cc:2243] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:46.163923 27531 raft_consensus.cc:2272] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:46.163326 26912 tablet_bootstrap.cc:654] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.165563 27531 ts_tablet_manager.cc:1962] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.167135 26916 ts_tablet_manager.cc:1480] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260928 20:02:46.174686 27676 consensus_queue.cc:1048] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:46.178792 26916 tablet_bootstrap.cc:492] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.184049 26916 tablet_bootstrap.cc:654] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.204139 27732 raft_consensus.cc:493] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.204612 27732 raft_consensus.cc:515] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.206367 27732 leader_election.cc:290] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.223846 26916 tablet_bootstrap.cc:492] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.224252 26916 ts_tablet_manager.cc:1449] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.000s
I20260928 20:02:46.226660 26916 raft_consensus.cc:359] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:46.227252 26916 raft_consensus.cc:385] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.227490 26916 raft_consensus.cc:740] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.228488 27531 ts_tablet_manager.cc:1975] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:46.228364 26916 consensus_queue.cc:260] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:46.237643 27531 log.cc:1199] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/ee4c267b42754dbca8eb5ebec2d66a23
I20260928 20:02:46.241534 26916 ts_tablet_manager.cc:1480] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260928 20:02:46.269035 27531 ts_tablet_manager.cc:1996] T ee4c267b42754dbca8eb5ebec2d66a23 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:46.269205 26916 tablet_bootstrap.cc:492] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.270980 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 273) took 1762 ms. Trace:
I20260928 20:02:46.271474 27531 rpcz_store.cc:276] 0928 20:02:44.508860 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.508963 (+ 103us) service_pool.cc:224] Handling call
0928 20:02:46.162279 (+1653316us) ts_tablet_manager.cc:1197] Deleting tablet ee4c267b42754dbca8eb5ebec2d66a23
0928 20:02:46.162316 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.173871 (+ 11555us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.228364 (+ 54493us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.270923 (+ 42559us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1652739}
I20260928 20:02:46.272897 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet ee4c267b42754dbca8eb5ebec2d66a23 (table default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 [id=899ddfb9d42b4edab7acc6c374382cce]) successfully deleted
I20260928 20:02:46.274065 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 275) took 1227 ms. Trace:
I20260928 20:02:46.274405 27531 rpcz_store.cc:276] 0928 20:02:45.046246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.046489 (+ 243us) service_pool.cc:224] Handling call
0928 20:02:46.273631 (+1227142us) ts_tablet_manager.cc:1197] Deleting tablet 3eb8477c5cb74205b4b55eb38d7f9542
0928 20:02:46.273780 (+ 149us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.274015 (+ 235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226532}
I20260928 20:02:46.277163 26916 tablet_bootstrap.cc:654] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:46.277530 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 3eb8477c5cb74205b4b55eb38d7f9542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb8477c5cb74205b4b55eb38d7f9542 already in progress: creating tablet
I20260928 20:02:46.278455 27531 tablet_replica.cc:333] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:46.246012 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 173611us
I20260928 20:02:46.279253 27531 raft_consensus.cc:2243] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:46.279722 26450 leader_election.cc:343] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.280052 26450 leader_election.cc:304] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.282400 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.284526 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.286792 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.287181 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5f5f16f2d7457799e1b96a293695f4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.289089 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5f5f16f2d7457799e1b96a293695f4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.290199 27750 raft_consensus.cc:2749] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.279826 27531 raft_consensus.cc:2272] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:46.296350 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.298153 27531 ts_tablet_manager.cc:1962] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.306391 26916 tablet_bootstrap.cc:492] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.307595 26916 ts_tablet_manager.cc:1449] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.001s
I20260928 20:02:46.309744 26916 raft_consensus.cc:359] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.310348 26916 raft_consensus.cc:385] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.310590 26916 raft_consensus.cc:740] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.311154 26916 consensus_queue.cc:260] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.320725 27531 ts_tablet_manager.cc:1975] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 20:02:46.322507 27615 ts_tablet_manager.cc:1975] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:46.322974 27615 log.cc:1199] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:46.323797 27615 ts_tablet_manager.cc:1996] T c4de78b7781d43458cbf2d3e889357fc P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:46.325073 26595 consensus_peers.cc:597] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:46.326745 26450 leader_election.cc:343] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.326963 27531 log.cc:1199] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/5d4ea23c18e04819b28d3428d584f3ac
W20260928 20:02:46.327340 26450 leader_election.cc:343] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.327720 27531 ts_tablet_manager.cc:1996] T 5d4ea23c18e04819b28d3428d584f3ac P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
W20260928 20:02:46.327859 26450 leader_election.cc:343] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.332006 26916 ts_tablet_manager.cc:1480] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.024s user 0.003s sys 0.002s
I20260928 20:02:46.333230 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 277) took 1222 ms. Trace:
I20260928 20:02:46.333525 27531 rpcz_store.cc:276] 0928 20:02:45.111111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.111240 (+ 129us) service_pool.cc:224] Handling call
0928 20:02:46.278322 (+1167082us) ts_tablet_manager.cc:1197] Deleting tablet 5d4ea23c18e04819b28d3428d584f3ac
0928 20:02:46.278359 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.314836 (+ 36477us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.320621 (+ 5785us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.333177 (+ 12556us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045526}
I20260928 20:02:46.334698 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]) successfully deleted
W20260928 20:02:46.335090 26450 leader_election.cc:343] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.335415 26450 leader_election.cc:304] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.338589 26916 tablet_bootstrap.cc:492] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.349946 27750 raft_consensus.cc:2749] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:46.351970 26450 leader_election.cc:343] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.352402 26913 tablet_bootstrap.cc:654] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.352334 26450 leader_election.cc:304] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.353087 27531 tablet_replica.cc:333] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:46.358634 27531 raft_consensus.cc:2243] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:46.359334 27750 raft_consensus.cc:2749] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.359872 27531 raft_consensus.cc:2272] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:46.360357 26450 leader_election.cc:343] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.360700 26450 leader_election.cc:304] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.361689 27531 ts_tablet_manager.cc:1962] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.369905 27673 raft_consensus.cc:493] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.370535 27673 raft_consensus.cc:515] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.374334 27673 leader_election.cc:290] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:46.375075 27750 raft_consensus.cc:2749] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.378619 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dd3080d50748d2ad79f472d3c17673" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.378875 27750 raft_consensus.cc:493] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.379204 26800 raft_consensus.cc:2468] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:46.379264 27750 raft_consensus.cc:515] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.381214 27750 leader_election.cc:290] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.385530 26594 leader_election.cc:304] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:46.387713 26916 tablet_bootstrap.cc:654] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.387871 27676 raft_consensus.cc:2804] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:46.388228 27676 raft_consensus.cc:493] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:46.388538 27676 raft_consensus.cc:3060] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:46.393198 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.400357 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.402920 27531 ts_tablet_manager.cc:1975] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:46.405009 26912 tablet_bootstrap.cc:492] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:46.405465 27531 log.cc:1199] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/0e0a362efb68408d8dce96dce0130035
I20260928 20:02:46.406246 27531 ts_tablet_manager.cc:1996] T 0e0a362efb68408d8dce96dce0130035 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:46.411439 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 264) took 2295 ms. Trace:
I20260928 20:02:46.413530 27531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 281) took 1112 ms. Trace:
I20260928 20:02:46.413902 27531 rpcz_store.cc:276] 0928 20:02:45.300915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.301061 (+ 146us) service_pool.cc:224] Handling call
0928 20:02:46.352919 (+1051858us) ts_tablet_manager.cc:1197] Deleting tablet 0e0a362efb68408d8dce96dce0130035
0928 20:02:46.352974 (+ 55us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.381925 (+ 28951us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.402804 (+ 20879us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.413475 (+ 10671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719,"tablet-delete.queue_time_us":1051307}
I20260928 20:02:46.415378 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 0e0a362efb68408d8dce96dce0130035 (table default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 [id=62b393e94fb74eb6a1103662c6a672c7]) successfully deleted
W20260928 20:02:46.404855 26450 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.416481 26450 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.416913 26450 leader_election.cc:304] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.417709 27750 raft_consensus.cc:2749] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:46.419831 26595 leader_election.cc:343] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:46.434031 26916 tablet_bootstrap.cc:492] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.434463 26916 ts_tablet_manager.cc:1449] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.096s user 0.010s sys 0.000s
W20260928 20:02:35.415834 27347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:02:36.706851 27337 debug-util.cc:398] Leaking SignalData structure 0x7b0800028e80 after lost signal to thread 27051
W20260928 20:02:46.440178 27337 kernel_stack_watchdog.cc:198] Thread 27051 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 296ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260928 20:02:46.441748 27349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:02:46.405517 26912 ts_tablet_manager.cc:1449] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.758s user 0.011s sys 0.002s
I20260928 20:02:46.437078 26916 raft_consensus.cc:359] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.446429 26916 raft_consensus.cc:385] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.446674 26916 raft_consensus.cc:740] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.447247 26916 consensus_queue.cc:260] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.449041 26916 ts_tablet_manager.cc:1480] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260928 20:02:46.448861 26912 raft_consensus.cc:359] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:46.447752 27051 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 11.039s user 0.661s sys 0.953s
W20260928 20:02:46.449604 27348 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 10875 milliseconds
W20260928 20:02:46.450933 27051 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 11.043s user 0.662s sys 0.953s
I20260928 20:02:46.451426 27051 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260928 20:02:46.453173 27051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:02:46.458791 26229 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 85ad26fa3e30479696e59d32e4c3ff1e
I20260928 20:02:46.459937 27051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:02:46.460070 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c337753d93e448c28340ef32cc51734d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:46.461658 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c337753d93e448c28340ef32cc51734d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:46.462471 27750 raft_consensus.cc:493] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.462706 27051 hybrid_clock.cc:648] HybridClock initialized: now 1790625766462666 us; error 58 us; skew 500 ppm
I20260928 20:02:46.462894 27750 raft_consensus.cc:515] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.463958 27051 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260928 20:02:46.464705 27750 leader_election.cc:290] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.467013 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:46.468806 26450 leader_election.cc:343] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.483633 26916 tablet_bootstrap.cc:492] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.497578 27051 webserver.cc:533] Webserver started at http://127.25.129.252:43621/ using document root <none> and password file <none>
I20260928 20:02:46.499015 27051 fs_manager.cc:362] Metadata directory not provided
I20260928 20:02:46.499363 27051 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:02:46.508711 26916 tablet_bootstrap.cc:654] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.513653 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a" } modify_external_catalogs: true
I20260928 20:02:46.514300 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a" } modify_external_catalogs: true
I20260928 20:02:46.449522 26912 raft_consensus.cc:385] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.533043 26912 raft_consensus.cc:740] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.534708 26912 consensus_queue.cc:260] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.536206 27051 fs_manager.cc:714] Time spent opening directory manager: real 0.023s user 0.007s sys 0.000s
W20260928 20:02:46.538494 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 103727us
I20260928 20:02:46.548250 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.553742 27750 raft_consensus.cc:493] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.554219 27750 raft_consensus.cc:515] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:46.555984 27775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:02:46.555979 27750 leader_election.cc:290] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:46.555986 26739 consensus_peers.cc:597] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:46.563724 27051 fs_manager.cc:730] Time spent opening block manager: real 0.022s user 0.005s sys 0.001s
I20260928 20:02:46.564149 27051 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data,/tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
uuid: "0b347187d9be4ad08708acffdf4dda63"
format_stamp: "Formatted at 2026-09-28 20:02:13 on dist-test-slave-zq0l"
I20260928 20:02:46.567623 27051 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:02:46.575119 26912 ts_tablet_manager.cc:1480] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.129s user 0.004s sys 0.002s
W20260928 20:02:46.590370 26450 leader_election.cc:343] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.591096 26450 leader_election.cc:304] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:46.592880 26595 consensus_peers.cc:597] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d4ea23c18e04819b28d3428d584f3ac. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:46.598306 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:46.599888 26450 leader_election.cc:343] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.601589 26912 tablet_bootstrap.cc:492] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:46.620448 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_b59a850776244e54842b25bbddc43283 [id=3dab28923da541d880df28b2119b4de3]). Expected version 1 got 0
I20260928 20:02:46.411916 27615 rpcz_store.cc:276] 0928 20:02:44.116121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.118192 (+ 2071us) service_pool.cc:224] Handling call
0928 20:02:45.223432 (+1105240us) ts_tablet_manager.cc:1197] Deleting tablet c4de78b7781d43458cbf2d3e889357fc
0928 20:02:45.223487 (+ 55us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.041139 (+817652us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.322370 (+281231us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.411358 (+ 88988us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1104730}
I20260928 20:02:46.633948 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.635964 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 265) took 2264 ms. Trace:
I20260928 20:02:46.636482 27615 rpcz_store.cc:276] 0928 20:02:44.371324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.382181 (+ 10857us) service_pool.cc:224] Handling call
0928 20:02:46.635482 (+2253301us) ts_tablet_manager.cc:1197] Deleting tablet 626a876a51d04095b5dd54726bb995f3
0928 20:02:46.635542 (+ 60us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.635885 (+ 343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252570}
I20260928 20:02:46.639111 26913 tablet_bootstrap.cc:492] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:46.639642 26913 ts_tablet_manager.cc:1449] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.507s user 0.012s sys 0.000s
W20260928 20:02:46.641027 26450 leader_election.cc:343] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.641431 26450 leader_election.cc:304] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.643357 27732 raft_consensus.cc:2749] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.644153 27732 raft_consensus.cc:493] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.644640 27732 raft_consensus.cc:515] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:46.650759 26740 consensus_peers.cc:597] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0216c99dfd8f498595f3f7dbadf8a79b. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:46.652235 27732 leader_election.cc:290] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.652925 27732 raft_consensus.cc:2749] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.644778 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 266) took 2219 ms. Trace:
I20260928 20:02:46.653815 27615 rpcz_store.cc:276] 0928 20:02:44.423844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.426683 (+ 2839us) service_pool.cc:224] Handling call
0928 20:02:46.637736 (+2211053us) ts_tablet_manager.cc:1197] Deleting tablet a86e8a782b3e46d09a45bbb7025546af
0928 20:02:46.637787 (+ 51us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.638090 (+ 303us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2210319}
I20260928 20:02:46.654542 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cbde5f5dc4ff6a046b16b1e2b9786" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.655269 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 270) took 1607 ms. Trace:
W20260928 20:02:46.656191 26450 leader_election.cc:343] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.657066 27615 rpcz_store.cc:276] 0928 20:02:45.047896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.048037 (+ 141us) service_pool.cc:224] Handling call
0928 20:02:46.654840 (+1606803us) ts_tablet_manager.cc:1197] Deleting tablet 3eb8477c5cb74205b4b55eb38d7f9542
0928 20:02:46.654885 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.655217 (+ 332us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1606238}
I20260928 20:02:46.655894 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cbde5f5dc4ff6a046b16b1e2b9786" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.655894 26913 raft_consensus.cc:359] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.659272 26913 raft_consensus.cc:385] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.659584 26913 raft_consensus.cc:740] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.660960 27615 tablet_replica.cc:333] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:46.649706 27676 raft_consensus.cc:515] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:46.661003 26450 leader_election.cc:343] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.661362 26450 leader_election.cc:304] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.661801 27615 raft_consensus.cc:2243] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Raft consensus shutting down.
I20260928 20:02:46.662129 27733 raft_consensus.cc:2749] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.662756 27615 raft_consensus.cc:2272] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:46.664810 27615 ts_tablet_manager.cc:1962] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.669369 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0dd3080d50748d2ad79f472d3c17673" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:46.669894 26803 raft_consensus.cc:3060] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:46.679335 26916 tablet_bootstrap.cc:492] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.679868 26916 ts_tablet_manager.cc:1449] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.196s user 0.006s sys 0.016s
I20260928 20:02:46.682969 27676 leader_election.cc:290] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:46.683877 26803 raft_consensus.cc:2468] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:46.686743 26594 leader_election.cc:304] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:46.688027 27676 raft_consensus.cc:2804] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:46.660749 26913 consensus_queue.cc:260] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:46.688822 26595 leader_election.cc:343] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:46.691847 26916 raft_consensus.cc:359] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.692514 26916 raft_consensus.cc:385] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.692764 26916 raft_consensus.cc:740] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.694499 26913 ts_tablet_manager.cc:1480] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.054s user 0.006s sys 0.000s
I20260928 20:02:46.697676 27750 raft_consensus.cc:493] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.698192 27750 raft_consensus.cc:515] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:46.694792 27676 raft_consensus.cc:697] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:46.699417 27676 consensus_queue.cc:237] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.700086 27750 leader_election.cc:290] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:46.702275 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:46.703573 26450 leader_election.cc:343] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.701090 26913 tablet_bootstrap.cc:492] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:46.704278 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:46.705370 26450 leader_election.cc:343] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.705724 26450 leader_election.cc:304] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.706650 27750 raft_consensus.cc:2749] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.706357 26916 consensus_queue.cc:260] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.709726 26916 ts_tablet_manager.cc:1480] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.029s user 0.004s sys 0.002s
I20260928 20:02:46.717185 26913 tablet_bootstrap.cc:654] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.721227 26912 tablet_bootstrap.cc:654] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.721568 26916 tablet_bootstrap.cc:492] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.684612 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet c4de78b7781d43458cbf2d3e889357fc (table default.Table_7b71cef2215d4ba9a0d4cdb625664604 [id=f55e212e2f97427fba3f983fb0ff2cdf]) successfully deleted
W20260928 20:02:46.722754 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b94aed8337bb4b20b7977e91640c6710 consensus state has no leader
W20260928 20:02:46.723552 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 626a876a51d04095b5dd54726bb995f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 626a876a51d04095b5dd54726bb995f3 already in progress: creating tablet
W20260928 20:02:46.724166 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet a86e8a782b3e46d09a45bbb7025546af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a86e8a782b3e46d09a45bbb7025546af already in progress: creating tablet
W20260928 20:02:46.724751 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 3eb8477c5cb74205b4b55eb38d7f9542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb8477c5cb74205b4b55eb38d7f9542 already in progress: creating tablet
I20260928 20:02:46.725620 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:46.732275 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:46.733211 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:46.734565 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:46.735852 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:46.743677 26916 tablet_bootstrap.cc:654] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.744186 26236 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:46.745987 27753 raft_consensus.cc:493] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.746452 27753 raft_consensus.cc:515] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.748710 27753 leader_election.cc:290] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.752961 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:46.753858 26512 raft_consensus.cc:2468] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:46.760035 26740 leader_election.cc:304] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:46.760735 27753 raft_consensus.cc:2804] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:46.760999 27750 raft_consensus.cc:493] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.761090 27753 raft_consensus.cc:493] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:46.761406 27753 raft_consensus.cc:3060] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:46.761446 27750 raft_consensus.cc:515] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.763368 27750 leader_election.cc:290] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.764225 26235 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 335) took 1255 ms. Trace:
I20260928 20:02:46.765357 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:46.766556 26450 leader_election.cc:343] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.764544 26235 rpcz_store.cc:276] 0928 20:02:45.508973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.689526 (+180553us) service_pool.cc:224] Handling call
0928 20:02:45.766871 (+ 77345us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0abc96 00007ff79cc5b634 00007ff79cc5b5c2 00007ff79cc5b4f1 00007ff79cc5b46c 00007ff79cc5a722 00007ff79aefc15c 00007ff79aefb596
0928 20:02:45.767734 (+ 863us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:45.768577 (+ 843us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:45.769285 (+ 708us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:45.769497 (+ 212us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:46.114802 (+345305us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:46.764161 (+649359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:46.081069 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:46.081460 (+ 391us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:46.081484 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:46.081498 (+ 14us) tablet.cc:662] Decoding operations
0928 20:02:46.081742 (+ 244us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:46.081784 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:46.081809 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:46.081977 (+ 168us) tablet.cc:701] Row locks acquired
0928 20:02:46.081989 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:46.082095 (+ 106us) write_op.cc:270] Start()
0928 20:02:46.082195 (+ 100us) write_op.cc:276] Timestamp: P: 1790625766082029 usec, L: 0
0928 20:02:46.082211 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:46.083103 (+ 892us) log.cc:844] Serialized 405 byte log entry
0928 20:02:46.112608 (+ 29505us) op_driver.cc:464] REPLICATION: finished
0928 20:02:46.112831 (+ 223us) write_op.cc:301] APPLY: starting
0928 20:02:46.112904 (+ 73us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:46.113013 (+ 109us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:46.113116 (+ 103us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:46.113286 (+ 170us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:46.113420 (+ 134us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:46.113466 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:02:46.113657 (+ 191us) log.cc:844] Serialized 23 byte log entry
0928 20:02:46.113803 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.113865 (+ 62us) write_op.cc:454] Released schema lock
0928 20:02:46.113906 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:46.115389 (+ 1483us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.115427 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":175995264,"child_traces":[["op",{"apply.queue_time_us":83,"apply.run_cpu_time_us":1265,"apply.run_wall_time_us":1265,"num_ops":1,"prepare.queue_time_us":306082,"prepare.run_cpu_time_us":1994,"prepare.run_wall_time_us":3707,"raft.queue_time_us":103,"raft.run_cpu_time_us":15,"raft.run_wall_time_us":16,"replication_time_us":30291}]]}
I20260928 20:02:46.771714 26916 tablet_bootstrap.cc:492] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.772113 26916 ts_tablet_manager.cc:1449] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.001s
I20260928 20:02:46.773054 27753 raft_consensus.cc:515] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.778456 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:46.779886 26229 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 338) took 1102 ms. Trace:
I20260928 20:02:46.782536 26916 raft_consensus.cc:359] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.783169 26916 raft_consensus.cc:385] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.783406 26916 raft_consensus.cc:740] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.783645 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:46.784991 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:46.786057 26912 tablet_bootstrap.cc:492] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:46.786468 27531 tablet_replica.cc:333] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:46.786870 26912 ts_tablet_manager.cc:1449] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.186s user 0.005s sys 0.005s
I20260928 20:02:46.780196 26229 rpcz_store.cc:276] 0928 20:02:45.677208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:46.513255 (+836047us) service_pool.cc:224] Handling call
0928 20:02:46.514804 (+ 1549us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:46.515522 (+ 718us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:46.515641 (+ 119us) catalog_manager.cc:2863] Locking tablets
0928 20:02:46.564445 (+ 48804us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:46.599520 (+ 35075us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.599562 (+ 42us) write_op.cc:454] Released schema lock
0928 20:02:46.607626 (+ 8064us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:46.607915 (+ 289us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:46.778368 (+170453us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:46.779824 (+ 1456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:46.579270 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:46.579693 (+ 423us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:46.579721 (+ 28us) write_op.cc:435] Acquired schema lock
0928 20:02:46.579739 (+ 18us) tablet.cc:662] Decoding operations
0928 20:02:46.580076 (+ 337us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:46.580122 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:46.580151 (+ 29us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:46.580434 (+ 283us) tablet.cc:701] Row locks acquired
0928 20:02:46.580451 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:02:46.580563 (+ 112us) write_op.cc:270] Start()
0928 20:02:46.580650 (+ 87us) write_op.cc:276] Timestamp: P: 1790625766580496 usec, L: 0
0928 20:02:46.580669 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:02:46.581185 (+ 516us) log.cc:844] Serialized 734 byte log entry
0928 20:02:46.590994 (+ 9809us) op_driver.cc:464] REPLICATION: finished
0928 20:02:46.591315 (+ 321us) write_op.cc:301] APPLY: starting
0928 20:02:46.591371 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:46.591476 (+ 105us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:46.591583 (+ 107us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:46.591851 (+ 268us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:46.591998 (+ 147us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:46.592053 (+ 55us) write_op.cc:312] APPLY: finished
0928 20:02:46.592255 (+ 202us) log.cc:844] Serialized 29 byte log entry
0928 20:02:46.592409 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.592485 (+ 76us) write_op.cc:454] Released schema lock
0928 20:02:46.592518 (+ 33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":178,"apply.run_cpu_time_us":1373,"apply.run_wall_time_us":1372,"num_ops":2,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2224,"prepare.run_wall_time_us":4416,"raft.queue_time_us":852,"raft.run_cpu_time_us":767,"raft.run_wall_time_us":767,"replication_time_us":10217}]]}
I20260928 20:02:46.789305 26912 raft_consensus.cc:359] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.795305 26916 consensus_queue.cc:260] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.799321 27531 raft_consensus.cc:2243] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:46.799962 27531 raft_consensus.cc:2272] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:46.802032 27531 ts_tablet_manager.cc:1962] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:46.804438 27753 leader_election.cc:290] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.806968 26916 ts_tablet_manager.cc:1480] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260928 20:02:46.807976 26916 tablet_bootstrap.cc:492] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.810621 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:46.811196 26512 raft_consensus.cc:3060] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:46.813562 26916 tablet_bootstrap.cc:654] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.718267 27615 ts_tablet_manager.cc:1975] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260928 20:02:46.757990 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.766036 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.783677 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:46.806080 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:46.822077 26739 leader_election.cc:343] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.822841 26450 leader_election.cc:343] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.823199 26450 leader_election.cc:304] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.823467 27615 log.cc:1199] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/5d4ea23c18e04819b28d3428d584f3ac
I20260928 20:02:46.824368 27615 ts_tablet_manager.cc:1996] T 5d4ea23c18e04819b28d3428d584f3ac P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:46.825145 26739 leader_election.cc:343] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.827297 27750 raft_consensus.cc:2749] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:46.830657 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet db5f5f16f2d7457799e1b96a293695f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db5f5f16f2d7457799e1b96a293695f4 already in progress: creating tablet
I20260928 20:02:46.835254 26512 raft_consensus.cc:2468] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:46.840411 26740 leader_election.cc:304] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:46.841635 27753 raft_consensus.cc:2804] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:46.842760 27753 raft_consensus.cc:697] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:46.843590 27753 consensus_queue.cc:237] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.790061 26912 raft_consensus.cc:385] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.848403 26912 raft_consensus.cc:740] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.849099 26912 consensus_queue.cc:260] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.849414 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 272) took 1736 ms. Trace:
I20260928 20:02:46.849752 27615 rpcz_store.cc:276] 0928 20:02:45.113037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.113165 (+ 128us) service_pool.cc:224] Handling call
0928 20:02:46.660154 (+1546989us) ts_tablet_manager.cc:1197] Deleting tablet 5d4ea23c18e04819b28d3428d584f3ac
0928 20:02:46.660838 (+ 684us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.694304 (+ 33466us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.718136 (+ 23832us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:46.849349 (+131213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1496643}
I20260928 20:02:46.851176 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 5d4ea23c18e04819b28d3428d584f3ac (table default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]) successfully deleted
I20260928 20:02:46.851514 26912 ts_tablet_manager.cc:1480] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.064s user 0.004s sys 0.002s
I20260928 20:02:46.852339 26912 tablet_bootstrap.cc:492] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:46.852283 27615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 275) took 1547 ms. Trace:
I20260928 20:02:46.852684 27615 rpcz_store.cc:276] 0928 20:02:45.304445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.304555 (+ 110us) service_pool.cc:224] Handling call
0928 20:02:46.851915 (+1547360us) ts_tablet_manager.cc:1197] Deleting tablet 0e0a362efb68408d8dce96dce0130035
0928 20:02:46.851963 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:46.852227 (+ 264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1546824}
W20260928 20:02:46.853916 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 0e0a362efb68408d8dce96dce0130035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e0a362efb68408d8dce96dce0130035 already in progress: creating tablet
W20260928 20:02:46.856130 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet db5f5f16f2d7457799e1b96a293695f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db5f5f16f2d7457799e1b96a293695f4 already in progress: creating tablet
I20260928 20:02:46.861212 26916 tablet_bootstrap.cc:492] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.861652 26916 ts_tablet_manager.cc:1449] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.005s
I20260928 20:02:46.864571 26913 tablet_bootstrap.cc:492] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:46.864210 26916 raft_consensus.cc:359] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.864841 26916 raft_consensus.cc:385] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.864987 26913 ts_tablet_manager.cc:1449] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.164s user 0.005s sys 0.005s
I20260928 20:02:46.865105 26916 raft_consensus.cc:740] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.867390 26913 raft_consensus.cc:359] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.882177 26913 raft_consensus.cc:385] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.882460 26913 raft_consensus.cc:740] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.883178 26913 consensus_queue.cc:260] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.888979 26912 tablet_bootstrap.cc:654] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.896826 26913 ts_tablet_manager.cc:1480] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260928 20:02:46.877766 27531 ts_tablet_manager.cc:1975] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:46.900413 27531 log.cc:1199] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:46.878434 26916 consensus_queue.cc:260] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.901235 27531 ts_tablet_manager.cc:1996] T db5f5f16f2d7457799e1b96a293695f4 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:46.902284 26916 ts_tablet_manager.cc:1480] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.040s user 0.003s sys 0.005s
I20260928 20:02:46.903316 26916 tablet_bootstrap.cc:492] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.904085 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet db5f5f16f2d7457799e1b96a293695f4 (table default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a [id=fd3816a55b234cad88a421587951bb94]) successfully deleted
I20260928 20:02:46.909614 26913 tablet_bootstrap.cc:492] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:46.896402 27750 raft_consensus.cc:493] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.911078 27750 raft_consensus.cc:515] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.913213 27750 leader_election.cc:290] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.914840 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.916718 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:46.918753 26450 leader_election.cc:343] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.920814 26450 leader_election.cc:343] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.921132 26916 tablet_bootstrap.cc:654] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.921213 26450 leader_election.cc:304] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.923098 27733 raft_consensus.cc:2749] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.937722 26912 tablet_bootstrap.cc:492] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:46.938238 26912 ts_tablet_manager.cc:1449] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.086s user 0.009s sys 0.003s
I20260928 20:02:46.938506 27750 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.939044 27750 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.940578 26912 raft_consensus.cc:359] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.941201 26912 raft_consensus.cc:385] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.941457 26912 raft_consensus.cc:740] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.942994 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:46.944820 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:46.946578 26450 leader_election.cc:343] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:46.947309 26450 leader_election.cc:343] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:46.947695 26450 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.948468 27733 raft_consensus.cc:2749] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.941071 27750 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.953227 26913 tablet_bootstrap.cc:654] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.953601 26916 tablet_bootstrap.cc:492] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.954030 26916 ts_tablet_manager.cc:1449] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.004s
I20260928 20:02:46.956434 26916 raft_consensus.cc:359] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.957000 26916 raft_consensus.cc:385] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.957249 26916 raft_consensus.cc:740] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.942060 26912 consensus_queue.cc:260] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.964401 26912 ts_tablet_manager.cc:1480] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260928 20:02:46.969614 26916 consensus_queue.cc:260] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:46.971611 26916 ts_tablet_manager.cc:1480] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260928 20:02:46.973894 26916 tablet_bootstrap.cc:492] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:46.978672 26913 tablet_bootstrap.cc:492] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:46.979408 26913 ts_tablet_manager.cc:1449] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.082s user 0.008s sys 0.003s
I20260928 20:02:46.980537 26912 tablet_bootstrap.cc:492] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:46.981992 26916 tablet_bootstrap.cc:654] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:46.981935 27676 raft_consensus.cc:493] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.982451 27676 raft_consensus.cc:515] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.984544 27676 leader_election.cc:290] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:46.986420 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:46.988572 26913 raft_consensus.cc:359] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.989163 26913 raft_consensus.cc:385] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:46.991122 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f5ee801a9354a858356fb4e055a1863" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:46.992498 26595 leader_election.cc:304] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:46.993391 27676 raft_consensus.cc:2749] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:46.989379 26913 raft_consensus.cc:740] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:46.995200 27750 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:46.995901 27750 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:46.997440 26916 tablet_bootstrap.cc:492] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:46.997826 26916 ts_tablet_manager.cc:1449] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.010s
I20260928 20:02:46.998051 27750 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:46.995398 26913 consensus_queue.cc:260] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.000002 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.000207 27676 raft_consensus.cc:493] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.001255 27676 raft_consensus.cc:515] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.001407 26916 raft_consensus.cc:359] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.001971 26916 raft_consensus.cc:385] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.003039 26916 raft_consensus.cc:740] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.003618 26916 consensus_queue.cc:260] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.004484 27676 leader_election.cc:290] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:47.005548 26916 ts_tablet_manager.cc:1480] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260928 20:02:47.005785 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018497a652234fbdb04cf6c034bcc5d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.006402 26916 tablet_bootstrap.cc:492] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:47.006404 26800 raft_consensus.cc:2468] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:47.007556 26912 tablet_bootstrap.cc:654] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.009321 26594 leader_election.cc:304] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.011143 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.012465 27676 raft_consensus.cc:2804] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:47.012854 27676 raft_consensus.cc:493] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:47.013440 27676 raft_consensus.cc:3060] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.019713 26916 tablet_bootstrap.cc:654] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.026235 26913 ts_tablet_manager.cc:1480] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.047s user 0.004s sys 0.004s
I20260928 20:02:47.029882 26913 tablet_bootstrap.cc:492] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:47.031188 26651 raft_consensus.cc:3060] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.034291 26912 tablet_bootstrap.cc:492] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:47.034669 26912 ts_tablet_manager.cc:1449] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.004s
I20260928 20:02:47.035002 26913 tablet_bootstrap.cc:654] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:47.036091 26450 leader_election.cc:343] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.036746 26450 leader_election.cc:343] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.037132 26450 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.036947 26912 raft_consensus.cc:359] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.037539 26912 raft_consensus.cc:385] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.037781 26912 raft_consensus.cc:740] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.045620 27750 raft_consensus.cc:2749] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:47.053859 26595 leader_election.cc:343] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:47.059175 27808 tablet.cc:1751] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:47.070875 27777 raft_consensus.cc:493] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.071537 27777 raft_consensus.cc:515] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.073431 27801 tablet.cc:1751] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:47.075665 27777 leader_election.cc:290] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:47.076772 27802 tablet.cc:1751] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:47.077965 26913 tablet_bootstrap.cc:492] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:47.078465 26913 ts_tablet_manager.cc:1449] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.000s
I20260928 20:02:47.080324 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fb4e1fd0584a42a4de9eab14d5578c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.080968 26803 raft_consensus.cc:2468] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:47.082597 26594 leader_election.cc:304] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.083407 27777 raft_consensus.cc:2804] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:47.083737 27777 raft_consensus.cc:493] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:47.084036 27777 raft_consensus.cc:3060] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.088743 26913 raft_consensus.cc:359] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.089344 26913 raft_consensus.cc:385] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.089584 26913 raft_consensus.cc:740] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.090163 26913 consensus_queue.cc:260] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.094633 27676 raft_consensus.cc:515] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.102778 26912 consensus_queue.cc:260] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.116058 27733 raft_consensus.cc:493] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.116336 26912 ts_tablet_manager.cc:1480] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.081s user 0.005s sys 0.000s
I20260928 20:02:47.117208 26912 tablet_bootstrap.cc:492] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:47.116726 27733 raft_consensus.cc:515] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.119284 27733 leader_election.cc:290] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.122311 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:47.124089 26450 leader_election.cc:343] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.096077 26595 leader_election.cc:343] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:47.114977 26913 ts_tablet_manager.cc:1480] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20260928 20:02:47.121522 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.129860 27777 raft_consensus.cc:515] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.130533 26913 tablet_bootstrap.cc:492] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:47.137410 26913 tablet_bootstrap.cc:654] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.147993 27753 raft_consensus.cc:493] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.148434 27753 raft_consensus.cc:515] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.148770 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fb4e1fd0584a42a4de9eab14d5578c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:47.149603 26803 raft_consensus.cc:3060] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.151517 27753 leader_election.cc:290] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:47.153640 26740 leader_election.cc:343] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
I20260928 20:02:47.143384 27777 leader_election.cc:290] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:47.152981 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23636443834932852f21092be1d1ac" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:47.160575 26739 leader_election.cc:343] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.161074 26739 leader_election.cc:304] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:47.161871 27753 raft_consensus.cc:2749] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.163151 27733 raft_consensus.cc:493] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.163628 27733 raft_consensus.cc:515] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.165638 27733 leader_election.cc:290] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:47.166399 26450 leader_election.cc:343] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.166738 26450 leader_election.cc:304] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.167330 27733 raft_consensus.cc:2749] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.169605 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018497a652234fbdb04cf6c034bcc5d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:47.170148 26800 raft_consensus.cc:3060] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.154318 26912 tablet_bootstrap.cc:654] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.177620 26800 raft_consensus.cc:2468] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:47.178789 26594 leader_election.cc:304] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.179504 27777 raft_consensus.cc:2804] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:47.179949 27777 raft_consensus.cc:697] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:47.180673 27777 consensus_queue.cc:237] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.175518 26803 raft_consensus.cc:2468] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:47.188563 26913 tablet_bootstrap.cc:492] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:47.189036 26913 ts_tablet_manager.cc:1449] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.004s
I20260928 20:02:47.191643 26913 raft_consensus.cc:359] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.198343 26916 tablet_bootstrap.cc:492] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:47.193024 26594 leader_election.cc:304] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.198742 26916 ts_tablet_manager.cc:1449] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.193s user 0.032s sys 0.040s
I20260928 20:02:47.199111 27759 raft_consensus.cc:2804] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:47.199565 27759 raft_consensus.cc:697] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:47.200304 27759 consensus_queue.cc:237] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.201258 26916 raft_consensus.cc:359] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.201906 26916 raft_consensus.cc:385] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.202219 26916 raft_consensus.cc:740] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.202983 26916 consensus_queue.cc:260] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.205040 26916 ts_tablet_manager.cc:1480] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:02:47.200330 27676 leader_election.cc:290] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:47.207955 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:47.210449 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:47.211753 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3]). Expected version 2 got 0
I20260928 20:02:47.212143 26913 raft_consensus.cc:385] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.212437 26913 raft_consensus.cc:740] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.214977 26913 consensus_queue.cc:260] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.221051 26913 ts_tablet_manager.cc:1480] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20260928 20:02:47.222046 26912 tablet_bootstrap.cc:492] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:47.224309 26912 ts_tablet_manager.cc:1449] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.107s user 0.008s sys 0.002s
I20260928 20:02:47.226683 26630 tablet_service.cc:1511] Processing CreateTablet for tablet e868e5a3ebd2494ca20e1e08a146850e (DEFAULT_TABLE table=default.Table_3830bee23f7b423ab7799d67ec7eceb1 [id=dd85d3fd71a34e12abbd1254fbf8d9ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.227278 26916 tablet_bootstrap.cc:492] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:47.227924 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868e5a3ebd2494ca20e1e08a146850e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.229554 26912 raft_consensus.cc:359] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.232628 26916 tablet_bootstrap.cc:654] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.233223 26913 tablet_bootstrap.cc:492] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:47.233566 26783 tablet_service.cc:1511] Processing CreateTablet for tablet e868e5a3ebd2494ca20e1e08a146850e (DEFAULT_TABLE table=default.Table_3830bee23f7b423ab7799d67ec7eceb1 [id=dd85d3fd71a34e12abbd1254fbf8d9ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.234558 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868e5a3ebd2494ca20e1e08a146850e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.247283 26493 tablet_service.cc:1511] Processing CreateTablet for tablet e868e5a3ebd2494ca20e1e08a146850e (DEFAULT_TABLE table=default.Table_3830bee23f7b423ab7799d67ec7eceb1 [id=dd85d3fd71a34e12abbd1254fbf8d9ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.248531 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868e5a3ebd2494ca20e1e08a146850e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.249133 26913 tablet_bootstrap.cc:654] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.249127 26916 tablet_bootstrap.cc:492] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:47.249488 26916 ts_tablet_manager.cc:1449] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.005s
I20260928 20:02:47.251983 26916 raft_consensus.cc:359] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.252576 26916 raft_consensus.cc:385] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.252810 26916 raft_consensus.cc:740] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.253439 26916 consensus_queue.cc:260] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.253927 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 87718f040f0d4b9d88a551cae4f0d47f (DEFAULT_TABLE table=default.Table_419bbb75ac2d4717b1cb696825cf70dc [id=4ad6473396cd4040b3abda93d38b0428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.254855 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87718f040f0d4b9d88a551cae4f0d47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.257119 26916 ts_tablet_manager.cc:1480] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260928 20:02:47.256714 26912 raft_consensus.cc:385] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.257694 26912 raft_consensus.cc:740] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.258034 26916 tablet_bootstrap.cc:492] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:47.258322 26912 consensus_queue.cc:260] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.261662 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 87718f040f0d4b9d88a551cae4f0d47f (DEFAULT_TABLE table=default.Table_419bbb75ac2d4717b1cb696825cf70dc [id=4ad6473396cd4040b3abda93d38b0428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.262854 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87718f040f0d4b9d88a551cae4f0d47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.268553 26912 ts_tablet_manager.cc:1480] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260928 20:02:47.268772 26916 tablet_bootstrap.cc:654] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.268891 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 87718f040f0d4b9d88a551cae4f0d47f (DEFAULT_TABLE table=default.Table_419bbb75ac2d4717b1cb696825cf70dc [id=4ad6473396cd4040b3abda93d38b0428]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.269379 26912 tablet_bootstrap.cc:492] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:47.269833 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87718f040f0d4b9d88a551cae4f0d47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.275777 27733 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.276262 27733 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.277212 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 21cb34c5e33544c9875e7babf4830164 (DEFAULT_TABLE table=default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.278226 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cb34c5e33544c9875e7babf4830164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.278431 27733 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.282152 27759 raft_consensus.cc:493] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.282612 27759 raft_consensus.cc:515] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.285599 27759 leader_election.cc:290] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:47.285501 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0216c99dfd8f498595f3f7dbadf8a79b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.312897 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 21cb34c5e33544c9875e7babf4830164 (DEFAULT_TABLE table=default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.313836 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cb34c5e33544c9875e7babf4830164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.320303 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.328696 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.330040 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 21cb34c5e33544c9875e7babf4830164 (DEFAULT_TABLE table=default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.331041 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cb34c5e33544c9875e7babf4830164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.343880 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 311f004a7acc4d43b4b88564b57efa74 (DEFAULT_TABLE table=default.Table_e4aa863223cc477b9b0ce2f8de2397d9 [id=f1329ba1066a431083c953a490bb544d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.345000 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311f004a7acc4d43b4b88564b57efa74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.349466 26655 raft_consensus.cc:3060] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.352849 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 311f004a7acc4d43b4b88564b57efa74 (DEFAULT_TABLE table=default.Table_e4aa863223cc477b9b0ce2f8de2397d9 [id=f1329ba1066a431083c953a490bb544d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.354192 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311f004a7acc4d43b4b88564b57efa74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.359774 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 311f004a7acc4d43b4b88564b57efa74 (DEFAULT_TABLE table=default.Table_e4aa863223cc477b9b0ce2f8de2397d9 [id=f1329ba1066a431083c953a490bb544d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.360780 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311f004a7acc4d43b4b88564b57efa74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.366537 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 26797990cec14e87a4a30a3bbd2ff7c2 (DEFAULT_TABLE table=default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.367457 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26797990cec14e87a4a30a3bbd2ff7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.377359 27733 raft_consensus.cc:493] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:47.377879 26595 leader_election.cc:343] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:47.377940 27733 raft_consensus.cc:515] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.380259 27733 leader_election.cc:290] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.381441 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.389708 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 26797990cec14e87a4a30a3bbd2ff7c2 (DEFAULT_TABLE table=default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.390722 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26797990cec14e87a4a30a3bbd2ff7c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:47.405015 26595 leader_election.cc:343] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:47.405040 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 26797990cec14e87a4a30a3bbd2ff7c2 (DEFAULT_TABLE table=default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.406168 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26797990cec14e87a4a30a3bbd2ff7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.412648 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.428707 26913 tablet_bootstrap.cc:492] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:47.429241 26913 ts_tablet_manager.cc:1449] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.208s user 0.013s sys 0.011s
I20260928 20:02:47.444708 26913 raft_consensus.cc:359] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.445575 26913 raft_consensus.cc:385] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.445658 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 (DEFAULT_TABLE table=default.Table_ccf4e77806ac4d888aa9b68621ef381d [id=259f91142592489a9885a228943b5d11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.445901 26913 raft_consensus.cc:740] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.447772 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 (DEFAULT_TABLE table=default.Table_ccf4e77806ac4d888aa9b68621ef381d [id=259f91142592489a9885a228943b5d11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.448902 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 (DEFAULT_TABLE table=default.Table_ccf4e77806ac4d888aa9b68621ef381d [id=259f91142592489a9885a228943b5d11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.450023 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.456266 26912 tablet_bootstrap.cc:654] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.463552 26913 consensus_queue.cc:260] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:47.466378 26450 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.466821 26595 leader_election.cc:343] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0216c99dfd8f498595f3f7dbadf8a79b
W20260928 20:02:47.466913 26450 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.467183 26595 leader_election.cc:304] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:47.467474 26450 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.467775 26450 leader_election.cc:304] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.467953 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb8477c5cb74205b4b55eb38d7f9542" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.468387 27733 raft_consensus.cc:2749] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.475035 26913 ts_tablet_manager.cc:1480] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.045s user 0.005s sys 0.004s
I20260928 20:02:47.480724 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 71272e843df3472ab06c4bd0be21d884 (DEFAULT_TABLE table=default.Table_22b94739706d4bcabfd2fe1c283c4ab9 [id=8e2065efd25245bfb73bf8fdcb9458af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.489374 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.507763 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71272e843df3472ab06c4bd0be21d884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.508056 26913 tablet_bootstrap.cc:492] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:47.512065 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb8477c5cb74205b4b55eb38d7f9542" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.513221 26913 tablet_bootstrap.cc:654] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:47.544536 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 75023.8us
I20260928 20:02:47.551648 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3]). Expected version 2 got 0
W20260928 20:02:47.552488 26450 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.552945 26450 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.553646 27733 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.555099 27777 raft_consensus.cc:493] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.555547 27777 raft_consensus.cc:515] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:47.556977 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 46221.4us
I20260928 20:02:47.557940 27777 leader_election.cc:290] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:47.560891 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.564725 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 71272e843df3472ab06c4bd0be21d884 (DEFAULT_TABLE table=default.Table_22b94739706d4bcabfd2fe1c283c4ab9 [id=8e2065efd25245bfb73bf8fdcb9458af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.565009 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 25512bb19e3c4f78bb917378b10021e5 (DEFAULT_TABLE table=default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.565986 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25512bb19e3c4f78bb917378b10021e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.567655 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71272e843df3472ab06c4bd0be21d884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.565418 26916 tablet_bootstrap.cc:492] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:02:47.566349 26450 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.568954 26916 ts_tablet_manager.cc:1449] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.311s user 0.072s sys 0.108s
I20260928 20:02:47.571333 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d90ce97d3db4bff8b2eea71c530c351" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:47.571396 26916 raft_consensus.cc:359] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.572075 26512 raft_consensus.cc:2393] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:47.572119 26916 raft_consensus.cc:385] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.572500 26916 raft_consensus.cc:740] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.573262 26916 consensus_queue.cc:260] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.578907 26595 leader_election.cc:304] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.581836 26913 tablet_bootstrap.cc:492] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:47.582239 26913 ts_tablet_manager.cc:1449] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.074s user 0.011s sys 0.004s
I20260928 20:02:47.582746 27673 raft_consensus.cc:3060] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.582827 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_77549b4ee8db495692f2cc830dc826b2 [id=a6241269939c4539979d41f860203228]). Expected version 1 got 0
I20260928 20:02:47.584184 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:47.584499 26913 raft_consensus.cc:359] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.585073 26913 raft_consensus.cc:385] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.585140 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:47.585438 26913 raft_consensus.cc:740] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.585637 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:47.586302 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:47.587381 27676 raft_consensus.cc:2749] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.596796 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:47.600607 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:47.601248 27673 raft_consensus.cc:2749] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.602051 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:47.604158 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:47.605870 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]). Expected version 1 got 0
I20260928 20:02:47.610582 27733 raft_consensus.cc:493] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.611260 26916 ts_tablet_manager.cc:1480] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.042s user 0.005s sys 0.000s
I20260928 20:02:47.611148 27733 raft_consensus.cc:515] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.612211 26916 tablet_bootstrap.cc:492] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:47.613471 27733 leader_election.cc:290] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.634277 26916 tablet_bootstrap.cc:654] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.634725 27733 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.635283 27733 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.638396 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.642773 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 71272e843df3472ab06c4bd0be21d884 (DEFAULT_TABLE table=default.Table_22b94739706d4bcabfd2fe1c283c4ab9 [id=8e2065efd25245bfb73bf8fdcb9458af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.643198 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 25512bb19e3c4f78bb917378b10021e5 (DEFAULT_TABLE table=default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.646551 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71272e843df3472ab06c4bd0be21d884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.647413 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25512bb19e3c4f78bb917378b10021e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:47.658416 27051 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 0.707s user 0.003s sys 0.008s
W20260928 20:02:47.658713 27051 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 0.707s user 0.003s sys 0.008s
I20260928 20:02:47.659933 26912 tablet_bootstrap.cc:492] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:47.660326 26912 ts_tablet_manager.cc:1449] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.391s user 0.016s sys 0.023s
I20260928 20:02:47.662705 26912 raft_consensus.cc:359] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.663290 26912 raft_consensus.cc:385] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.663548 26912 raft_consensus.cc:740] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.664196 27733 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.664103 26912 consensus_queue.cc:260] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.666061 26912 ts_tablet_manager.cc:1480] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 20:02:47.666951 26912 tablet_bootstrap.cc:492] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:47.669948 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 25512bb19e3c4f78bb917378b10021e5 (DEFAULT_TABLE table=default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.676523 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 (DEFAULT_TABLE table=default.Table_f87f9401517747eb9784b49f2ffce310 [id=27105e0b65184760a89eb58afd0539eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.677721 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 7775ad91c86840c49a902b059a0ff74d (DEFAULT_TABLE table=default.Table_c3320acca4da439bb957f8a82adbd8a2 [id=c241df12dd55497985910321fa8f03c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.678681 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7775ad91c86840c49a902b059a0ff74d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:47.681663 26450 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.682060 26450 leader_election.cc:304] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.682807 27733 raft_consensus.cc:2749] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.685498 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.585997 26913 consensus_queue.cc:260] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.686623 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.688274 27733 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.689245 27733 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.689762 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.691418 26913 ts_tablet_manager.cc:1480] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.109s user 0.005s sys 0.000s
I20260928 20:02:47.691304 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.692238 26913 tablet_bootstrap.cc:492] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:47.692806 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 (DEFAULT_TABLE table=default.Table_f87f9401517747eb9784b49f2ffce310 [id=27105e0b65184760a89eb58afd0539eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.693811 26236 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497] alter complete (version 2)
I20260928 20:02:47.694577 26234 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca] alter complete (version 1)
I20260928 20:02:47.696439 26233 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 323) took 2837 ms. Trace:
I20260928 20:02:47.703778 26912 tablet_bootstrap.cc:654] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.696755 26233 rpcz_store.cc:276] 0928 20:02:44.858685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.861442 (+ 2757us) service_pool.cc:224] Handling call
0928 20:02:44.864018 (+ 2576us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:44.864653 (+ 635us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:44.865189 (+ 536us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:44.865385 (+ 196us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:44.916092 (+ 50707us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:44.916119 (+ 27us) write_op.cc:454] Released schema lock
0928 20:02:44.916292 (+ 173us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:47.696376 (+2780084us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:44.895121 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:44.895533 (+ 412us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:44.895558 (+ 25us) write_op.cc:435] Acquired schema lock
0928 20:02:44.895570 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:44.895811 (+ 241us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:44.895852 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:44.895875 (+ 23us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:44.896027 (+ 152us) tablet.cc:701] Row locks acquired
0928 20:02:44.896040 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:44.896139 (+ 99us) write_op.cc:270] Start()
0928 20:02:44.896213 (+ 74us) write_op.cc:276] Timestamp: P: 1790625764896084 usec, L: 0
0928 20:02:44.896227 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:44.896677 (+ 450us) log.cc:844] Serialized 405 byte log entry
0928 20:02:44.905526 (+ 8849us) op_driver.cc:464] REPLICATION: finished
0928 20:02:44.909957 (+ 4431us) write_op.cc:301] APPLY: starting
0928 20:02:44.910013 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:44.910135 (+ 122us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:44.910220 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:44.910398 (+ 178us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:44.910523 (+ 125us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:44.910567 (+ 44us) write_op.cc:312] APPLY: finished
0928 20:02:44.910735 (+ 168us) log.cc:844] Serialized 23 byte log entry
0928 20:02:44.910870 (+ 135us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:44.910927 (+ 57us) write_op.cc:454] Released schema lock
0928 20:02:44.910956 (+ 29us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4290,"apply.run_cpu_time_us":1162,"apply.run_wall_time_us":1162,"num_ops":1,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":1881,"prepare.run_wall_time_us":3636,"raft.queue_time_us":135,"raft.run_cpu_time_us":689,"raft.run_wall_time_us":688,"replication_time_us":9216}]]}
W20260928 20:02:47.705463 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 56) took 1019 ms (client timeout 1000 ms). Trace:
I20260928 20:02:47.716065 27750 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.716678 27750 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.718518 27750 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:47.705865 26233 rpcz_store.cc:269] 0928 20:02:46.685562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:47.705070 (+1019508us) service_pool.cc:211] Skipping call since client already timed out
0928 20:02:47.705390 (+ 320us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 20:02:47.720321 26233 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b91a573103c4c2d995abde8db91b821 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:47.726845 27733 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.737623 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 (DEFAULT_TABLE table=default.Table_f87f9401517747eb9784b49f2ffce310 [id=27105e0b65184760a89eb58afd0539eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.743811 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3657e36a6d2844c28852db1a4f2ed191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.744616 27777 consensus_queue.cc:1048] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:47.745312 27825 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:02:47.748234 27825 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:47.747205 27729 consensus_queue.cc:1048] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:47.751995 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 3 candidate_status { last_received { term: 2 index: 402 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:47.750533 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:47.751776 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:47.762995 26450 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.763872 26450 leader_election.cc:343] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.764520 26450 leader_election.cc:343] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.769114 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_f77e79769ec14ab0ace5b45b517ec34d [id=d89268285ef14f5dbd9e5d503ecba72f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8cbffea517e2438d90ca234b9f72f733 consensus state has no leader
W20260928 20:02:47.784538 26234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 55) took 4332 ms (client timeout 1000 ms). Trace:
I20260928 20:02:47.787467 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.790241 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:47.785358 26234 rpcz_store.cc:269] 0928 20:02:43.451849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:43.459203 (+ 7354us) service_pool.cc:224] Handling call
0928 20:02:47.784414 (+4325211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:44.429736 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:44.430407 (+ 671us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:44.430433 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:44.430446 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:44.430704 (+ 258us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:44.430743 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:44.430765 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:44.430903 (+ 138us) tablet.cc:701] Row locks acquired
0928 20:02:44.430915 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:44.431036 (+ 121us) write_op.cc:270] Start()
0928 20:02:44.431117 (+ 81us) write_op.cc:276] Timestamp: P: 1790625764430977 usec, L: 0
0928 20:02:44.431132 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:44.442733 (+ 11601us) log.cc:844] Serialized 356 byte log entry
0928 20:02:44.462895 (+ 20162us) op_driver.cc:464] REPLICATION: finished
0928 20:02:44.463410 (+ 515us) write_op.cc:301] APPLY: starting
0928 20:02:44.463472 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:44.463566 (+ 94us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:44.463660 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:44.463802 (+ 142us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:44.463923 (+ 121us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:44.463977 (+ 54us) write_op.cc:312] APPLY: finished
0928 20:02:44.464139 (+ 162us) log.cc:844] Serialized 23 byte log entry
0928 20:02:44.464277 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:44.464338 (+ 61us) write_op.cc:454] Released schema lock
0928 20:02:44.464800 (+ 462us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:44.477611 (+ 12811us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:44.477635 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68500,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":366,"apply.run_cpu_time_us":1584,"apply.run_wall_time_us":1585,"num_ops":1,"prepare.queue_time_us":20412,"prepare.run_cpu_time_us":1977,"prepare.run_wall_time_us":47865,"raft.queue_time_us":88,"raft.run_cpu_time_us":604,"raft.run_wall_time_us":8284,"replication_time_us":31676}]]}
W20260928 20:02:47.796572 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48631us
I20260928 20:02:47.797309 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3657e36a6d2844c28852db1a4f2ed191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.802865 27729 raft_consensus.cc:493] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.803299 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:47.803287 27729 raft_consensus.cc:515] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.805347 27729 leader_election.cc:290] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.810947 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596a5540716441c49ec8185c8dc6a80c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.811605 26655 raft_consensus.cc:2468] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:47.770179 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 7775ad91c86840c49a902b059a0ff74d (DEFAULT_TABLE table=default.Table_c3320acca4da439bb957f8a82adbd8a2 [id=c241df12dd55497985910321fa8f03c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.773159 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25512bb19e3c4f78bb917378b10021e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.815904 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3657e36a6d2844c28852db1a4f2ed191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.815502 26450 leader_election.cc:304] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.816434 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7775ad91c86840c49a902b059a0ff74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.819043 26739 leader_election.cc:304] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.819768 26912 tablet_bootstrap.cc:492] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:47.820243 26912 ts_tablet_manager.cc:1449] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.153s user 0.017s sys 0.006s
I20260928 20:02:47.823974 27729 raft_consensus.cc:2804] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:47.824398 27729 raft_consensus.cc:493] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:47.824960 27729 raft_consensus.cc:3060] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.827085 26912 raft_consensus.cc:359] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.827710 26912 raft_consensus.cc:385] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:47.827932 26912 raft_consensus.cc:740] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:47.828655 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:47.828553 26912 consensus_queue.cc:260] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:47.805788 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 7775ad91c86840c49a902b059a0ff74d (DEFAULT_TABLE table=default.Table_c3320acca4da439bb957f8a82adbd8a2 [id=c241df12dd55497985910321fa8f03c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.806838 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:47.829953 26912 ts_tablet_manager.cc:1480] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.009s user 0.004s sys 0.002s
I20260928 20:02:47.836733 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet fa037333676c4dba93160c5e3337f891 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b91a573103c4c2d995abde8db91b821) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:47.838395 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:47.847101 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7775ad91c86840c49a902b059a0ff74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.849650 26912 tablet_bootstrap.cc:492] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:47.851956 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (DEFAULT_TABLE table=default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.852945 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed3cd78c90c42f6a99a92bae2cd5491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.854336 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cda7651d4cf4c7e82c7329735e6bdcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:42 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:47.854507 27825 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:02:47.856479 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (DEFAULT_TABLE table=default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.857360 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed3cd78c90c42f6a99a92bae2cd5491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.863147 27829 raft_consensus.cc:493] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.863673 27829 raft_consensus.cc:515] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.865765 27829 leader_election.cc:290] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.867250 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38abbc891d9c4268820cb0faba3d08b5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:47.868841 26739 leader_election.cc:343] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.884693 26912 tablet_bootstrap.cc:654] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:47.890051 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (DEFAULT_TABLE table=default.Table_67bf18ee818a4291b2f1c8a0ff80078c [id=55d0d2bfce9844fab53d8e8033613353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.892720 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed3cd78c90c42f6a99a92bae2cd5491. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:47.894266 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 129759us
I20260928 20:02:47.895022 26913 tablet_bootstrap.cc:654] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:47.895118 26450 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.895643 26450 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.898685 27750 raft_consensus.cc:2749] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:47.916016 26450 leader_election.cc:343] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.916775 26450 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:47.919312 26740 leader_election.cc:343] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:47.921248 27750 raft_consensus.cc:2749] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.929462 27750 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.929868 27750 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:47.919437 26146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260928 20:02:47.931731 27750 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.877977 27729 raft_consensus.cc:515] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:47.940351 26146 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111)
I20260928 20:02:47.940798 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:02:47.941164 27729 leader_election.cc:290] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.943087 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596a5540716441c49ec8185c8dc6a80c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:47.943699 26651 raft_consensus.cc:3060] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:47.944195 26740 leader_election.cc:343] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:47.945748 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (DEFAULT_TABLE table=default.Table_1b28541b1dad44e393063e5c45c35050 [id=43358fe86db543f2a98a1cd7cf4a450f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.946759 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.947422 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 1dde3191a52b4254944ae1f8556e1632 (DEFAULT_TABLE table=default.Table_3e3854f997f64d7d910310d5a64f929d [id=fc4bea74df184fe5bab194471bd93657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.948391 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dde3191a52b4254944ae1f8556e1632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.950810 26651 raft_consensus.cc:2468] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:47.959630 26739 leader_election.cc:304] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.877889 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (DEFAULT_TABLE table=default.Table_1b28541b1dad44e393063e5c45c35050 [id=43358fe86db543f2a98a1cd7cf4a450f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.961076 27829 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.961694 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:47.961476 27829 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.962285 27837 raft_consensus.cc:2804] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:47.962707 27837 raft_consensus.cc:697] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:47.963495 27837 consensus_queue.cc:237] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:47.966701 27825 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:02:47.972462 27829 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:47.944557 26740 leader_election.cc:304] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:47.976717 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:47.977300 26511 raft_consensus.cc:2468] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:47.978739 26740 leader_election.cc:343] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:47.979257 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (DEFAULT_TABLE table=default.Table_1b28541b1dad44e393063e5c45c35050 [id=43358fe86db543f2a98a1cd7cf4a450f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:47.980010 26740 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:47.980051 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:47.980667 27753 raft_consensus.cc:2749] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.981133 27844 raft_consensus.cc:493] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:47.981371 27753 raft_consensus.cc:2804] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 20:02:47.981585 26739 leader_election.cc:343] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.981680 27753 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:47.981648 27844 raft_consensus.cc:515] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:47.982331 27753 raft_consensus.cc:3060] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:47.983510 27849 tablet.cc:1751] T a9a8177684ed461cbc7bbc4aeb30873c P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 20:02:47.990391 26450 leader_election.cc:343] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.990782 26450 leader_election.cc:304] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.992112 26916 tablet_bootstrap.cc:492] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:47.992638 27844 leader_election.cc:290] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:47.993216 27844 raft_consensus.cc:2749] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:47.998052 26450 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:47.998422 26450 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:47.999083 27673 consensus_queue.cc:1048] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:47.999804 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4b91a573103c4c2d995abde8db91b821
W20260928 20:02:47.999843 26595 consensus_peers.cc:597] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:48.001572 26233 catalog_manager.cc:6934] ReplaceTablet: tablet 4b91a573103c4c2d995abde8db91b821 deleted and replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a
I20260928 20:02:48.001879 26233 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 339) took 2324 ms. Trace:
I20260928 20:02:48.002839 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b91a573103c4c2d995abde8db91b821 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.002172 26233 rpcz_store.cc:276] 0928 20:02:45.677465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:47.720213 (+2042748us) service_pool.cc:224] Handling call
0928 20:02:48.001827 (+281614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:47.803126 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:47.803605 (+ 479us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:47.803630 (+ 25us) write_op.cc:435] Acquired schema lock
0928 20:02:47.803648 (+ 18us) tablet.cc:662] Decoding operations
0928 20:02:47.804023 (+ 375us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:47.804072 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:47.804104 (+ 32us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:47.804347 (+ 243us) tablet.cc:701] Row locks acquired
0928 20:02:47.804366 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:47.804498 (+ 132us) write_op.cc:270] Start()
0928 20:02:47.804591 (+ 93us) write_op.cc:276] Timestamp: P: 1790625767804448 usec, L: 0
0928 20:02:47.804609 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:47.910016 (+105407us) log.cc:844] Serialized 631 byte log entry
0928 20:02:47.988891 (+ 78875us) op_driver.cc:464] REPLICATION: finished
0928 20:02:47.989862 (+ 971us) write_op.cc:301] APPLY: starting
0928 20:02:47.989920 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:47.990042 (+ 122us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:47.990192 (+ 150us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:47.998519 (+ 8327us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:47.998739 (+ 220us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:47.998843 (+ 104us) write_op.cc:312] APPLY: finished
0928 20:02:47.999023 (+ 180us) log.cc:844] Serialized 29 byte log entry
0928 20:02:47.999169 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:47.999232 (+ 63us) write_op.cc:454] Released schema lock
0928 20:02:47.999263 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":792,"num_ops":2,"prepare.queue_time_us":67167,"prepare.run_cpu_time_us":2367,"prepare.run_wall_time_us":108405,"replication_time_us":184178,"thread_start_us":2056,"threads_started":1}]]}
I20260928 20:02:48.007911 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 1dde3191a52b4254944ae1f8556e1632 (DEFAULT_TABLE table=default.Table_3e3854f997f64d7d910310d5a64f929d [id=fc4bea74df184fe5bab194471bd93657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.008876 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dde3191a52b4254944ae1f8556e1632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.010293 27843 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:47.996340 26912 tablet_bootstrap.cc:492] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:47.997103 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.016036 27835 tablet_replica.cc:333] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:48.016335 26912 ts_tablet_manager.cc:1449] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.167s user 0.011s sys 0.000s
I20260928 20:02:48.016894 27835 raft_consensus.cc:2243] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.017380 27835 raft_consensus.cc:2272] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.018658 26912 raft_consensus.cc:359] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.019246 26912 raft_consensus.cc:385] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.019404 27835 ts_tablet_manager.cc:1962] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:48.019479 26912 raft_consensus.cc:740] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.025199 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.026494 26912 consensus_queue.cc:260] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.028326 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:48.015964 26916 ts_tablet_manager.cc:1449] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.404s user 0.003s sys 0.045s
I20260928 20:02:48.039026 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:48.038951 27850 tablet.cc:1751] T a9a8177684ed461cbc7bbc4aeb30873c P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:48.042539 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b91a573103c4c2d995abde8db91b821 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.045552 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:48.046060 26450 leader_election.cc:343] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:48.051715 26450 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:48.052791 26450 leader_election.cc:343] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.053129 26450 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:48.053283 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet e70df4ddf0f9430980c967d798ed6c50 because the tablet was not found. No further retry: Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
W20260928 20:02:48.054142 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4604b0cf7e56457086383c4314814b21 because the tablet was not found. No further retry: Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21
I20260928 20:02:48.054929 26912 ts_tablet_manager.cc:1480] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.038s user 0.007s sys 0.000s
W20260928 20:02:48.055073 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 because the tablet was not found. No further retry: Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:48.055371 27673 raft_consensus.cc:493] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.055812 27844 raft_consensus.cc:2749] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:48.055900 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet fa037333676c4dba93160c5e3337f891 because the tablet was not found. No further retry: Not found: Tablet not found: fa037333676c4dba93160c5e3337f891
I20260928 20:02:48.055763 27673 raft_consensus.cc:515] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.058565 27673 leader_election.cc:290] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:48.059882 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.062345 26804 raft_consensus.cc:2468] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:48.063493 26594 leader_election.cc:304] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:48.064306 27673 raft_consensus.cc:2804] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:48.064720 27844 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.064648 27673 raft_consensus.cc:493] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:48.065102 27844 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.065644 26913 tablet_bootstrap.cc:492] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:48.066008 26913 ts_tablet_manager.cc:1449] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.374s user 0.008s sys 0.000s
I20260928 20:02:48.066015 26916 raft_consensus.cc:359] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.066655 26916 raft_consensus.cc:385] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.066905 27844 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:48.065217 27673 raft_consensus.cc:3060] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:48.063382 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 979f943cd32849f399347f3d9d5b5c18 (DEFAULT_TABLE table=default.Table_8691e84d63084dd38d8988f4311c83c6 [id=5bcb1e3b9dec45df8affc72f783620c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.081730 27673 raft_consensus.cc:515] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.066900 26916 raft_consensus.cc:740] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.082923 26916 consensus_queue.cc:260] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.083428 27051 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260928 20:02:48.073916 27857 tablet_replica.cc:333] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:48.084966 27857 raft_consensus.cc:2243] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.085559 27857 raft_consensus.cc:2272] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.085661 27051 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:02:48.085618 27753 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:48.090041 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4b91a573103c4c2d995abde8db91b821 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b91a573103c4c2d995abde8db91b821 already in progress: creating tablet
I20260928 20:02:48.088363 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b91a573103c4c2d995abde8db91b821 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.093340 27857 ts_tablet_manager.cc:1962] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:48.088126 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979f943cd32849f399347f3d9d5b5c18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:48.054028 26450 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.099846 27673 leader_election.cc:290] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:48.099795 26450 leader_election.cc:304] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:48.100332 26450 raft_consensus.cc:2686] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 20:02:48.100749 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46746.5us
I20260928 20:02:48.094985 26916 ts_tablet_manager.cc:1480] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.065s user 0.005s sys 0.000s
I20260928 20:02:48.102131 26916 tablet_bootstrap.cc:492] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:48.102746 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 1dde3191a52b4254944ae1f8556e1632 (DEFAULT_TABLE table=default.Table_3e3854f997f64d7d910310d5a64f929d [id=fc4bea74df184fe5bab194471bd93657]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.103684 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dde3191a52b4254944ae1f8556e1632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.105389 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d7ab92a37c4f9b865fa9fe49d46916" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:48.123955 26595 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
W20260928 20:02:48.127143 26595 consensus_peers.cc:597] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93fb4e1fd0584a42a4de9eab14d5578c. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:48.128022 26595 leader_election.cc:343] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
W20260928 20:02:48.130982 26450 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.133785 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 979f943cd32849f399347f3d9d5b5c18 (DEFAULT_TABLE table=default.Table_8691e84d63084dd38d8988f4311c83c6 [id=5bcb1e3b9dec45df8affc72f783620c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.138224 26916 tablet_bootstrap.cc:654] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.079043 26913 raft_consensus.cc:359] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.146358 26913 raft_consensus.cc:385] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.146692 26913 raft_consensus.cc:740] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.147461 26913 consensus_queue.cc:260] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.149752 26916 tablet_bootstrap.cc:492] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:48.150135 26913 ts_tablet_manager.cc:1480] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.084s user 0.006s sys 0.000s
I20260928 20:02:48.150166 26916 ts_tablet_manager.cc:1449] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.000s
I20260928 20:02:48.152462 26916 raft_consensus.cc:359] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.153123 26916 raft_consensus.cc:385] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.153393 26916 raft_consensus.cc:740] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:02:48.154538 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 61493us
I20260928 20:02:48.157610 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 979f943cd32849f399347f3d9d5b5c18 (DEFAULT_TABLE table=default.Table_8691e84d63084dd38d8988f4311c83c6 [id=5bcb1e3b9dec45df8affc72f783620c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.158268 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 5b276f21d85c4bb4bdd777f8f9a43960 (DEFAULT_TABLE table=default.Table_505b4c5717db4fc4941b68e6271305a6 [id=85411afbf7894f15aa20dfcecafc0a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.158592 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979f943cd32849f399347f3d9d5b5c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.161906 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2728c9979bb647a5a8f0a902c299e53d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:48.162447 26800 raft_consensus.cc:3060] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:48.164352 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 5b276f21d85c4bb4bdd777f8f9a43960 (DEFAULT_TABLE table=default.Table_505b4c5717db4fc4941b68e6271305a6 [id=85411afbf7894f15aa20dfcecafc0a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.165208 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b276f21d85c4bb4bdd777f8f9a43960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.168572 26912 tablet_bootstrap.cc:492] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:48.178040 26800 raft_consensus.cc:2468] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:48.184710 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979f943cd32849f399347f3d9d5b5c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.184702 27857 ts_tablet_manager.cc:1975] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:48.185120 27857 log.cc:1199] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4b91a573103c4c2d995abde8db91b821
I20260928 20:02:48.185798 27857 ts_tablet_manager.cc:1996] T 4b91a573103c4c2d995abde8db91b821 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:48.187888 27753 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:48.192353 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d7ab92a37c4f9b865fa9fe49d46916" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.192562 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:48.192966 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 4b91a573103c4c2d995abde8db91b821 (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]) successfully deleted
I20260928 20:02:48.193082 26513 raft_consensus.cc:3060] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:48.194785 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b276f21d85c4bb4bdd777f8f9a43960. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:48.200845 26450 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.201231 26450 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:48.202028 27844 raft_consensus.cc:2749] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:48.201248 26513 raft_consensus.cc:2468] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:48.210237 26916 consensus_queue.cc:260] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.212363 26916 ts_tablet_manager.cc:1480] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.062s user 0.004s sys 0.000s
I20260928 20:02:48.213292 26916 tablet_bootstrap.cc:492] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:48.086243 27051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:02:48.218935 26916 tablet_bootstrap.cc:654] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.228631 26740 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:48.230563 27837 raft_consensus.cc:2804] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:48.230767 26912 tablet_bootstrap.cc:654] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.230996 27837 raft_consensus.cc:697] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:48.231321 26234 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228]). Expected version 2 got 0
I20260928 20:02:48.231769 27837 consensus_queue.cc:237] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.151054 26913 tablet_bootstrap.cc:492] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:48.161613 26637 tablet_service.cc:1511] Processing CreateTablet for tablet ea01d2ddd91d4a0fa29afaebfbd83528 (DEFAULT_TABLE table=default.Table_9ef30a62591542edab5ee1be742ee4b3 [id=e246baf2b71f4e35811937013e2ff074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.235321 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea01d2ddd91d4a0fa29afaebfbd83528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.159394 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 5b276f21d85c4bb4bdd777f8f9a43960 (DEFAULT_TABLE table=default.Table_505b4c5717db4fc4941b68e6271305a6 [id=85411afbf7894f15aa20dfcecafc0a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.239051 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b276f21d85c4bb4bdd777f8f9a43960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.254179 26782 tablet_service.cc:1511] Processing CreateTablet for tablet ea01d2ddd91d4a0fa29afaebfbd83528 (DEFAULT_TABLE table=default.Table_9ef30a62591542edab5ee1be742ee4b3 [id=e246baf2b71f4e35811937013e2ff074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.255144 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea01d2ddd91d4a0fa29afaebfbd83528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.265410 26912 tablet_bootstrap.cc:492] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:48.265913 26912 ts_tablet_manager.cc:1449] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.098s user 0.007s sys 0.003s
I20260928 20:02:48.272698 26490 tablet_service.cc:1511] Processing CreateTablet for tablet ea01d2ddd91d4a0fa29afaebfbd83528 (DEFAULT_TABLE table=default.Table_9ef30a62591542edab5ee1be742ee4b3 [id=e246baf2b71f4e35811937013e2ff074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.273816 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea01d2ddd91d4a0fa29afaebfbd83528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.273962 26594 leader_election.cc:304] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:48.275461 27759 raft_consensus.cc:2804] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:48.276108 27759 raft_consensus.cc:697] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:48.284521 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:48.277133 27759 consensus_queue.cc:237] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.285665 26234 catalog_manager.cc:5838] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:48.286880 26234 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:48.254330 27863 tablet.cc:1751] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:48.316270 27862 consensus_queue.cc:1048] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:48.316817 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3021bc9be24874a6ebee01dfb6d7fa (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.317170 26912 raft_consensus.cc:359] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.317826 26912 raft_consensus.cc:385] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:02:48.317859 26739 leader_election.cc:343] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.319834 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3021bc9be24874a6ebee01dfb6d7fa (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.320649 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3021bc9be24874a6ebee01dfb6d7fa (DEFAULT_TABLE table=default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.321449 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3021bc9be24874a6ebee01dfb6d7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.324168 26913 tablet_bootstrap.cc:654] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:48.345287 26595 consensus_peers.cc:597] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:48.349021 26636 tablet_service.cc:1511] Processing CreateTablet for tablet a0133314d6de46cea61a9260df79bdea (DEFAULT_TABLE table=default.Table_007ea4b1225442a2b70ad99fa3bafe73 [id=0d8dd739f4ba4c9baeccfb6cd40490c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.350230 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3021bc9be24874a6ebee01dfb6d7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.350940 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0133314d6de46cea61a9260df79bdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.386837 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3021bc9be24874a6ebee01dfb6d7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.410772 27676 consensus_queue.cc:1048] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:48.415915 27676 raft_consensus.cc:493] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.416397 27676 raft_consensus.cc:515] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.417738 26782 tablet_service.cc:1511] Processing CreateTablet for tablet a0133314d6de46cea61a9260df79bdea (DEFAULT_TABLE table=default.Table_007ea4b1225442a2b70ad99fa3bafe73 [id=0d8dd739f4ba4c9baeccfb6cd40490c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.417882 26493 tablet_service.cc:1511] Processing CreateTablet for tablet a0133314d6de46cea61a9260df79bdea (DEFAULT_TABLE table=default.Table_007ea4b1225442a2b70ad99fa3bafe73 [id=0d8dd739f4ba4c9baeccfb6cd40490c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:48.419231 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0133314d6de46cea61a9260df79bdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.419308 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0133314d6de46cea61a9260df79bdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:48.419672 27676 leader_election.cc:290] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:48.421182 26595 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
W20260928 20:02:48.423163 26594 leader_election.cc:343] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:48.423511 26594 leader_election.cc:304] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:48.424351 27676 raft_consensus.cc:2749] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:48.424978 26912 raft_consensus.cc:740] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.425663 26912 consensus_queue.cc:260] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.448756 26912 ts_tablet_manager.cc:1480] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.142s user 0.005s sys 0.000s
I20260928 20:02:48.453177 26233 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228]). Expected version 2 got 0
I20260928 20:02:48.449956 26912 tablet_bootstrap.cc:492] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:48.458571 26233 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:48.467635 26916 tablet_bootstrap.cc:492] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:48.468045 26916 ts_tablet_manager.cc:1449] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.255s user 0.054s sys 0.064s
I20260928 20:02:48.468431 27835 ts_tablet_manager.cc:1975] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:48.469066 27835 log.cc:1199] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:48.469835 27835 ts_tablet_manager.cc:1996] T 8163815661694d70ba4c2e36a424eaa1 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:48.470958 26916 raft_consensus.cc:359] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.472322 26916 raft_consensus.cc:385] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.472616 26916 raft_consensus.cc:740] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.472774 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 8163815661694d70ba4c2e36a424eaa1 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]) successfully deleted
I20260928 20:02:48.473397 26916 consensus_queue.cc:260] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:48.473984 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 7cda7651d4cf4c7e82c7329735e6bdcc because the tablet was not found. No further retry: Not found: Tablet not found: 7cda7651d4cf4c7e82c7329735e6bdcc
W20260928 20:02:48.474560 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4b91a573103c4c2d995abde8db91b821 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b91a573103c4c2d995abde8db91b821 already in progress: creating tablet
I20260928 20:02:48.475612 26916 ts_tablet_manager.cc:1480] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260928 20:02:48.476516 26916 tablet_bootstrap.cc:492] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:48.481734 26916 tablet_bootstrap.cc:654] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.495105 26912 tablet_bootstrap.cc:654] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.503086 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_8d26e012313e4a30b824a5f081aa548d [id=219bcf821c96465eb48c3199ea6f4237] alter complete (version 3)
I20260928 20:02:48.504148 26231 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499] alter complete (version 1)
W20260928 20:02:48.511963 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 54) took 4258 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.515892 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 with delete_type TABLET_DATA_DELETED (replaced by tablet a86e8a782b3e46d09a45bbb7025546af) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.517112 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.517750 27854 tablet_replica.cc:333] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:02:48.517832 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 82e0acdca2ff4dfc9ae5ddc97d7aab24 because the tablet was not found. No further retry: Not found: Tablet not found: 82e0acdca2ff4dfc9ae5ddc97d7aab24
I20260928 20:02:48.518848 27854 raft_consensus.cc:2243] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.519299 27854 raft_consensus.cc:2272] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.521473 27854 ts_tablet_manager.cc:1962] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:48.522970 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:48.512274 26231 rpcz_store.cc:269] 0928 20:02:44.253780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.253931 (+ 151us) service_pool.cc:224] Handling call
0928 20:02:48.511894 (+4257963us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:47.754773 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:47.755319 (+ 546us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:47.755347 (+ 28us) write_op.cc:435] Acquired schema lock
0928 20:02:47.755365 (+ 18us) tablet.cc:662] Decoding operations
0928 20:02:47.755648 (+ 283us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:47.755699 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:47.755726 (+ 27us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:47.755923 (+ 197us) tablet.cc:701] Row locks acquired
0928 20:02:47.755940 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:02:47.756073 (+ 133us) write_op.cc:270] Start()
0928 20:02:47.756160 (+ 87us) write_op.cc:276] Timestamp: P: 1790625767756022 usec, L: 0
0928 20:02:47.756178 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:47.756730 (+ 552us) log.cc:844] Serialized 356 byte log entry
0928 20:02:47.968993 (+212263us) op_driver.cc:464] REPLICATION: finished
0928 20:02:47.986535 (+ 17542us) write_op.cc:301] APPLY: starting
0928 20:02:47.986607 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:47.986723 (+ 116us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:47.986842 (+ 119us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:47.987096 (+ 254us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:47.987242 (+ 146us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:47.987294 (+ 52us) write_op.cc:312] APPLY: finished
0928 20:02:47.987490 (+ 196us) log.cc:844] Serialized 23 byte log entry
0928 20:02:47.987643 (+ 153us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:47.987704 (+ 61us) write_op.cc:454] Released schema lock
0928 20:02:47.987733 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:48.023931 (+ 36198us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.023971 (+ 40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10427,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":17349,"apply.run_cpu_time_us":1470,"apply.run_wall_time_us":37368,"num_ops":1,"prepare.queue_time_us":56833,"prepare.run_cpu_time_us":2957,"prepare.run_wall_time_us":48225,"raft.queue_time_us":55166,"raft.run_cpu_time_us":1324,"raft.run_wall_time_us":1874,"replication_time_us":212704,"thread_start_us":124759,"threads_started":3}]]}
I20260928 20:02:48.523747 26913 tablet_bootstrap.cc:492] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:48.524147 26913 ts_tablet_manager.cc:1449] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.373s user 0.008s sys 0.000s
I20260928 20:02:48.537240 26913 raft_consensus.cc:359] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.537874 26913 raft_consensus.cc:385] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.544471 26912 tablet_bootstrap.cc:492] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:48.544914 26912 ts_tablet_manager.cc:1449] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.095s user 0.009s sys 0.000s
I20260928 20:02:48.547184 26912 raft_consensus.cc:359] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.550832 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.497270 27844 raft_consensus.cc:493] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.552085 27844 raft_consensus.cc:515] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.552719 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.554255 27844 leader_election.cc:290] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:48.554965 26912 raft_consensus.cc:385] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.555516 26912 raft_consensus.cc:740] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.555575 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.556242 26912 consensus_queue.cc:260] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.556592 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:48.556847 26913 raft_consensus.cc:740] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.558070 26913 consensus_queue.cc:260] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:48.561998 26450 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:48.562610 26450 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.562930 26450 leader_election.cc:304] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:48.563428 26913 ts_tablet_manager.cc:1480] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.039s user 0.008s sys 0.000s
I20260928 20:02:48.564832 26912 ts_tablet_manager.cc:1480] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260928 20:02:48.569844 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:48.571359 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet c4de78b7781d43458cbf2d3e889357fc because the tablet was not found. No further retry: Not found: Tablet not found: c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:48.573558 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:48.574892 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet db5f5f16f2d7457799e1b96a293695f4 because the tablet was not found. No further retry: Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:48.575338 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:48.576925 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because the tablet was not found. No further retry: Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:48.578262 27844 raft_consensus.cc:2749] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:48.578836 27844 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.579180 27844 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.580901 27844 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:48.583071 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.584160 26912 tablet_bootstrap.cc:492] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:48.585013 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:48.586289 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.586349 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.587061 27857 tablet_replica.cc:333] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:48.587920 27857 raft_consensus.cc:2243] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.588366 27857 raft_consensus.cc:2272] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.588891 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.590207 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac with delete_type TABLET_DATA_DELETED (replaced by tablet 3ed3cd78c90c42f6a99a92bae2cd5491) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:48.590574 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because the tablet was not found. No further retry: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:48.590914 27857 ts_tablet_manager.cc:1962] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:48.592525 26450 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:48.593124 26450 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.593581 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.594484 26450 leader_election.cc:304] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:48.594872 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because the tablet was not found. No further retry: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:48.596180 27844 raft_consensus.cc:2749] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:48.596253 26232 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 55) took 3206 ms (client timeout 1000 ms). Trace:
W20260928 20:02:48.596572 26232 rpcz_store.cc:269] 0928 20:02:45.390167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.390292 (+ 125us) service_pool.cc:224] Handling call
0928 20:02:45.395566 (+ 5274us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:48.596190 (+3200624us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":5465344}
I20260928 20:02:48.597429 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.598694 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.599364 27862 raft_consensus.cc:493] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:48.599615 26229 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 29dd1355039e4bca952f13a9d174813e consensus state has no leader
I20260928 20:02:48.599771 27862 raft_consensus.cc:515] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.601329 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.601677 27862 leader_election.cc:290] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:48.603585 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4604b0cf7e56457086383c4314814b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.604033 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet c4de78b7781d43458cbf2d3e889357fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.604700 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0308d824cf401c8cca0cf7a950fd53" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:48.605330 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:48.605662 26740 leader_election.cc:343] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4d0308d824cf401c8cca0cf7a950fd53
W20260928 20:02:48.606047 26739 leader_election.cc:343] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.606421 26739 leader_election.cc:304] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:48.606288 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4604b0cf7e56457086383c4314814b21 because the tablet was not found. No further retry: Not found: Tablet not found: 4604b0cf7e56457086383c4314814b21
W20260928 20:02:48.607041 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet c4de78b7781d43458cbf2d3e889357fc because the tablet was not found. No further retry: Not found: Tablet not found: c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:48.607450 27862 raft_consensus.cc:2749] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:48.610553 27854 ts_tablet_manager.cc:1975] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:48.610901 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.611886 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.612231 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:48.612932 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because the tablet was not found. No further retry: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:48.613217 27835 tablet_replica.cc:333] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:48.614080 27835 raft_consensus.cc:2243] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.614530 27835 raft_consensus.cc:2272] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.615993 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.616328 27835 ts_tablet_manager.cc:1962] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:48.623592 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d4ea23c18e04819b28d3428d584f3ac with delete_type TABLET_DATA_DELETED (replaced by tablet 3ed3cd78c90c42f6a99a92bae2cd5491) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.623972 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.624279 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.624294 27854 log.cc:1199] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/946f215581734bf591ab05502e5ff4a0
I20260928 20:02:48.623313 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.625291 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.627656 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.627998 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.628108 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.628698 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.632300 27854 ts_tablet_manager.cc:1996] T 946f215581734bf591ab05502e5ff4a0 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:48.633137 27759 raft_consensus.cc:493] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.633587 27759 raft_consensus.cc:515] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.635687 27759 leader_election.cc:290] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:48.638842 26595 leader_election.cc:343] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:48.638958 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.640074 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 946f215581734bf591ab05502e5ff4a0 (table default.Table_6ca64aa2893a44d1b8e8321bd40ffbcd [id=78b4f1c42b7347169b12fd63aad7323e]) successfully deleted
I20260928 20:02:48.642362 26912 tablet_bootstrap.cc:654] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:48.643781 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet c4de78b7781d43458cbf2d3e889357fc because the tablet was not found. No further retry: Not found: Tablet not found: c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:48.647604 27854 tablet_replica.cc:333] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:48.648617 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.649000 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.649763 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:48.650799 26594 consensus_peers.cc:597] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:48.651463 27835 ts_tablet_manager.cc:1975] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:48.651948 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38abbc891d9c4268820cb0faba3d08b5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.652503 26800 raft_consensus.cc:2468] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:48.651930 27835 log.cc:1199] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:48.653723 26594 leader_election.cc:304] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:48.654631 27835 ts_tablet_manager.cc:1996] T 2728c9979bb647a5a8f0a902c299e53d P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:48.654793 27759 raft_consensus.cc:2804] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:48.655115 27759 raft_consensus.cc:493] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:48.655439 27759 raft_consensus.cc:3060] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:48.663331 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.664882 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:48.614775 26230 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 57) took 3074 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.666311 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:48.665879 26230 rpcz_store.cc:269] 0928 20:02:45.540612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.611795 (+ 71183us) service_pool.cc:224] Handling call
0928 20:02:45.663980 (+ 52185us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:48.614700 (+2950720us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26054,"reported_tablets":16,"spinlock_wait_cycles":88918400}
I20260928 20:02:48.667189 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7e6367b41265466ab78f164d3ea3c7e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:48.668659 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e6367b41265466ab78f164d3ea3c7e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:48.670513 27835 tablet_replica.cc:333] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:02:48.645984 26227 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 56) took 4152 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.671697 27835 raft_consensus.cc:2243] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.672456 27835 raft_consensus.cc:2272] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.676916 27835 ts_tablet_manager.cc:1962] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:48.649580 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 58) took 2095 ms (client timeout 1000 ms). Trace:
W20260928 20:02:48.679884 26235 rpcz_store.cc:269] 0928 20:02:46.553694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:46.769990 (+216296us) service_pool.cc:224] Handling call
0928 20:02:48.649517 (+1879527us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16741,"reported_tablets":18}
W20260928 20:02:48.645205 26228 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 73) took 4202 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.640707 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_986d7757289e4ee0811e7ca166ab20bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:48.683712 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_986d7757289e4ee0811e7ca166ab20bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:48.686851 27854 raft_consensus.cc:2243] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:48.689603 27854 raft_consensus.cc:2272] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.684374 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 2728c9979bb647a5a8f0a902c299e53d (table default.Table_60b73bf93b434a499c613715e7cd6464 [id=42c910625bf147a08dd2e86593dee01a]) successfully deleted
W20260928 20:02:48.684660 26229 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 75) took 2059 ms (client timeout 1000 ms). Trace:
W20260928 20:02:48.691639 26229 rpcz_store.cc:269] 0928 20:02:46.624846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:46.795230 (+170384us) service_pool.cc:224] Handling call
0928 20:02:48.684598 (+1889368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25525,"reported_tablets":43}
I20260928 20:02:48.694353 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_65e7aa358d65483d80d93aab4fbce62a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:48.701006 27854 ts_tablet_manager.cc:1962] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:48.707696 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65e7aa358d65483d80d93aab4fbce62a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:48.693482 26236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 74) took 3169 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.687971 26234 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3] alter complete (version 2)
I20260928 20:02:48.692458 26235 master_service.cc:960] ReplaceTablet: received request to replace tablet 78d5de4a82bd41c1a8b2af2ba7417c46 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:48.712949 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.714414 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.715576 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.719869 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.720810 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.710071 27835 ts_tablet_manager.cc:1975] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:48.721481 27835 log.cc:1199] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:48.723455 27835 ts_tablet_manager.cc:1996] T a0dd3080d50748d2ad79f472d3c17673 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:02:48.708264 26236 rpcz_store.cc:269] 0928 20:02:45.524466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:45.606812 (+ 82346us) service_pool.cc:224] Handling call
0928 20:02:46.862187 (+1255375us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.862212 (+ 25us) write_op.cc:454] Released schema lock
0928 20:02:48.693419 (+1831207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:46.806301 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:46.806693 (+ 392us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:46.806718 (+ 25us) write_op.cc:435] Acquired schema lock
0928 20:02:46.806729 (+ 11us) tablet.cc:662] Decoding operations
0928 20:02:46.806998 (+ 269us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:46.807037 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:46.807068 (+ 31us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:46.807225 (+ 157us) tablet.cc:701] Row locks acquired
0928 20:02:46.807238 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:46.807349 (+ 111us) write_op.cc:270] Start()
0928 20:02:46.807428 (+ 79us) write_op.cc:276] Timestamp: P: 1790625766807306 usec, L: 0
0928 20:02:46.807443 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:46.807945 (+ 502us) log.cc:844] Serialized 356 byte log entry
0928 20:02:46.815045 (+ 7100us) op_driver.cc:464] REPLICATION: finished
0928 20:02:46.815344 (+ 299us) write_op.cc:301] APPLY: starting
0928 20:02:46.815398 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:46.815491 (+ 93us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:46.815587 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:46.815757 (+ 170us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:46.815943 (+ 186us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:46.816009 (+ 66us) write_op.cc:312] APPLY: finished
0928 20:02:46.816203 (+ 194us) log.cc:844] Serialized 23 byte log entry
0928 20:02:46.816346 (+ 143us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.816405 (+ 59us) write_op.cc:454] Released schema lock
0928 20:02:46.816434 (+ 29us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":23559,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":161,"apply.run_cpu_time_us":1256,"apply.run_wall_time_us":1255,"num_ops":1,"prepare.queue_time_us":5043,"prepare.run_cpu_time_us":1908,"prepare.run_wall_time_us":1908,"raft.queue_time_us":182,"raft.run_cpu_time_us":670,"raft.run_wall_time_us":670,"replication_time_us":7510}]]}
W20260928 20:02:48.671890 26227 rpcz_store.cc:269] 0928 20:02:44.493969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.494095 (+ 126us) service_pool.cc:224] Handling call
0928 20:02:44.547679 (+ 53584us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:48.645920 (+4098241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:45.857500 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:45.857992 (+ 492us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:45.858026 (+ 34us) write_op.cc:435] Acquired schema lock
0928 20:02:45.858046 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:45.858364 (+ 318us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:45.858415 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:45.858448 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:45.858626 (+ 178us) tablet.cc:701] Row locks acquired
0928 20:02:45.858645 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:45.858777 (+ 132us) write_op.cc:270] Start()
0928 20:02:45.858881 (+ 104us) write_op.cc:276] Timestamp: P: 1790625765858721 usec, L: 0
0928 20:02:45.858903 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:02:45.859513 (+ 610us) log.cc:844] Serialized 536 byte log entry
0928 20:02:46.078027 (+218514us) op_driver.cc:464] REPLICATION: finished
0928 20:02:46.078283 (+ 256us) write_op.cc:301] APPLY: starting
0928 20:02:46.078343 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:46.078457 (+ 114us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:46.078576 (+ 119us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:46.078766 (+ 190us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:46.078928 (+ 162us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:46.078997 (+ 69us) write_op.cc:312] APPLY: finished
0928 20:02:46.079192 (+ 195us) log.cc:844] Serialized 23 byte log entry
0928 20:02:46.079347 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.079417 (+ 70us) write_op.cc:454] Released schema lock
0928 20:02:46.079457 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:46.080806 (+ 1349us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:46.080829 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"spinlock_wait_cycles":114938240,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":1368,"apply.run_wall_time_us":1368,"num_ops":1,"prepare.queue_time_us":166992,"prepare.run_cpu_time_us":2370,"prepare.run_wall_time_us":223324,"raft.queue_time_us":65,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":11,"replication_time_us":219004}]]}
I20260928 20:02:48.726943 26227 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5b3bc03525cd48b7b3c9e4323c0206dd" } modify_external_catalogs: true
I20260928 20:02:48.730312 26916 tablet_bootstrap.cc:492] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:48.730839 26916 ts_tablet_manager.cc:1449] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.255s user 0.008s sys 0.001s
I20260928 20:02:48.733414 26916 raft_consensus.cc:359] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.749758 26912 tablet_bootstrap.cc:492] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:48.750247 26912 ts_tablet_manager.cc:1449] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.166s user 0.011s sys 0.002s
I20260928 20:02:48.654290 26913 tablet_bootstrap.cc:492] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:48.698190 27759 raft_consensus.cc:515] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.757757 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38abbc891d9c4268820cb0faba3d08b5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:48.758450 26804 raft_consensus.cc:3060] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:48.759493 26916 raft_consensus.cc:385] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.759802 26916 raft_consensus.cc:740] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.760497 26916 consensus_queue.cc:260] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.762377 26916 ts_tablet_manager.cc:1480] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260928 20:02:48.766582 26804 raft_consensus.cc:2468] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:48.767658 26594 leader_election.cc:304] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:48.768443 27777 raft_consensus.cc:2804] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:48.768859 27777 raft_consensus.cc:697] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:48.769582 27777 consensus_queue.cc:237] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.772535 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 946f215581734bf591ab05502e5ff4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:48.682336 26228 rpcz_store.cc:269] 0928 20:02:44.442403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:44.442576 (+ 173us) service_pool.cc:224] Handling call
0928 20:02:48.645137 (+4202561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:45.422188 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:45.422563 (+ 375us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:45.422586 (+ 23us) write_op.cc:435] Acquired schema lock
0928 20:02:45.422598 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:45.422835 (+ 237us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:45.422873 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:45.422894 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:45.423041 (+ 147us) tablet.cc:701] Row locks acquired
0928 20:02:45.423054 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:45.423149 (+ 95us) write_op.cc:270] Start()
0928 20:02:45.423227 (+ 78us) write_op.cc:276] Timestamp: P: 1790625765423099 usec, L: 0
0928 20:02:45.423242 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:45.423703 (+ 461us) log.cc:844] Serialized 536 byte log entry
0928 20:02:45.599429 (+175726us) op_driver.cc:464] REPLICATION: finished
0928 20:02:45.599674 (+ 245us) write_op.cc:301] APPLY: starting
0928 20:02:45.599731 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:45.599832 (+ 101us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:45.599940 (+ 108us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:45.600112 (+ 172us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:45.600241 (+ 129us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:45.600287 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:02:45.600462 (+ 175us) log.cc:844] Serialized 23 byte log entry
0928 20:02:45.600605 (+ 143us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:45.600665 (+ 60us) write_op.cc:454] Released schema lock
0928 20:02:45.600694 (+ 29us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 20:02:47.911661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:47.912112 (+ 451us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:47.912138 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:47.912153 (+ 15us) tablet.cc:662] Decoding operations
0928 20:02:47.912446 (+ 293us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:47.912487 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:47.912510 (+ 23us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:47.912671 (+ 161us) tablet.cc:701] Row locks acquired
0928 20:02:47.912684 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:47.912820 (+ 136us) write_op.cc:270] Start()
0928 20:02:47.912922 (+ 102us) write_op.cc:276] Timestamp: P: 1790625767912741 usec, L: 0
0928 20:02:47.912939 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:47.913434 (+ 495us) log.cc:844] Serialized 356 byte log entry
0928 20:02:48.109465 (+196031us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.110586 (+ 1121us) write_op.cc:301] APPLY: starting
0928 20:02:48.110642 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.110735 (+ 93us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.110823 (+ 88us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.110968 (+ 145us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.111094 (+ 126us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:48.111137 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:48.111297 (+ 160us) log.cc:844] Serialized 23 byte log entry
0928 20:02:48.111453 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.111510 (+ 57us) write_op.cc:454] Released schema lock
0928 20:02:48.111539 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:48.111871 (+ 332us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.111900 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36169,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":96,"apply.run_cpu_time_us":1236,"apply.run_wall_time_us":1237,"num_ops":1,"prepare.queue_time_us":81028,"prepare.run_cpu_time_us":1883,"prepare.run_wall_time_us":61760,"raft.queue_time_us":91,"raft.run_cpu_time_us":656,"raft.run_wall_time_us":656,"replication_time_us":176080}],["op",{"apply.queue_time_us":972,"apply.run_cpu_time_us":1142,"apply.run_wall_time_us":1251,"num_ops":1,"prepare.queue_time_us":172012,"prepare.run_cpu_time_us":2067,"prepare.run_wall_time_us":44456,"replication_time_us":196434}]]}
I20260928 20:02:48.778836 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:48.779435 26234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 59) took 1038 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.781615 27863 tablet.cc:1751] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:48.782797 27759 leader_election.cc:290] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:48.785004 26595 leader_election.cc:343] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:48.786931 27835 tablet_replica.cc:333] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:48.788134 27835 raft_consensus.cc:2243] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:48.788882 26913 tablet_bootstrap.cc:654] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.789198 27835 raft_consensus.cc:2272] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.791800 27835 ts_tablet_manager.cc:1962] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:48.792434 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 29dd1355039e4bca952f13a9d174813e consensus state has no leader
I20260928 20:02:48.792912 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet a0dd3080d50748d2ad79f472d3c17673 (table default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]) successfully deleted
I20260928 20:02:48.807018 26912 raft_consensus.cc:359] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.807854 26912 raft_consensus.cc:385] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:48.814121 27888 tablet.cc:1751] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:48.822772 27857 ts_tablet_manager.cc:1975] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 20:02:48.779768 26234 rpcz_store.cc:269] 0928 20:02:47.740970 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:47.793770 (+ 52800us) service_pool.cc:224] Handling call
0928 20:02:47.916649 (+122879us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:48.406624 (+489975us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.406655 (+ 31us) write_op.cc:454] Released schema lock
0928 20:02:48.687641 (+280986us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.687668 (+ 27us) write_op.cc:454] Released schema lock
0928 20:02:48.779372 (+ 91704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.374938 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.375511 (+ 573us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.375545 (+ 34us) write_op.cc:435] Acquired schema lock
0928 20:02:48.375576 (+ 31us) tablet.cc:662] Decoding operations
0928 20:02:48.375911 (+ 335us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.375968 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.375994 (+ 26us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:48.376171 (+ 177us) tablet.cc:701] Row locks acquired
0928 20:02:48.376184 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:48.376318 (+ 134us) write_op.cc:270] Start()
0928 20:02:48.376417 (+ 99us) write_op.cc:276] Timestamp: P: 1790625768376261 usec, L: 0
0928 20:02:48.376441 (+ 24us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.377098 (+ 657us) log.cc:844] Serialized 536 byte log entry
0928 20:02:48.387666 (+ 10568us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.388065 (+ 399us) write_op.cc:301] APPLY: starting
0928 20:02:48.388118 (+ 53us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.388207 (+ 89us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.388315 (+ 108us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.388475 (+ 160us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.388592 (+ 117us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:48.388637 (+ 45us) write_op.cc:312] APPLY: finished
0928 20:02:48.388798 (+ 161us) log.cc:844] Serialized 23 byte log entry
0928 20:02:48.388950 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.389007 (+ 57us) write_op.cc:454] Released schema lock
0928 20:02:48.389037 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 20:02:48.670154 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.670594 (+ 440us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.670622 (+ 28us) write_op.cc:435] Acquired schema lock
0928 20:02:48.670641 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:48.670972 (+ 331us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.671020 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.671050 (+ 30us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:48.671215 (+ 165us) tablet.cc:701] Row locks acquired
0928 20:02:48.671236 (+ 21us) write_op.cc:260] PREPARE: finished
0928 20:02:48.671352 (+ 116us) write_op.cc:270] Start()
0928 20:02:48.671442 (+ 90us) write_op.cc:276] Timestamp: P: 1790625768671277 usec, L: 0
0928 20:02:48.671465 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.672006 (+ 541us) log.cc:844] Serialized 356 byte log entry
0928 20:02:48.680940 (+ 8934us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.681263 (+ 323us) write_op.cc:301] APPLY: starting
0928 20:02:48.681322 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.681411 (+ 89us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.681505 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.681670 (+ 165us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.681796 (+ 126us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:48.681852 (+ 56us) write_op.cc:312] APPLY: finished
0928 20:02:48.682001 (+ 149us) log.cc:844] Serialized 23 byte log entry
0928 20:02:48.682738 (+ 737us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.682817 (+ 79us) write_op.cc:454] Released schema lock
0928 20:02:48.682846 (+ 29us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":22,"spinlock_wait_cycles":81430400,"child_traces":[["op",{"apply.queue_time_us":269,"apply.run_cpu_time_us":1134,"apply.run_wall_time_us":1134,"num_ops":1,"prepare.queue_time_us":85581,"prepare.run_cpu_time_us":2547,"prepare.run_wall_time_us":2548,"raft.queue_time_us":1794,"raft.run_cpu_time_us":620,"raft.run_wall_time_us":22564,"replication_time_us":11133}],["op",{"apply.queue_time_us":185,"apply.run_cpu_time_us":1181,"apply.run_wall_time_us":1741,"num_ops":1,"prepare.queue_time_us":64973,"prepare.run_cpu_time_us":2159,"prepare.run_wall_time_us":2159,"raft.queue_time_us":1047,"raft.run_cpu_time_us":629,"raft.run_wall_time_us":630,"replication_time_us":9388}]]}
I20260928 20:02:48.808148 26912 raft_consensus.cc:740] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.830166 27857 log.cc:1199] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/775b9a076bf048bea39423d3554babf7
I20260928 20:02:48.833021 26912 consensus_queue.cc:260] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.830953 27857 ts_tablet_manager.cc:1996] T 775b9a076bf048bea39423d3554babf7 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:48.850749 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c8183923a3404bd68e48ca401b6f5a52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:48.852480 26912 ts_tablet_manager.cc:1480] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.102s user 0.007s sys 0.000s
I20260928 20:02:48.853946 27835 ts_tablet_manager.cc:1975] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:48.858083 27835 log.cc:1199] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/0216c99dfd8f498595f3f7dbadf8a79b
I20260928 20:02:48.858469 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:02:48.859267 27835 ts_tablet_manager.cc:1996] T 0216c99dfd8f498595f3f7dbadf8a79b P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:02:48.859284 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8183923a3404bd68e48ca401b6f5a52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:48.860101 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.833482 26227 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5b3bc03525cd48b7b3c9e4323c0206dd" } modify_external_catalogs: true
I20260928 20:02:48.868566 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 775b9a076bf048bea39423d3554babf7 (table default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]) successfully deleted
I20260928 20:02:48.869783 26232 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 340) took 3052 ms. Trace:
W20260928 20:02:48.870085 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because the tablet was not found. No further retry: Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
W20260928 20:02:48.876257 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet c4de78b7781d43458cbf2d3e889357fc because the tablet was not found. No further retry: Not found: Tablet not found: c4de78b7781d43458cbf2d3e889357fc
I20260928 20:02:48.880265 26912 tablet_bootstrap.cc:492] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:48.881595 27857 tablet_replica.cc:333] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:48.891501 27857 raft_consensus.cc:2243] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.892143 27857 raft_consensus.cc:2272] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.857475 26230 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 341) took 2962 ms. Trace:
W20260928 20:02:48.896337 26740 consensus_peers.cc:597] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 596a5540716441c49ec8185c8dc6a80c. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:48.898154 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.900166 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.901347 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:48.904892 26594 consensus_peers.cc:597] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:48.907341 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.910162 27835 tablet_replica.cc:333] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:48.911051 27835 raft_consensus.cc:2243] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.911514 27835 raft_consensus.cc:2272] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:48.913659 27835 ts_tablet_manager.cc:1962] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:48.919032 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.920511 26229 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 343) took 2629 ms. Trace:
I20260928 20:02:48.920784 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 0216c99dfd8f498595f3f7dbadf8a79b (table default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]) successfully deleted
I20260928 20:02:48.892829 26230 rpcz_store.cc:276] 0928 20:02:45.894781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.666830 (+2772049us) service_pool.cc:224] Handling call
0928 20:02:48.669071 (+ 2241us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:48.746641 (+ 77570us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:48.776261 (+ 29620us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.776288 (+ 27us) write_op.cc:454] Released schema lock
0928 20:02:48.776483 (+ 195us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:48.857144 (+ 80661us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:48.857419 (+ 275us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.748076 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.749043 (+ 967us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.749076 (+ 33us) write_op.cc:435] Acquired schema lock
0928 20:02:48.749095 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:48.749428 (+ 333us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.749488 (+ 60us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.749528 (+ 40us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:48.749831 (+ 303us) tablet.cc:701] Row locks acquired
0928 20:02:48.749850 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:02:48.750007 (+ 157us) write_op.cc:270] Start()
0928 20:02:48.750151 (+ 144us) write_op.cc:276] Timestamp: P: 1790625768749912 usec, L: 0
0928 20:02:48.750177 (+ 26us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.750850 (+ 673us) log.cc:844] Serialized 433 byte log entry
0928 20:02:48.764089 (+ 13239us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.764407 (+ 318us) write_op.cc:301] APPLY: starting
0928 20:02:48.764461 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.764558 (+ 97us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.764652 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.765055 (+ 403us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.765190 (+ 135us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:48.765233 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:48.765437 (+ 204us) log.cc:844] Serialized 29 byte log entry
0928 20:02:48.765571 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.765635 (+ 64us) write_op.cc:454] Released schema lock
0928 20:02:48.765665 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":188,"apply.run_cpu_time_us":1414,"apply.run_wall_time_us":1417,"num_ops":2,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":3127,"prepare.run_wall_time_us":5851,"raft.queue_time_us":93,"raft.run_cpu_time_us":737,"raft.run_wall_time_us":736,"replication_time_us":13826}]]}
I20260928 20:02:48.904130 27844 raft_consensus.cc:493] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.926007 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_67bf18ee818a4291b2f1c8a0ff80078c" } new_table_name: "default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c" modify_external_catalogs: true
I20260928 20:02:48.926328 27844 raft_consensus.cc:515] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:48.916107 26916 tablet_bootstrap.cc:492] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:48.927433 27862 consensus_queue.cc:1048] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:48.928157 27844 leader_election.cc:290] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:48.919655 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.929651 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.931223 26235 catalog_manager.cc:6934] ReplaceTablet: tablet 78d5de4a82bd41c1a8b2af2ba7417c46 deleted and replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb
W20260928 20:02:48.931402 26450 leader_election.cc:343] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.931674 26235 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 342) took 2992 ms. Trace:
I20260928 20:02:48.932102 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:48.933435 26450 leader_election.cc:343] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.933765 26450 leader_election.cc:304] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:48.948020 27835 ts_tablet_manager.cc:1975] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:48.948447 27835 log.cc:1199] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:48.949263 27835 ts_tablet_manager.cc:1996] T aa4f373a46de433eabd3b35b6ed3d1e3 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:48.949375 27844 raft_consensus.cc:493] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.949836 27844 raft_consensus.cc:515] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:48.951974 27844 leader_election.cc:290] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:48.952385 27844 raft_consensus.cc:2749] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:48.952551 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a86cd5167c43a4beb51cd3138cdef8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:48.954038 26450 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.954478 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a86cd5167c43a4beb51cd3138cdef8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:48.954675 27857 ts_tablet_manager.cc:1962] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:48.955786 26450 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:48.956195 26450 leader_election.cc:304] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:48.957078 27879 raft_consensus.cc:2749] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:48.958077 26234 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 345) took 2234 ms. Trace:
I20260928 20:02:48.958915 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet aa4f373a46de433eabd3b35b6ed3d1e3 (table default.Table_53b73d543aa74f4190223084e9c487af [id=2c0cba9356064ab29bd837a988ab4921]) successfully deleted
I20260928 20:02:48.959928 27835 tablet_replica.cc:333] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:48.958405 26234 rpcz_store.cc:276] 0928 20:02:46.723309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.850410 (+2127101us) service_pool.cc:224] Handling call
0928 20:02:48.859655 (+ 9245us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:48.892638 (+ 32983us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:48.957470 (+ 64832us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:48.957761 (+ 291us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:48.958018 (+ 257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.934357 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.935034 (+ 677us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.935066 (+ 32us) write_op.cc:435] Acquired schema lock
0928 20:02:48.935086 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:48.935428 (+ 342us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.935494 (+ 66us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.935526 (+ 32us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:48.935780 (+ 254us) tablet.cc:701] Row locks acquired
0928 20:02:48.935800 (+ 20us) write_op.cc:260] PREPARE: finished
0928 20:02:48.935926 (+ 126us) write_op.cc:270] Start()
0928 20:02:48.936028 (+ 102us) write_op.cc:276] Timestamp: P: 1790625768935861 usec, L: 0
0928 20:02:48.936052 (+ 24us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.936652 (+ 600us) log.cc:844] Serialized 433 byte log entry
0928 20:02:48.945806 (+ 9154us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.956082 (+ 10276us) write_op.cc:301] APPLY: starting
0928 20:02:48.956139 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.956238 (+ 99us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.956342 (+ 104us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.956717 (+ 375us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.956846 (+ 129us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:48.956886 (+ 40us) write_op.cc:312] APPLY: finished
0928 20:02:48.957050 (+ 164us) log.cc:844] Serialized 29 byte log entry
0928 20:02:48.957191 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.957259 (+ 68us) write_op.cc:454] Released schema lock
0928 20:02:48.957291 (+ 32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":10108,"apply.run_cpu_time_us":1407,"apply.run_wall_time_us":1407,"num_ops":2,"prepare.queue_time_us":40560,"raft.queue_time_us":79,"raft.run_cpu_time_us":680,"raft.run_wall_time_us":688,"replication_time_us":9655}]]}
I20260928 20:02:48.963570 27777 raft_consensus.cc:493] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:48.964052 27777 raft_consensus.cc:515] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:48.963438 27835 raft_consensus.cc:2243] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:48.965236 27835 raft_consensus.cc:2272] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:48.967574 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 57) took 1224 ms (client timeout 1000 ms). Trace:
I20260928 20:02:48.967869 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:48.967916 26233 rpcz_store.cc:269] 0928 20:02:47.743281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.007804 (+264523us) service_pool.cc:224] Handling call
0928 20:02:48.967497 (+959693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43193,"reported_tablets":20}
I20260928 20:02:48.968438 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.966017 27777 leader_election.cc:290] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:48.969714 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23636443834932852f21092be1d1ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:48.969848 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet d8d27cbf353246fbb7fe09f385194d8a
I20260928 20:02:48.970278 26800 raft_consensus.cc:2468] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:48.971364 26594 leader_election.cc:304] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:48.972165 27777 raft_consensus.cc:2804] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:48.972492 27777 raft_consensus.cc:493] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:48.973127 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:48.973161 26227 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 344) took 2305 ms. Trace:
I20260928 20:02:48.973206 27777 raft_consensus.cc:3060] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:48.973321 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:48.974627 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:48.870160 26232 rpcz_store.cc:276] 0928 20:02:45.817813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.637677 (+2819864us) service_pool.cc:224] Handling call
0928 20:02:48.797372 (+159695us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:48.798913 (+ 1541us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:48.869030 (+ 70117us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.869058 (+ 28us) write_op.cc:454] Released schema lock
0928 20:02:48.869230 (+ 172us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:48.869495 (+ 265us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:48.869734 (+ 239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.800393 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.800910 (+ 517us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.800943 (+ 33us) write_op.cc:435] Acquired schema lock
0928 20:02:48.800962 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:48.802925 (+ 1963us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.802982 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.803022 (+ 40us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:48.803290 (+ 268us) tablet.cc:701] Row locks acquired
0928 20:02:48.803327 (+ 37us) write_op.cc:260] PREPARE: finished
0928 20:02:48.803478 (+ 151us) write_op.cc:270] Start()
0928 20:02:48.803585 (+ 107us) write_op.cc:276] Timestamp: P: 1790625768803424 usec, L: 0
0928 20:02:48.803602 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.804182 (+ 580us) log.cc:844] Serialized 433 byte log entry
0928 20:02:48.813924 (+ 9742us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.814267 (+ 343us) write_op.cc:301] APPLY: starting
0928 20:02:48.814329 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.814444 (+ 115us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.814569 (+ 125us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.815028 (+ 459us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.815198 (+ 170us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:48.815257 (+ 59us) write_op.cc:312] APPLY: finished
0928 20:02:48.815467 (+ 210us) log.cc:844] Serialized 29 byte log entry
0928 20:02:48.815628 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.815704 (+ 76us) write_op.cc:454] Released schema lock
0928 20:02:48.815733 (+ 29us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":209,"apply.run_cpu_time_us":1649,"apply.run_wall_time_us":1648,"num_ops":2,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2657,"prepare.run_wall_time_us":7153,"raft.queue_time_us":137,"raft.run_cpu_time_us":708,"raft.run_wall_time_us":705,"replication_time_us":10226}]]}
I20260928 20:02:48.977980 26232 master_service.cc:960] ReplaceTablet: received request to replace tablet 4cd2204d99e14a07af962295b152d60f from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:48.920835 26229 rpcz_store.cc:276] 0928 20:02:46.291208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.694010 (+2402802us) service_pool.cc:224] Handling call
0928 20:02:48.844335 (+150325us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:48.845923 (+ 1588us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:48.919689 (+ 73766us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.919720 (+ 31us) write_op.cc:454] Released schema lock
0928 20:02:48.919924 (+ 204us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:48.920194 (+ 270us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:48.920441 (+ 247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.847682 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.848162 (+ 480us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.848189 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:48.848201 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:48.848506 (+ 305us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.848547 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.848572 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:48.848784 (+ 212us) tablet.cc:701] Row locks acquired
0928 20:02:48.848800 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:48.848915 (+ 115us) write_op.cc:270] Start()
0928 20:02:48.849001 (+ 86us) write_op.cc:276] Timestamp: P: 1790625768848859 usec, L: 0
0928 20:02:48.849019 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.849528 (+ 509us) log.cc:844] Serialized 433 byte log entry
0928 20:02:48.874913 (+ 25385us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.875264 (+ 351us) write_op.cc:301] APPLY: starting
0928 20:02:48.875441 (+ 177us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.875562 (+ 121us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.875656 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.876066 (+ 410us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.876219 (+ 153us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:48.876263 (+ 44us) write_op.cc:312] APPLY: finished
0928 20:02:48.876429 (+ 166us) log.cc:844] Serialized 29 byte log entry
0928 20:02:48.876584 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.876649 (+ 65us) write_op.cc:454] Released schema lock
0928 20:02:48.876679 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":1612,"apply.run_wall_time_us":1612,"num_ops":2,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":2174,"prepare.run_wall_time_us":4714,"raft.queue_time_us":81,"raft.run_cpu_time_us":640,"raft.run_wall_time_us":639,"replication_time_us":25715}]]}
I20260928 20:02:48.986275 27835 ts_tablet_manager.cc:1962] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:48.987002 26916 tablet_bootstrap.cc:654] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:48.991197 26913 tablet_bootstrap.cc:492] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:48.991642 26913 ts_tablet_manager.cc:1449] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.428s user 0.006s sys 0.004s
I20260928 20:02:48.998309 26913 raft_consensus.cc:359] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.002211 26913 raft_consensus.cc:385] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.003204 26913 raft_consensus.cc:740] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:48.932080 26235 rpcz_store.cc:276] 0928 20:02:45.939541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.680628 (+2741087us) service_pool.cc:224] Handling call
0928 20:02:48.857794 (+177166us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.857824 (+ 30us) write_op.cc:454] Released schema lock
0928 20:02:48.931614 (+ 73790us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.824697 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.825150 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.825174 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:48.825187 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:48.825564 (+ 377us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.825606 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.825640 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:48.825867 (+ 227us) tablet.cc:701] Row locks acquired
0928 20:02:48.825889 (+ 22us) write_op.cc:260] PREPARE: finished
0928 20:02:48.826031 (+ 142us) write_op.cc:270] Start()
0928 20:02:48.826164 (+ 133us) write_op.cc:276] Timestamp: P: 1790625768825971 usec, L: 0
0928 20:02:48.826184 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.826852 (+ 668us) log.cc:844] Serialized 631 byte log entry
0928 20:02:48.835833 (+ 8981us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.836128 (+ 295us) write_op.cc:301] APPLY: starting
0928 20:02:48.836194 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.836327 (+ 133us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.836422 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.836797 (+ 375us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.837001 (+ 204us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:48.837048 (+ 47us) write_op.cc:312] APPLY: finished
0928 20:02:48.837224 (+ 176us) log.cc:844] Serialized 29 byte log entry
0928 20:02:48.837477 (+ 253us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.837549 (+ 72us) write_op.cc:454] Released schema lock
0928 20:02:48.837583 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":158,"apply.run_cpu_time_us":1632,"apply.run_wall_time_us":1630,"num_ops":2,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":2436,"prepare.run_wall_time_us":5159,"raft.queue_time_us":81,"raft.run_cpu_time_us":680,"raft.run_wall_time_us":681,"replication_time_us":9551}]]}
I20260928 20:02:49.009588 27862 raft_consensus.cc:493] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.010057 26562 heartbeater.cc:344] Connected to a master server at 127.25.129.253:32923
I20260928 20:02:49.010067 27862 raft_consensus.cc:515] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.012090 27862 leader_election.cc:290] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:49.014370 26740 leader_election.cc:343] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:49.015586 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3e3854f997f64d7d910310d5a64f929d" } modify_external_catalogs: true
I20260928 20:02:49.016390 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86e8a782b3e46d09a45bbb7025546af" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.010589 26595 leader_election.cc:343] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
W20260928 20:02:49.018182 26739 leader_election.cc:343] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.018548 26739 leader_election.cc:304] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:49.019286 27862 raft_consensus.cc:2749] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.016660 26913 consensus_queue.cc:260] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.028748 27862 raft_consensus.cc:493] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.029258 27862 raft_consensus.cc:515] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.032234 27862 leader_election.cc:290] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.032939 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:49.033483 26511 raft_consensus.cc:2468] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:49.034489 26740 leader_election.cc:304] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:48.973436 26227 rpcz_store.cc:276] 0928 20:02:46.667410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.726546 (+2059136us) service_pool.cc:224] Handling call
0928 20:02:48.860807 (+134261us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:48.862276 (+ 1469us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:48.862408 (+ 132us) catalog_manager.cc:2863] Locking tablets
0928 20:02:48.863476 (+ 1068us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:48.969232 (+105756us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.969260 (+ 28us) write_op.cc:454] Released schema lock
0928 20:02:48.969500 (+ 240us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:48.969683 (+ 183us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:48.969769 (+ 86us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:48.973101 (+ 3332us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:48.865397 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:48.865876 (+ 479us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:48.865906 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:02:48.865923 (+ 17us) tablet.cc:662] Decoding operations
0928 20:02:48.866384 (+ 461us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:48.866431 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:48.866481 (+ 50us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:48.866885 (+ 404us) tablet.cc:701] Row locks acquired
0928 20:02:48.866906 (+ 21us) write_op.cc:260] PREPARE: finished
0928 20:02:48.867038 (+ 132us) write_op.cc:270] Start()
0928 20:02:48.867142 (+ 104us) write_op.cc:276] Timestamp: P: 1790625768866977 usec, L: 0
0928 20:02:48.867166 (+ 24us) op_driver.cc:348] REPLICATION: starting
0928 20:02:48.867706 (+ 540us) log.cc:844] Serialized 734 byte log entry
0928 20:02:48.883579 (+ 15873us) op_driver.cc:464] REPLICATION: finished
0928 20:02:48.890856 (+ 7277us) write_op.cc:301] APPLY: starting
0928 20:02:48.890906 (+ 50us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:48.891008 (+ 102us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:48.891105 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:48.891403 (+ 298us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:48.891546 (+ 143us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:48.891589 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:48.891758 (+ 169us) log.cc:844] Serialized 29 byte log entry
0928 20:02:48.891889 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:48.891951 (+ 62us) write_op.cc:454] Released schema lock
0928 20:02:48.891986 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7128,"apply.run_cpu_time_us":1302,"apply.run_wall_time_us":1302,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":2509,"prepare.run_wall_time_us":3504,"replication_time_us":16317}]]}
I20260928 20:02:49.036934 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:49.038357 27862 raft_consensus.cc:2804] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:49.038508 27759 raft_consensus.cc:493] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.038724 27862 raft_consensus.cc:493] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:49.039050 27862 raft_consensus.cc:3060] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.038976 27759 raft_consensus.cc:515] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.040918 27759 leader_election.cc:290] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:49.041157 26739 leader_election.cc:343] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.038798 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a443f94d7c7c4e60b56e3c9fdebecac4" } new_table_name: "default.Table_a47e5f225c19417296342e60482d31d1" modify_external_catalogs: true
W20260928 20:02:49.046463 26595 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
W20260928 20:02:49.046926 26594 leader_election.cc:343] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:49.047683 26594 leader_election.cc:304] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.048790 27676 raft_consensus.cc:2749] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.050262 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3e3854f997f64d7d910310d5a64f929d" } modify_external_catalogs: true
I20260928 20:02:49.055328 26913 ts_tablet_manager.cc:1480] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.063s user 0.005s sys 0.000s
I20260928 20:02:49.057358 27857 ts_tablet_manager.cc:1975] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:49.063773 27759 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.064216 27759 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.069370 27759 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:49.077663 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ed3cd78c90c42f6a99a92bae2cd5491 consensus state has no leader
I20260928 20:02:49.078238 26230 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 346) took 2106 ms. Trace:
I20260928 20:02:49.078665 26913 tablet_bootstrap.cc:492] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:49.078588 26230 rpcz_store.cc:276] 0928 20:02:46.971414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.925707 (+1954293us) service_pool.cc:224] Handling call
0928 20:02:48.926596 (+ 889us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:49.008208 (+ 81612us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:49.047580 (+ 39372us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:49.047859 (+ 279us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:49.076784 (+ 28925us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:49.076844 (+ 60us) write_op.cc:454] Released schema lock
0928 20:02:49.077048 (+ 204us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:49.078183 (+ 1135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:49.049280 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:49.049790 (+ 510us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:49.049825 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:02:49.049840 (+ 15us) tablet.cc:662] Decoding operations
0928 20:02:49.050183 (+ 343us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:49.050231 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:49.050258 (+ 27us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:49.050427 (+ 169us) tablet.cc:701] Row locks acquired
0928 20:02:49.050442 (+ 15us) write_op.cc:260] PREPARE: finished
0928 20:02:49.050560 (+ 118us) write_op.cc:270] Start()
0928 20:02:49.050653 (+ 93us) write_op.cc:276] Timestamp: P: 1790625769050488 usec, L: 0
0928 20:02:49.050671 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:49.051196 (+ 525us) log.cc:844] Serialized 405 byte log entry
0928 20:02:49.060027 (+ 8831us) op_driver.cc:464] REPLICATION: finished
0928 20:02:49.060924 (+ 897us) write_op.cc:301] APPLY: starting
0928 20:02:49.060985 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:49.061084 (+ 99us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:49.061215 (+ 131us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:49.061432 (+ 217us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:49.061595 (+ 163us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:49.061663 (+ 68us) write_op.cc:312] APPLY: finished
0928 20:02:49.061873 (+ 210us) log.cc:844] Serialized 23 byte log entry
0928 20:02:49.062058 (+ 185us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:49.062183 (+ 125us) write_op.cc:454] Released schema lock
0928 20:02:49.062224 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":746,"apply.run_cpu_time_us":1505,"apply.run_wall_time_us":1505,"num_ops":1,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2243,"prepare.run_wall_time_us":21875,"raft.queue_time_us":86,"raft.run_cpu_time_us":660,"raft.run_wall_time_us":1441,"replication_time_us":9238}]]}
I20260928 20:02:49.070676 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:48.890000 26912 tablet_bootstrap.cc:654] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.082607 26511 raft_consensus.cc:2393] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:49.083405 27857 log.cc:1199] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/1edf314241784091a603907a43429b28
I20260928 20:02:49.015779 27777 raft_consensus.cc:515] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.056499 27898 tablet.cc:1751] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:49.090322 27857 ts_tablet_manager.cc:1996] T 1edf314241784091a603907a43429b28 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:49.090335 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23636443834932852f21092be1d1ac" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:49.090914 26800 raft_consensus.cc:3060] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.092614 26916 tablet_bootstrap.cc:492] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:49.093454 26916 ts_tablet_manager.cc:1449] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.178s user 0.008s sys 0.001s
I20260928 20:02:49.097383 26800 raft_consensus.cc:2468] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:49.099273 27777 leader_election.cc:290] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:49.099576 26594 leader_election.cc:304] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:49.100798 27759 raft_consensus.cc:2804] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:49.101526 27759 raft_consensus.cc:697] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:49.102501 27759 consensus_queue.cc:237] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.100848 27854 ts_tablet_manager.cc:1975] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.104382 27854 log.cc:1199] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:49.105221 27854 ts_tablet_manager.cc:1996] T aa4f373a46de433eabd3b35b6ed3d1e3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.087469 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:49.108709 26594 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.053728 27862 raft_consensus.cc:515] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.113025 26912 tablet_bootstrap.cc:492] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:49.115418 26912 ts_tablet_manager.cc:1449] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.240s user 0.007s sys 0.003s
I20260928 20:02:49.116295 27777 raft_consensus.cc:3060] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.124011 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:49.124612 26513 raft_consensus.cc:3060] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.122567 27862 leader_election.cc:290] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.118134 26912 raft_consensus.cc:359] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.129989 26912 raft_consensus.cc:385] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.130373 26912 raft_consensus.cc:740] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.132781 27857 tablet_replica.cc:333] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:49.132696 26513 raft_consensus.cc:2468] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:49.133683 27857 raft_consensus.cc:2243] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:49.133157 26912 consensus_queue.cc:260] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.135773 26912 ts_tablet_manager.cc:1480] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260928 20:02:49.136688 26912 tablet_bootstrap.cc:492] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:49.137027 26740 leader_election.cc:304] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:49.139820 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:49.141179 26739 leader_election.cc:343] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.142272 27862 raft_consensus.cc:2804] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:49.142741 27862 raft_consensus.cc:697] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
W20260928 20:02:49.143571 26595 leader_election.cc:343] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
I20260928 20:02:49.143493 27862 consensus_queue.cc:237] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.145035 27857 raft_consensus.cc:2272] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.147241 27857 ts_tablet_manager.cc:1962] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.148115 27907 raft_consensus.cc:493] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.148530 27907 raft_consensus.cc:515] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.152024 27907 leader_election.cc:290] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.152484 26913 tablet_bootstrap.cc:654] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:49.153409 26740 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:49.156955 26912 tablet_bootstrap.cc:654] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.161300 27835 ts_tablet_manager.cc:1975] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.161726 27835 log.cc:1199] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:49.164256 27854 tablet_replica.cc:333] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.094035 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 1edf314241784091a603907a43429b28 (table default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 [id=b39c31256b914e41bdb078ad90d6506b]) successfully deleted
I20260928 20:02:49.165200 27854 raft_consensus.cc:2243] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:49.165205 26223 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 71186us
I20260928 20:02:49.165679 27854 raft_consensus.cc:2272] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:49.136279 26221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 55958.6us
I20260928 20:02:49.161036 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet aa4f373a46de433eabd3b35b6ed3d1e3 (table default.Table_53b73d543aa74f4190223084e9c487af [id=2c0cba9356064ab29bd837a988ab4921]) successfully deleted
W20260928 20:02:49.166309 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet c6544b7b405c4831900f37e052892409 because the tablet was not found. No further retry: Not found: Tablet not found: c6544b7b405c4831900f37e052892409
I20260928 20:02:49.165784 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655fc043b9468ea51ce5ae983e8f06" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.167001 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 5d4ea23c18e04819b28d3428d584f3ac because the tablet was not found. No further retry: Not found: Tablet not found: 5d4ea23c18e04819b28d3428d584f3ac
W20260928 20:02:49.167483 26739 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:49.167659 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 0216c99dfd8f498595f3f7dbadf8a79b because the tablet was not found. No further retry: Not found: Tablet not found: 0216c99dfd8f498595f3f7dbadf8a79b
I20260928 20:02:49.167831 26739 leader_election.cc:304] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:49.168223 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 0e0a362efb68408d8dce96dce0130035 because the tablet was not found. No further retry: Not found: Tablet not found: 0e0a362efb68408d8dce96dce0130035
W20260928 20:02:49.168756 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 596a5540716441c49ec8185c8dc6a80c because the tablet was not found. No further retry: Not found: Tablet not found: 596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:49.169096 27907 raft_consensus.cc:2749] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:49.169307 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4c23636443834932852f21092be1d1ac because the tablet was not found. No further retry: Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
I20260928 20:02:49.169356 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f712a5a9fc0941c98d6a49bbecc89b54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:49.169973 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet b0655fc043b9468ea51ce5ae983e8f06 because the tablet was not found. No further retry: Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
W20260928 20:02:49.170854 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f712a5a9fc0941c98d6a49bbecc89b54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:49.171538 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet ee4c267b42754dbca8eb5ebec2d66a23 because the tablet was not found. No further retry: Not found: Tablet not found: ee4c267b42754dbca8eb5ebec2d66a23
W20260928 20:02:49.172382 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4d0308d824cf401c8cca0cf7a950fd53 because the tablet was not found. No further retry: Not found: Tablet not found: 4d0308d824cf401c8cca0cf7a950fd53
W20260928 20:02:49.173026 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4c23636443834932852f21092be1d1ac because the tablet was not found. No further retry: Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
I20260928 20:02:49.163826 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_39b8a2a0083445798ec0e58e3b2db431"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:49.145042 26916 raft_consensus.cc:359] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.178822 26916 raft_consensus.cc:385] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.179107 26916 raft_consensus.cc:740] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:02:49.179445 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39b8a2a0083445798ec0e58e3b2db431 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:49.179817 26916 consensus_queue.cc:260] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.189528 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_71dac26ca689411e89880e236cf117b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:49.189961 27844 raft_consensus.cc:493] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.190248 27835 ts_tablet_manager.cc:1996] T 018497a652234fbdb04cf6c034bcc5d3 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:49.190368 27844 raft_consensus.cc:515] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:49.191013 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71dac26ca689411e89880e236cf117b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:49.192179 27844 leader_election.cc:290] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.192977 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 018497a652234fbdb04cf6c034bcc5d3 (table default.Table_438a2bd078e04a3e87064ca81d283559 [id=e27528ba702740e7a7aaae54dc8503fb]) successfully deleted
I20260928 20:02:49.194278 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.195914 26450 leader_election.cc:343] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.196659 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7199ac53613b456991c7551d779d0e75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:49.196931 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:49.197227 27777 raft_consensus.cc:2749] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.184015 27854 ts_tablet_manager.cc:1962] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:49.198139 26450 leader_election.cc:343] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:49.198315 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7199ac53613b456991c7551d779d0e75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:49.198486 26450 leader_election.cc:304] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.199090 27844 raft_consensus.cc:2749] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.226238 27862 consensus_queue.cc:1048] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:49.228472 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because the tablet was not found. No further retry: Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:49.229362 27835 tablet_replica.cc:333] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:49.230157 27835 raft_consensus.cc:2243] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:49.239373 26913 tablet_bootstrap.cc:492] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:49.239755 26913 ts_tablet_manager.cc:1449] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.164s user 0.000s sys 0.022s
I20260928 20:02:49.246307 26916 ts_tablet_manager.cc:1480] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.153s user 0.007s sys 0.003s
I20260928 20:02:49.231091 27835 raft_consensus.cc:2272] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.252367 27835 ts_tablet_manager.cc:1962] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.263851 26912 tablet_bootstrap.cc:492] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:49.264253 26912 ts_tablet_manager.cc:1449] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.128s user 0.008s sys 0.014s
I20260928 20:02:49.252457 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:49.281435 26916 tablet_bootstrap.cc:492] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:49.283504 27862 consensus_queue.cc:1048] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:49.298930 26913 raft_consensus.cc:359] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.299597 26913 raft_consensus.cc:385] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.299853 26913 raft_consensus.cc:740] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.300442 26913 consensus_queue.cc:260] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.305284 26913 ts_tablet_manager.cc:1480] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.065s user 0.002s sys 0.005s
I20260928 20:02:49.308768 26913 tablet_bootstrap.cc:492] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:49.319780 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d13562e920244194969520df564a949d consensus state has no leader
I20260928 20:02:49.320240 26233 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 348) took 1411 ms. Trace:
I20260928 20:02:49.320510 26233 rpcz_store.cc:276] 0928 20:02:47.908734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.968686 (+1059952us) service_pool.cc:224] Handling call
0928 20:02:49.037786 (+ 69100us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0abc96 00007ff79cc5b634 00007ff79cc5b5c2 00007ff79cc5b4f1 00007ff79cc5b46c 00007ff79cc5a722 00007ff79aefc15c 00007ff79aefb596
0928 20:02:49.051534 (+ 13748us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:49.052155 (+ 621us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:49.052685 (+ 530us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:49.052873 (+ 188us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:49.319307 (+266434us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:49.320192 (+ 885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:49.071284 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:49.071759 (+ 475us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:49.071789 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:02:49.071804 (+ 15us) tablet.cc:662] Decoding operations
0928 20:02:49.072297 (+ 493us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:49.072356 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:49.072395 (+ 39us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:49.072581 (+ 186us) tablet.cc:701] Row locks acquired
0928 20:02:49.072604 (+ 23us) write_op.cc:260] PREPARE: finished
0928 20:02:49.072743 (+ 139us) write_op.cc:270] Start()
0928 20:02:49.072839 (+ 96us) write_op.cc:276] Timestamp: P: 1790625769072671 usec, L: 0
0928 20:02:49.072860 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:49.073419 (+ 559us) log.cc:844] Serialized 405 byte log entry
0928 20:02:49.315177 (+241758us) op_driver.cc:464] REPLICATION: finished
0928 20:02:49.316539 (+ 1362us) write_op.cc:301] APPLY: starting
0928 20:02:49.316590 (+ 51us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:49.316687 (+ 97us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:49.316781 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:49.316950 (+ 169us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:49.317081 (+ 131us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:49.317126 (+ 45us) write_op.cc:312] APPLY: finished
0928 20:02:49.317282 (+ 156us) log.cc:844] Serialized 23 byte log entry
0928 20:02:49.317432 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:49.317487 (+ 55us) write_op.cc:454] Released schema lock
0928 20:02:49.317514 (+ 27us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:49.317761 (+ 247us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:49.317784 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":145358208,"child_traces":[["op",{"apply.queue_time_us":1228,"apply.run_cpu_time_us":1190,"apply.run_wall_time_us":1189,"num_ops":1,"prepare.queue_time_us":17409,"prepare.run_cpu_time_us":2285,"prepare.run_wall_time_us":22811,"raft.queue_time_us":73,"raft.run_cpu_time_us":678,"raft.run_wall_time_us":1074,"replication_time_us":242234}]]}
I20260928 20:02:49.329778 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 7e78ac2ae0124b7b859a79bd9f1c203a (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:49.330160 26913 tablet_bootstrap.cc:654] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.332512 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 7e78ac2ae0124b7b859a79bd9f1c203a (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:49.335325 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e78ac2ae0124b7b859a79bd9f1c203a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:49.336516 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 7e78ac2ae0124b7b859a79bd9f1c203a (DEFAULT_TABLE table=default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:49.337431 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e78ac2ae0124b7b859a79bd9f1c203a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:49.340582 27862 raft_consensus.cc:493] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.340857 27844 raft_consensus.cc:493] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.341027 27862 raft_consensus.cc:515] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.341303 27844 raft_consensus.cc:515] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.343111 27844 leader_election.cc:290] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.343899 27862 leader_election.cc:290] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.345160 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:49.346288 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0a362efb68408d8dce96dce0130035" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.348253 26739 leader_election.cc:343] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:49.348917 26450 leader_election.cc:343] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.349251 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 01e47444ae914b07a7e3e64711423635 (DEFAULT_TABLE table=default.Table_c337753d93e448c28340ef32cc51734d [id=f017a4846b1a4583ba89acf078c09200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:49.350000 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:49.351889 26740 leader_election.cc:343] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0e0a362efb68408d8dce96dce0130035
I20260928 20:02:49.352249 26740 leader_election.cc:304] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:49.353868 26450 leader_election.cc:343] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.354257 26450 leader_election.cc:304] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.355273 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e47444ae914b07a7e3e64711423635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:49.355274 27879 raft_consensus.cc:2749] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.355505 27862 raft_consensus.cc:2749] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.363848 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 01e47444ae914b07a7e3e64711423635 (DEFAULT_TABLE table=default.Table_c337753d93e448c28340ef32cc51734d [id=f017a4846b1a4583ba89acf078c09200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:49.365491 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e47444ae914b07a7e3e64711423635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:49.378309 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 01e47444ae914b07a7e3e64711423635 (DEFAULT_TABLE table=default.Table_c337753d93e448c28340ef32cc51734d [id=f017a4846b1a4583ba89acf078c09200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:49.396497 27844 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.396744 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_1b28541b1dad44e393063e5c45c35050" } new_table_name: "default.Table_12db5cb4890d4a1aa01c4c814765353b" modify_external_catalogs: true
W20260928 20:02:49.396901 26595 consensus_peers.cc:597] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:49.396971 27844 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.398849 27844 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.400475 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7a934c9d12fa42cd818bc13a48bfd4ea" } modify_external_catalogs: true
I20260928 20:02:49.401005 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7a934c9d12fa42cd818bc13a48bfd4ea" } modify_external_catalogs: true
I20260928 20:02:49.405227 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:49.390396 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:49.407699 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:49.409054 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e47444ae914b07a7e3e64711423635. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:49.409416 26450 leader_election.cc:343] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:49.409977 26450 leader_election.cc:343] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.410334 26450 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.414263 27844 raft_consensus.cc:2749] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.415100 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e78ac2ae0124b7b859a79bd9f1c203a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:49.435487 26912 raft_consensus.cc:359] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.436565 26912 raft_consensus.cc:385] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.442628 27777 raft_consensus.cc:493] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.443208 27777 raft_consensus.cc:515] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.446043 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0308d824cf401c8cca0cf7a950fd53" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:49.446656 26804 raft_consensus.cc:2468] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:49.447775 26594 leader_election.cc:304] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:49.448495 27915 raft_consensus.cc:2804] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:49.448796 27915 raft_consensus.cc:493] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:49.449076 27915 raft_consensus.cc:3060] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.436946 26912 raft_consensus.cc:740] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.459265 26912 consensus_queue.cc:260] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.461671 26912 ts_tablet_manager.cc:1480] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.197s user 0.006s sys 0.001s
I20260928 20:02:49.441242 26228 catalog_manager.cc:5838] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:49.465718 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:49.466933 27777 leader_election.cc:290] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:49.468185 26913 tablet_bootstrap.cc:492] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:49.468577 26913 ts_tablet_manager.cc:1449] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.160s user 0.042s sys 0.043s
I20260928 20:02:49.468641 27854 ts_tablet_manager.cc:1975] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:49.469098 27854 log.cc:1199] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:49.470813 27854 ts_tablet_manager.cc:1996] T e70df4ddf0f9430980c967d798ed6c50 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.473858 27854 tablet_replica.cc:333] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.474769 27854 raft_consensus.cc:2243] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:49.475721 27854 raft_consensus.cc:2272] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.476334 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet e70df4ddf0f9430980c967d798ed6c50 (table default.Table_060bc0393e4d45c2a1ef08a71894f56d [id=14b35dc03a724a6d9062137acac612cc]) successfully deleted
W20260928 20:02:49.477031 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 5d4ea23c18e04819b28d3428d584f3ac because the tablet was not found. No further retry: Not found: Tablet not found: 5d4ea23c18e04819b28d3428d584f3ac
I20260928 20:02:49.477859 27854 ts_tablet_manager.cc:1962] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.478502 26913 raft_consensus.cc:359] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.479132 26913 raft_consensus.cc:385] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.479380 26913 raft_consensus.cc:740] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.480818 27915 raft_consensus.cc:515] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.484836 26913 consensus_queue.cc:260] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.491928 26913 ts_tablet_manager.cc:1480] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260928 20:02:49.493280 26913 tablet_bootstrap.cc:492] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:49.494333 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d0308d824cf401c8cca0cf7a950fd53" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:49.494949 26804 raft_consensus.cc:3060] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.495414 27854 ts_tablet_manager.cc:1975] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.495739 27854 log.cc:1199] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:49.496773 27854 ts_tablet_manager.cc:1996] T 8163815661694d70ba4c2e36a424eaa1 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.497764 26912 tablet_bootstrap.cc:492] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:02:49.506212 26594 consensus_peers.cc:597] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:49.510491 26913 tablet_bootstrap.cc:654] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.501853 26804 raft_consensus.cc:2468] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:49.513320 26594 leader_election.cc:304] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:49.514460 27777 raft_consensus.cc:2804] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:49.515143 26912 tablet_bootstrap.cc:654] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.516156 27777 raft_consensus.cc:697] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:49.517560 27777 consensus_queue.cc:237] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.519598 27835 ts_tablet_manager.cc:1975] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.523643 27835 log.cc:1199] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:49.523913 27915 leader_election.cc:290] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:49.524523 27835 ts_tablet_manager.cc:1996] T 93fb4e1fd0584a42a4de9eab14d5578c P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:49.527108 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 93fb4e1fd0584a42a4de9eab14d5578c (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]) successfully deleted
I20260928 20:02:49.530776 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8b0494f6646c4da3a2555b1b10dfe6d9" } new_table_name: "default.Table_3d54d1555a914679a1a011feaa634329" modify_external_catalogs: true
I20260928 20:02:49.531049 27854 tablet_replica.cc:333] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.532764 27854 raft_consensus.cc:2243] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:49.533771 27854 pending_rounds.cc:70] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:49.534236 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 8163815661694d70ba4c2e36a424eaa1 (table default.Table_8fbaf845832a4eb58670a1c3a9953c39 [id=207395568b4a48319dd1213d82969180]) successfully deleted
W20260928 20:02:49.534956 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 946f215581734bf591ab05502e5ff4a0 because the tablet was not found. No further retry: Not found: Tablet not found: 946f215581734bf591ab05502e5ff4a0
I20260928 20:02:49.535375 27854 pending_rounds.cc:77] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403146908614656 op_type: NO_OP noop_request { }
W20260928 20:02:49.536177 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because the tablet was not found. No further retry: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:49.536602 27854 raft_consensus.cc:2889] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:49.537034 27854 raft_consensus.cc:2272] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.537420 27835 tablet_replica.cc:333] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:49.538239 27835 raft_consensus.cc:2243] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:49.538743 27835 raft_consensus.cc:2272] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.539290 27854 ts_tablet_manager.cc:1962] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.540997 27835 ts_tablet_manager.cc:1962] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.550014 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c6c5485157f74500b90a91d0746c56c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:49.551510 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6c5485157f74500b90a91d0746c56c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:49.543308 26912 tablet_bootstrap.cc:492] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:49.554531 26912 ts_tablet_manager.cc:1449] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.000s
W20260928 20:02:49.555969 26594 consensus_peers.cc:597] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:49.556942 26912 raft_consensus.cc:359] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.557547 26912 raft_consensus.cc:385] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.557796 26912 raft_consensus.cc:740] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.558792 26912 consensus_queue.cc:260] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.559669 26913 tablet_bootstrap.cc:492] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:49.560067 26913 ts_tablet_manager.cc:1449] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.067s user 0.011s sys 0.005s
I20260928 20:02:49.560739 26912 ts_tablet_manager.cc:1480] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:02:49.562805 26913 raft_consensus.cc:359] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.563413 26913 raft_consensus.cc:385] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.563666 26913 raft_consensus.cc:740] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.564335 26913 consensus_queue.cc:260] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.566257 26913 ts_tablet_manager.cc:1480] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260928 20:02:49.573616 26913 tablet_bootstrap.cc:492] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:49.582517 27854 ts_tablet_manager.cc:1975] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.585755 27854 log.cc:1199] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:49.587356 26916 tablet_bootstrap.cc:700] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent opening tablet: real 0.160s user 0.001s sys 0.001s
I20260928 20:02:49.586851 26912 tablet_bootstrap.cc:492] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:49.588161 27854 ts_tablet_manager.cc:1996] T 2728c9979bb647a5a8f0a902c299e53d P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.590072 26916 tablet_bootstrap.cc:654] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.590565 26913 tablet_bootstrap.cc:654] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.596071 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 2728c9979bb647a5a8f0a902c299e53d (table default.Table_60b73bf93b434a499c613715e7cd6464 [id=42c910625bf147a08dd2e86593dee01a]) successfully deleted
I20260928 20:02:49.596232 27854 tablet_replica.cc:333] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.597123 27854 raft_consensus.cc:2243] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:49.606012 27854 raft_consensus.cc:2272] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.608704 27854 ts_tablet_manager.cc:1962] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.611465 26913 tablet_bootstrap.cc:492] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:49.613903 26913 ts_tablet_manager.cc:1449] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.003s
I20260928 20:02:49.617563 26912 tablet_bootstrap.cc:654] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.619544 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4cd2204d99e14a07af962295b152d60f
I20260928 20:02:49.622200 27888 tablet.cc:1751] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:49.624331 26232 catalog_manager.cc:6934] ReplaceTablet: tablet 4cd2204d99e14a07af962295b152d60f deleted and replaced by tablet e8de132c03884597a311898f4d427bb1
I20260928 20:02:49.616956 26913 raft_consensus.cc:359] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.625313 26913 raft_consensus.cc:385] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.625366 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c0cba0a8dbf4476e8c5b101a855ea68b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:49.628139 26913 raft_consensus.cc:740] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.628865 26913 consensus_queue.cc:260] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.632292 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd2204d99e14a07af962295b152d60f with delete_type TABLET_DATA_DELETED (replaced by tablet e8de132c03884597a311898f4d427bb1) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:49.633693 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd2204d99e14a07af962295b152d60f with delete_type TABLET_DATA_DELETED (replaced by tablet e8de132c03884597a311898f4d427bb1) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:49.637482 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0cba0a8dbf4476e8c5b101a855ea68b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:49.637862 27835 ts_tablet_manager.cc:1975] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:49.638324 27835 log.cc:1199] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4c23636443834932852f21092be1d1ac
I20260928 20:02:49.638931 27835 ts_tablet_manager.cc:1996] T 4c23636443834932852f21092be1d1ac P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:49.638429 27898 tablet.cc:1751] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:49.639123 26913 ts_tablet_manager.cc:1480] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.025s user 0.004s sys 0.001s
I20260928 20:02:49.644670 26912 tablet_bootstrap.cc:492] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:49.645105 26912 ts_tablet_manager.cc:1449] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.001s
I20260928 20:02:49.647764 26912 raft_consensus.cc:359] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.648340 26912 raft_consensus.cc:385] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.648582 26912 raft_consensus.cc:740] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.649724 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 4c23636443834932852f21092be1d1ac (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]) successfully deleted
I20260928 20:02:49.650887 26913 tablet_bootstrap.cc:492] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:49.654673 27835 tablet_replica.cc:333] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:49.655730 27835 raft_consensus.cc:2243] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:49.656808 26912 consensus_queue.cc:260] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.662673 27907 raft_consensus.cc:493] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.663175 27907 raft_consensus.cc:515] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.664908 26913 tablet_bootstrap.cc:654] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.665134 27907 leader_election.cc:290] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:49.673532 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd2204d99e14a07af962295b152d60f with delete_type TABLET_DATA_DELETED (replaced by tablet e8de132c03884597a311898f4d427bb1) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:49.676254 26740 leader_election.cc:343] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1edf314241784091a603907a43429b28
I20260928 20:02:49.684814 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edf314241784091a603907a43429b28" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.686331 26739 leader_election.cc:343] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.686707 26739 leader_election.cc:304] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:49.687665 27907 raft_consensus.cc:2749] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.689868 27835 raft_consensus.cc:2272] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.693879 27835 ts_tablet_manager.cc:1962] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:49.703258 26595 leader_election.cc:343] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:49.691134 26912 ts_tablet_manager.cc:1480] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.046s user 0.006s sys 0.001s
I20260928 20:02:49.711283 26912 tablet_bootstrap.cc:492] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:49.727299 26912 tablet_bootstrap.cc:654] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:49.744427 26595 leader_election.cc:343] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:49.754268 26912 tablet_bootstrap.cc:492] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:49.754755 26912 ts_tablet_manager.cc:1449] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.000s
I20260928 20:02:49.757565 26912 raft_consensus.cc:359] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.758867 26912 raft_consensus.cc:385] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.759168 26912 raft_consensus.cc:740] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.761595 27854 ts_tablet_manager.cc:1975] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.766723 27854 log.cc:1199] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:49.767550 27854 ts_tablet_manager.cc:1996] T 93fb4e1fd0584a42a4de9eab14d5578c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.772807 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 93fb4e1fd0584a42a4de9eab14d5578c (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]) successfully deleted
I20260928 20:02:49.774778 27854 tablet_replica.cc:333] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.775624 27854 raft_consensus.cc:2243] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:49.776559 27854 raft_consensus.cc:2272] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:49.782680 26862 log.cc:927] Time spent T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Append to log took a long time: real 0.165s user 0.033s sys 0.013s
I20260928 20:02:49.784513 27854 ts_tablet_manager.cc:1962] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.780761 27907 raft_consensus.cc:493] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.787755 27907 raft_consensus.cc:515] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.788803 26913 tablet_bootstrap.cc:492] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:49.789279 26913 ts_tablet_manager.cc:1449] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.149s user 0.011s sys 0.005s
I20260928 20:02:49.789693 27907 leader_election.cc:290] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.791030 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6544b7b405c4831900f37e052892409" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.791152 26740 leader_election.cc:343] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: c6544b7b405c4831900f37e052892409
I20260928 20:02:49.791076 26912 consensus_queue.cc:260] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:49.791625 26651 raft_consensus.cc:2468] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:49.792608 27835 ts_tablet_manager.cc:1975] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.794812 26913 raft_consensus.cc:359] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.793125 26739 leader_election.cc:304] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:49.795989 27907 raft_consensus.cc:2804] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:49.796307 27907 raft_consensus.cc:493] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:49.796384 26913 raft_consensus.cc:385] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.796622 27907 raft_consensus.cc:3060] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.796736 26913 raft_consensus.cc:740] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.803426 27835 log.cc:1199] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:49.803243 26913 consensus_queue.cc:260] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.805852 26913 ts_tablet_manager.cc:1480] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
W20260928 20:02:49.806663 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 29dd1355039e4bca952f13a9d174813e consensus state has no leader
I20260928 20:02:49.809504 27835 ts_tablet_manager.cc:1996] T 596a5540716441c49ec8185c8dc6a80c P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:49.811393 26913 tablet_bootstrap.cc:492] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:49.811381 27835 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 321) took 1090 ms. Trace:
I20260928 20:02:49.815028 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 1dde3191a52b4254944ae1f8556e1632
I20260928 20:02:49.815215 27835 rpcz_store.cc:276] 0928 20:02:48.720623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.720712 (+ 89us) service_pool.cc:224] Handling call
0928 20:02:49.654460 (+933748us) ts_tablet_manager.cc:1197] Deleting tablet 596a5540716441c49ec8185c8dc6a80c
0928 20:02:49.654531 (+ 71us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.731122 (+ 76591us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.792491 (+ 61369us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.811327 (+ 18836us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":933255}
I20260928 20:02:49.803102 27907 raft_consensus.cc:515] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.816570 26234 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 347) took 2821 ms. Trace:
I20260928 20:02:49.808740 26912 ts_tablet_manager.cc:1480] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.054s user 0.005s sys 0.000s
I20260928 20:02:49.819073 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 596a5540716441c49ec8185c8dc6a80c (table default.Table_1d2bed217f0242aabcfc3979c76a1757 [id=a763bf903e6146868af5e380c2a9df4d]) successfully deleted
I20260928 20:02:49.819564 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:49.820523 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:49.821723 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6544b7b405c4831900f37e052892409" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:49.822278 26651 raft_consensus.cc:3060] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:49.823961 26740 leader_election.cc:343] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: c6544b7b405c4831900f37e052892409
I20260928 20:02:49.830034 26651 raft_consensus.cc:2468] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:49.830508 26912 tablet_bootstrap.cc:492] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:49.816869 26234 rpcz_store.cc:276] 0928 20:02:46.994928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.961390 (+1966462us) service_pool.cc:224] Handling call
0928 20:02:49.015487 (+ 54097us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:49.050709 (+ 35222us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:49.051215 (+ 506us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:49.051332 (+ 117us) catalog_manager.cc:2863] Locking tablets
0928 20:02:49.326352 (+275020us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:49.814657 (+488305us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:49.814848 (+ 191us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:49.814945 (+ 97us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:49.816517 (+ 1572us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:49.612717 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:49.751635 (+138918us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:49.751672 (+ 37us) write_op.cc:435] Acquired schema lock
0928 20:02:49.751691 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:49.752108 (+ 417us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:49.752160 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:49.752191 (+ 31us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:49.752539 (+ 348us) tablet.cc:701] Row locks acquired
0928 20:02:49.752555 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:49.752702 (+ 147us) write_op.cc:270] Start()
0928 20:02:49.752806 (+ 104us) write_op.cc:276] Timestamp: P: 1790625769748669 usec, L: 0
0928 20:02:49.752832 (+ 26us) op_driver.cc:348] REPLICATION: starting
0928 20:02:49.753455 (+ 623us) log.cc:844] Serialized 734 byte log entry
0928 20:02:49.812558 (+ 59103us) op_driver.cc:464] REPLICATION: finished
0928 20:02:49.812890 (+ 332us) write_op.cc:301] APPLY: starting
0928 20:02:49.812957 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:49.813065 (+ 108us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:49.813148 (+ 83us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:49.813375 (+ 227us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:49.813528 (+ 153us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:49.813580 (+ 52us) write_op.cc:312] APPLY: finished
0928 20:02:49.813763 (+ 183us) log.cc:844] Serialized 29 byte log entry
0928 20:02:49.813906 (+ 143us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:49.813985 (+ 79us) write_op.cc:454] Released schema lock
0928 20:02:49.814025 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:49.814319 (+ 294us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:49.814360 (+ 41us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":121805056,"child_traces":[["op",{"apply.queue_time_us":191,"apply.run_cpu_time_us":1373,"apply.run_wall_time_us":1372,"num_ops":2,"prepare.queue_time_us":284730,"prepare.run_cpu_time_us":2830,"prepare.run_wall_time_us":197492,"raft.queue_time_us":50565,"raft.run_cpu_time_us":747,"raft.run_wall_time_us":747,"replication_time_us":59633}]]}
I20260928 20:02:49.837399 26912 tablet_bootstrap.cc:654] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.838945 26739 leader_election.cc:304] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:49.839720 27862 raft_consensus.cc:2804] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:49.840140 27862 raft_consensus.cc:697] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:49.840921 27862 consensus_queue.cc:237] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.831281 27907 leader_election.cc:290] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:49.848999 27835 tablet_replica.cc:333] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:49.852059 27835 raft_consensus.cc:2243] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:49.853648 27835 raft_consensus.cc:2272] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.853895 26916 tablet_bootstrap.cc:492] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:49.854427 26916 ts_tablet_manager.cc:1449] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.573s user 0.011s sys 0.003s
I20260928 20:02:49.855901 27835 ts_tablet_manager.cc:1962] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:49.856792 26916 raft_consensus.cc:359] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:49.858506 26595 consensus_peers.cc:597] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38abbc891d9c4268820cb0faba3d08b5. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:49.859058 27676 raft_consensus.cc:493] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.859462 27676 raft_consensus.cc:515] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.861286 27676 leader_election.cc:290] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:49.862094 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:49.881289 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 046ed3ac8b6b46afbc1e1bde4b2365ef consensus state has no leader
I20260928 20:02:49.882565 26913 tablet_bootstrap.cc:654] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:49.894814 26594 consensus_peers.cc:597] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:49.904623 27854 ts_tablet_manager.cc:1975] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.906929 27854 log.cc:1199] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:49.907660 27854 ts_tablet_manager.cc:1996] T a0dd3080d50748d2ad79f472d3c17673 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.910007 26912 tablet_bootstrap.cc:492] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:49.910530 26912 ts_tablet_manager.cc:1449] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.005s
I20260928 20:02:49.906637 26913 tablet_bootstrap.cc:492] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:49.911047 26913 ts_tablet_manager.cc:1449] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.100s user 0.007s sys 0.002s
I20260928 20:02:49.912927 26912 raft_consensus.cc:359] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.913702 26912 raft_consensus.cc:385] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.913959 26912 raft_consensus.cc:740] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.913563 26913 raft_consensus.cc:359] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.914404 26913 raft_consensus.cc:385] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:49.915062 26913 raft_consensus.cc:740] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:49.917984 26913 consensus_queue.cc:260] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:49.919597 26912 consensus_queue.cc:260] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.922557 26912 ts_tablet_manager.cc:1480] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260928 20:02:49.923406 26912 tablet_bootstrap.cc:492] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:49.924209 26913 ts_tablet_manager.cc:1480] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260928 20:02:49.917306 27835 ts_tablet_manager.cc:1975] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:49.928033 27835 log.cc:1199] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:49.928789 27835 ts_tablet_manager.cc:1996] T 38abbc891d9c4268820cb0faba3d08b5 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:49.929813 27854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 310) took 1031 ms. Trace:
I20260928 20:02:49.930179 27854 rpcz_store.cc:276] 0928 20:02:48.898715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.901230 (+ 2515us) service_pool.cc:224] Handling call
0928 20:02:49.774628 (+873398us) ts_tablet_manager.cc:1197] Deleting tablet a0dd3080d50748d2ad79f472d3c17673
0928 20:02:49.774667 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.828376 (+ 53709us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.904475 (+ 76099us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.929755 (+ 25280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":872919}
I20260928 20:02:49.930629 27835 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 322) took 1152 ms. Trace:
I20260928 20:02:49.930938 27835 rpcz_store.cc:276] 0928 20:02:48.778617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.778719 (+ 102us) service_pool.cc:224] Handling call
0928 20:02:49.848850 (+1070131us) ts_tablet_manager.cc:1197] Deleting tablet 38abbc891d9c4268820cb0faba3d08b5
0928 20:02:49.848893 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.897832 (+ 48939us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.917199 (+ 19367us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.930575 (+ 13376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069650}
I20260928 20:02:49.931630 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet a0dd3080d50748d2ad79f472d3c17673 (table default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]) successfully deleted
I20260928 20:02:49.932276 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 38abbc891d9c4268820cb0faba3d08b5 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]) successfully deleted
I20260928 20:02:49.932474 27835 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 323) took 1072 ms. Trace:
I20260928 20:02:49.933370 27854 tablet_replica.cc:333] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.932729 27835 rpcz_store.cc:276] 0928 20:02:48.859874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.859981 (+ 107us) service_pool.cc:224] Handling call
0928 20:02:49.932163 (+1072182us) ts_tablet_manager.cc:1197] Deleting tablet 78d5de4a82bd41c1a8b2af2ba7417c46
0928 20:02:49.932200 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.932427 (+ 227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1071663}
I20260928 20:02:49.934335 27854 raft_consensus.cc:2243] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:49.935432 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d5de4a82bd41c1a8b2af2ba7417c46 already in progress: creating tablet
I20260928 20:02:49.943972 27854 raft_consensus.cc:2272] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.935329 26913 tablet_bootstrap.cc:492] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:49.945947 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet d8d27cbf353246fbb7fe09f385194d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8d27cbf353246fbb7fe09f385194d8a already in progress: creating tablet
I20260928 20:02:49.934639 26912 tablet_bootstrap.cc:654] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:49.949992 26913 tablet_bootstrap.cc:654] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:49.950898 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4cd2204d99e14a07af962295b152d60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd2204d99e14a07af962295b152d60f already in progress: creating tablet
I20260928 20:02:49.952728 27854 ts_tablet_manager.cc:1962] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:49.954010 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 1dde3191a52b4254944ae1f8556e1632 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dde3191a52b4254944ae1f8556e1632 already in progress: creating tablet
I20260928 20:02:49.863131 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:49.964169 26511 raft_consensus.cc:2393] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:49.873723 27954 tablet.cc:1751] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:49.966279 26595 leader_election.cc:304] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.967644 27676 raft_consensus.cc:3060] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:49.975229 27879 raft_consensus.cc:493] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:49.975656 27879 raft_consensus.cc:515] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:49.976661 27676 raft_consensus.cc:2749] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.977121 27854 ts_tablet_manager.cc:1975] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:49.977438 27854 log.cc:1199] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:49.977579 27879 leader_election.cc:290] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:49.978149 27854 ts_tablet_manager.cc:1996] T 596a5540716441c49ec8185c8dc6a80c P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:49.979496 27862 consensus_queue.cc:1048] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:49.980123 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:49.982020 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:49.982072 26450 leader_election.cc:343] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.903589 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:49.907505 27857 ts_tablet_manager.cc:1975] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:49.983011 27857 log.cc:1199] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:02:49.983755 27857 ts_tablet_manager.cc:1996] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:49.984526 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 326) took 1336 ms. Trace:
I20260928 20:02:49.985515 27854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 312) took 1079 ms. Trace:
I20260928 20:02:49.985415 27862 consensus_queue.cc:1048] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:49.984879 27857 rpcz_store.cc:276] 0928 20:02:48.648391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.648479 (+ 88us) service_pool.cc:224] Handling call
0928 20:02:49.132629 (+484150us) ts_tablet_manager.cc:1197] Deleting tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
0928 20:02:49.132665 (+ 36us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.292356 (+159691us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.907355 (+614999us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.984460 (+ 77105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":483624}
I20260928 20:02:49.986819 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 (table default.Table_82491753b5fc4f5290c7b0ffaef58075 [id=eb753b0a4a1e415b8b002953ec65c0fc]) successfully deleted
W20260928 20:02:49.985100 26450 leader_election.cc:343] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:49.986564 27854 rpcz_store.cc:276] 0928 20:02:48.905863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.907171 (+ 1308us) service_pool.cc:224] Handling call
0928 20:02:49.933224 (+1026053us) ts_tablet_manager.cc:1197] Deleting tablet 596a5540716441c49ec8185c8dc6a80c
0928 20:02:49.933262 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.963297 (+ 30035us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.977018 (+ 13721us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:49.985463 (+ 8445us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1025413}
I20260928 20:02:49.987273 26450 leader_election.cc:304] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:49.987897 27879 raft_consensus.cc:2749] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:49.988055 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 596a5540716441c49ec8185c8dc6a80c (table default.Table_1d2bed217f0242aabcfc3979c76a1757 [id=a763bf903e6146868af5e380c2a9df4d]) successfully deleted
I20260928 20:02:49.990247 27854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 313) took 1072 ms. Trace:
I20260928 20:02:49.991730 27854 rpcz_store.cc:276] 0928 20:02:48.918294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.918905 (+ 611us) service_pool.cc:224] Handling call
0928 20:02:49.989794 (+1070889us) ts_tablet_manager.cc:1197] Deleting tablet 78d5de4a82bd41c1a8b2af2ba7417c46
0928 20:02:49.989861 (+ 67us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:49.990194 (+ 333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1070357}
W20260928 20:02:49.993820 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d5de4a82bd41c1a8b2af2ba7417c46 already in progress: creating tablet
I20260928 20:02:49.995230 27854 tablet_replica.cc:333] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:49.996275 27854 raft_consensus.cc:2243] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:49.997604 27854 raft_consensus.cc:2272] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:49.999837 27854 ts_tablet_manager.cc:1962] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:50.012924 26912 tablet_bootstrap.cc:492] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.013407 26912 ts_tablet_manager.cc:1449] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.090s user 0.017s sys 0.014s
I20260928 20:02:50.015843 26912 raft_consensus.cc:359] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.018198 26916 raft_consensus.cc:385] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.018399 26913 tablet_bootstrap.cc:492] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:50.018563 26916 raft_consensus.cc:740] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.018807 26913 ts_tablet_manager.cc:1449] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.084s user 0.010s sys 0.000s
I20260928 20:02:50.019764 26916 consensus_queue.cc:260] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.021970 26913 raft_consensus.cc:359] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.022571 26913 raft_consensus.cc:385] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.022821 26913 raft_consensus.cc:740] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.023370 26912 raft_consensus.cc:385] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.023630 26912 raft_consensus.cc:740] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.023674 27676 raft_consensus.cc:493] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.024093 27676 raft_consensus.cc:515] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:50.024233 26912 consensus_queue.cc:260] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.025462 26916 ts_tablet_manager.cc:1480] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.171s user 0.005s sys 0.000s
I20260928 20:02:50.026985 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0a362efb68408d8dce96dce0130035" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.027530 26804 raft_consensus.cc:2468] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.029893 26912 ts_tablet_manager.cc:1480] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.016s user 0.001s sys 0.004s
I20260928 20:02:50.029700 26594 leader_election.cc:304] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.031041 27857 tablet_replica.cc:333] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:50.034571 26912 tablet_bootstrap.cc:492] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.036847 27879 raft_consensus.cc:493] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.037289 27879 raft_consensus.cc:515] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.039165 27879 leader_election.cc:290] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.039614 27862 raft_consensus.cc:493] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.040059 27862 raft_consensus.cc:515] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.043794 27879 raft_consensus.cc:493] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.043866 27759 raft_consensus.cc:2804] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.044198 27759 raft_consensus.cc:493] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.044544 27759 raft_consensus.cc:3060] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.044231 27879 raft_consensus.cc:515] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.047173 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.047689 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.048003 26913 consensus_queue.cc:260] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:50.048766 26450 leader_election.cc:343] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.048928 27862 leader_election.cc:290] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.049077 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c267b42754dbca8eb5ebec2d66a23" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.049336 26450 leader_election.cc:343] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.050588 26913 ts_tablet_manager.cc:1480] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260928 20:02:50.051476 26913 tablet_bootstrap.cc:492] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:50.053834 26740 leader_election.cc:343] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ee4c267b42754dbca8eb5ebec2d66a23
W20260928 20:02:50.054260 26739 leader_election.cc:343] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.054607 26739 leader_election.cc:304] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:50.055488 27862 raft_consensus.cc:2749] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.059231 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.061489 27676 leader_election.cc:290] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.061681 26912 tablet_bootstrap.cc:654] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:50.061801 26450 leader_election.cc:343] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.062215 26450 leader_election.cc:304] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:50.065815 27854 ts_tablet_manager.cc:1975] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:50.066187 27854 log.cc:1199] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/0216c99dfd8f498595f3f7dbadf8a79b
I20260928 20:02:50.065981 27759 raft_consensus.cc:515] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:50.066902 27854 ts_tablet_manager.cc:1996] T 0216c99dfd8f498595f3f7dbadf8a79b P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:50.057493 27879 leader_election.cc:290] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.067627 27879 raft_consensus.cc:2749] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.068034 27759 leader_election.cc:290] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.068688 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.068923 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0a362efb68408d8dce96dce0130035" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:50.069384 26804 raft_consensus.cc:3060] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.080000 26804 raft_consensus.cc:2468] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:50.081111 26594 leader_election.cc:304] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.082983 26913 tablet_bootstrap.cc:654] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.090538 27759 raft_consensus.cc:2804] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.091005 27759 raft_consensus.cc:697] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:50.091740 27759 consensus_queue.cc:237] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:50.098089 26912 tablet_bootstrap.cc:492] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.098539 26912 ts_tablet_manager.cc:1449] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.008s
I20260928 20:02:50.099452 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:02:50.102221 26913 tablet_bootstrap.cc:492] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:50.101928 26912 raft_consensus.cc:359] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.102627 26913 ts_tablet_manager.cc:1449] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.000s
I20260928 20:02:50.102725 26912 raft_consensus.cc:385] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.103073 26912 raft_consensus.cc:740] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.103915 26912 consensus_queue.cc:260] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.107663 26912 ts_tablet_manager.cc:1480] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260928 20:02:50.109151 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_06b8763e3d1242f796a3861e889b693a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:50.110306 26912 tablet_bootstrap.cc:492] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.111001 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:50.111557 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:50.113258 26222 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 already in progress: creating tablet
I20260928 20:02:50.110347 27857 raft_consensus.cc:2243] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:50.113943 27857 raft_consensus.cc:2272] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:50.114157 26913 raft_consensus.cc:359] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.114763 26913 raft_consensus.cc:385] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.115000 26913 raft_consensus.cc:740] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.115991 26913 consensus_queue.cc:260] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:50.116246 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06b8763e3d1242f796a3861e889b693a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:50.125442 26913 ts_tablet_manager.cc:1480] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260928 20:02:50.129086 26912 tablet_bootstrap.cc:654] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.130192 27759 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.130687 27759 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.129164 26913 tablet_bootstrap.cc:492] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:50.133414 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.134007 26804 raft_consensus.cc:2468] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.135275 26594 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.136011 27676 raft_consensus.cc:2804] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.136346 27676 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.136806 27676 raft_consensus.cc:3060] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.136994 27759 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.115058 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:50.146870 26912 tablet_bootstrap.cc:492] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.146857 27857 ts_tablet_manager.cc:1962] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:50.147392 26912 ts_tablet_manager.cc:1449] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.000s
W20260928 20:02:50.127084 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 65307.9us
I20260928 20:02:50.150043 26912 raft_consensus.cc:359] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.150995 26912 raft_consensus.cc:385] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.151283 26912 raft_consensus.cc:740] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.153043 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:50.153628 26509 raft_consensus.cc:2468] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.153829 27759 raft_consensus.cc:493] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.152935 26912 consensus_queue.cc:260] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:50.154498 26450 leader_election.cc:343] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.154894 26450 leader_election.cc:304] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:50.154394 27759 raft_consensus.cc:515] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:50.156498 26912 ts_tablet_manager.cc:1480] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260928 20:02:50.157487 27777 raft_consensus.cc:493] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.157879 27777 raft_consensus.cc:515] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.159629 27777 leader_election.cc:290] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:50.160650 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86e8a782b3e46d09a45bbb7025546af" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.161250 26804 raft_consensus.cc:2468] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.161444 26912 tablet_bootstrap.cc:492] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.162384 26594 leader_election.cc:304] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.145931 27676 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.164718 27759 leader_election.cc:290] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.165565 27777 raft_consensus.cc:2804] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.166366 27777 raft_consensus.cc:493] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.167755 27777 raft_consensus.cc:3060] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.170195 27676 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.174558 26913 tablet_bootstrap.cc:654] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.173658 27970 raft_consensus.cc:493] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.164907 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:50.175890 26800 raft_consensus.cc:3060] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.175282 27970 raft_consensus.cc:515] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.181445 27970 leader_election.cc:290] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.181893 26912 tablet_bootstrap.cc:654] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.166980 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655fc043b9468ea51ce5ae983e8f06" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.186856 26804 raft_consensus.cc:2468] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.188094 26594 leader_election.cc:304] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.159440 27879 raft_consensus.cc:2749] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.188896 27676 raft_consensus.cc:2804] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.189446 27676 raft_consensus.cc:493] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.189786 27676 raft_consensus.cc:3060] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.189733 26800 raft_consensus.cc:2468] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:50.190855 26594 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.191570 27759 raft_consensus.cc:2804] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.191973 27759 raft_consensus.cc:697] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:50.192692 27759 consensus_queue.cc:237] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.202076 27676 raft_consensus.cc:515] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:50.206032 26912 tablet_bootstrap.cc:492] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.206462 26912 ts_tablet_manager.cc:1449] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.005s
I20260928 20:02:50.206918 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655fc043b9468ea51ce5ae983e8f06" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:50.207525 26800 raft_consensus.cc:3060] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.211699 26916 tablet_bootstrap.cc:492] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:50.211898 26913 tablet_bootstrap.cc:492] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:50.212406 26913 ts_tablet_manager.cc:1449] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.083s user 0.008s sys 0.003s
I20260928 20:02:50.215375 26913 raft_consensus.cc:359] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.217700 26912 raft_consensus.cc:359] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.219080 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.218331 26912 raft_consensus.cc:385] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.221287 26912 raft_consensus.cc:740] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.222005 26912 consensus_queue.cc:260] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.224761 26912 ts_tablet_manager.cc:1480] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260928 20:02:50.216521 27676 leader_election.cc:290] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:50.216657 26595 leader_election.cc:343] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0e0a362efb68408d8dce96dce0130035
I20260928 20:02:50.218709 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.228562 26595 leader_election.cc:343] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0e0a362efb68408d8dce96dce0130035
I20260928 20:02:50.227329 26913 raft_consensus.cc:385] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.230137 26913 raft_consensus.cc:740] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.230795 26913 consensus_queue.cc:260] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.235350 26913 ts_tablet_manager.cc:1480] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260928 20:02:50.238358 26800 raft_consensus.cc:2468] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:50.239449 26594 leader_election.cc:304] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.241217 27676 raft_consensus.cc:2804] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.242192 27676 raft_consensus.cc:697] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:50.242898 27676 consensus_queue.cc:237] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:02:50.271409 26594 consensus_peers.cc:597] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c23636443834932852f21092be1d1ac. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:50.285403 27777 raft_consensus.cc:515] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.290555 26227 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:50.068704 27854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 315) took 1101 ms. Trace:
I20260928 20:02:50.294533 27854 rpcz_store.cc:276] 0928 20:02:48.967613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.967742 (+ 129us) service_pool.cc:224] Handling call
0928 20:02:49.995094 (+1027352us) ts_tablet_manager.cc:1197] Deleting tablet 0216c99dfd8f498595f3f7dbadf8a79b
0928 20:02:49.995133 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.030658 (+ 35525us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.065685 (+ 35027us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.068653 (+ 2968us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026776}
I20260928 20:02:50.295858 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 0216c99dfd8f498595f3f7dbadf8a79b (table default.Table_0f0ada7547004715aeb96e77c7a7f3ee [id=a348fb5e772743aa9185aa2406fb492a]) successfully deleted
W20260928 20:02:50.297405 26450 leader_election.cc:343] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.320436 26916 tablet_bootstrap.cc:654] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.323151 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228]). Expected version 2 got 0
I20260928 20:02:50.324149 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:50.325223 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:50.325814 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:50.326622 26912 tablet_bootstrap.cc:492] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.327235 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:50.332415 27965 raft_consensus.cc:493] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.332873 27965 raft_consensus.cc:515] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.334596 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]). Expected version 1 got 0
I20260928 20:02:50.334774 27965 leader_election.cc:290] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.335218 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:50.335395 27837 raft_consensus.cc:493] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.335835 27837 raft_consensus.cc:515] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.336308 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:50.336783 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:50.337389 26231 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]). Expected version 1 got 0
I20260928 20:02:50.337636 27837 leader_election.cc:290] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.339466 26913 tablet_bootstrap.cc:492] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:50.340234 26740 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4b91a573103c4c2d995abde8db91b821
I20260928 20:02:50.343184 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.344482 26739 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.344815 26739 leader_election.cc:304] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:50.345402 27907 raft_consensus.cc:2749] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.351886 26913 tablet_bootstrap.cc:654] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.354899 27854 tablet_replica.cc:333] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:50.355721 27854 raft_consensus.cc:2243] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:50.356671 27854 raft_consensus.cc:2272] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:50.358553 27854 ts_tablet_manager.cc:1962] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:50.363858 26913 tablet_bootstrap.cc:492] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:50.364332 26913 ts_tablet_manager.cc:1449] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.001s
I20260928 20:02:50.366580 26913 raft_consensus.cc:359] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.372387 26913 raft_consensus.cc:385] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.372681 26913 raft_consensus.cc:740] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.373399 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:50.373317 26913 consensus_queue.cc:260] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.373979 26513 raft_consensus.cc:3060] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.375243 26913 ts_tablet_manager.cc:1480] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260928 20:02:50.376029 26913 tablet_bootstrap.cc:492] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:50.379227 26234 catalog_manager.cc:5838] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:50.381978 26513 raft_consensus.cc:2468] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:50.382248 26234 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:50.383112 27907 raft_consensus.cc:493] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.383581 27907 raft_consensus.cc:515] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.385629 27907 leader_election.cc:290] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.387035 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:50.387578 26511 raft_consensus.cc:2468] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:50.388172 26595 leader_election.cc:343] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:50.388882 26740 leader_election.cc:304] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:50.389496 26595 consensus_peers.cc:597] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c23636443834932852f21092be1d1ac. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:50.389591 27907 raft_consensus.cc:493] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.389992 27837 raft_consensus.cc:2804] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.390375 27837 raft_consensus.cc:493] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.390456 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.390667 27837 raft_consensus.cc:3060] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:50.391656 26739 leader_election.cc:343] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.389993 27907 raft_consensus.cc:515] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.395159 27777 leader_election.cc:290] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:50.395682 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86e8a782b3e46d09a45bbb7025546af" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:50.396152 26800 raft_consensus.cc:3060] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.400867 27854 ts_tablet_manager.cc:1975] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:50.401217 27854 log.cc:1199] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:50.401877 27854 ts_tablet_manager.cc:1996] T 018497a652234fbdb04cf6c034bcc5d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:50.402626 26800 raft_consensus.cc:2468] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:50.403676 26594 leader_election.cc:304] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.404310 27907 leader_election.cc:290] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.405300 27837 raft_consensus.cc:515] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.405884 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.408380 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
W20260928 20:02:50.408651 26739 leader_election.cc:343] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.408872 26511 raft_consensus.cc:3060] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.409546 26913 tablet_bootstrap.cc:654] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.410051 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:50.411821 26739 leader_election.cc:343] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.419400 26511 raft_consensus.cc:2468] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:02:50.420274 26595 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:50.422170 27676 raft_consensus.cc:2804] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.422559 27676 raft_consensus.cc:697] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:50.423208 27676 consensus_queue.cc:237] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.429085 27854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 314) took 1461 ms. Trace:
I20260928 20:02:50.429463 27854 rpcz_store.cc:276] 0928 20:02:48.967267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.968332 (+ 1065us) service_pool.cc:224] Handling call
0928 20:02:50.296621 (+1328289us) ts_tablet_manager.cc:1197] Deleting tablet 018497a652234fbdb04cf6c034bcc5d3
0928 20:02:50.354757 (+ 58136us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.381012 (+ 26255us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.400736 (+ 19724us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.429017 (+ 28281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1327824}
I20260928 20:02:50.430837 27854 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 316) took 1456 ms. Trace:
I20260928 20:02:50.431157 27854 rpcz_store.cc:276] 0928 20:02:48.973952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.974511 (+ 559us) service_pool.cc:224] Handling call
0928 20:02:50.430498 (+1455987us) ts_tablet_manager.cc:1197] Deleting tablet d8d27cbf353246fbb7fe09f385194d8a
0928 20:02:50.430539 (+ 41us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.430775 (+ 236us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1455518}
I20260928 20:02:50.436021 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d41c7a2638544b2b90e5398f97ad686b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:50.436839 26740 leader_election.cc:304] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:50.431509 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:50.437691 26513 raft_consensus.cc:2468] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:50.438062 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d41c7a2638544b2b90e5398f97ad686b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:50.441597 27879 raft_consensus.cc:493] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.442059 27879 raft_consensus.cc:515] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.444133 27879 leader_election.cc:290] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:50.444443 26450 leader_election.cc:343] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.444804 26450 leader_election.cc:304] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:50.445086 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.446625 27965 raft_consensus.cc:2749] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.446692 27879 raft_consensus.cc:493] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.447207 27879 raft_consensus.cc:515] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.450038 27879 leader_election.cc:290] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.451396 27907 raft_consensus.cc:2804] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.451833 27907 raft_consensus.cc:697] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:50.452692 27907 consensus_queue.cc:237] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:50.461681 26450 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.465634 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.476121 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.481604 26232 master_service.cc:960] ReplaceTablet: received request to replace tablet 06e7228a68b84f2aab2bfa582fa25ab8 from {username='slave'} at 127.0.0.1:40138
W20260928 20:02:50.484754 26450 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:50.487799 26450 leader_election.cc:343] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.488749 27857 ts_tablet_manager.cc:1975] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:50.450534 27837 leader_election.cc:290] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.498847 26912 tablet_bootstrap.cc:654] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.492940 26916 tablet_bootstrap.cc:492] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:50.506531 26916 ts_tablet_manager.cc:1449] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.295s user 0.011s sys 0.005s
W20260928 20:02:50.508533 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 71773.1us
I20260928 20:02:50.509032 26916 raft_consensus.cc:359] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.509769 26916 raft_consensus.cc:385] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.510349 26912 tablet_bootstrap.cc:492] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.510397 26916 raft_consensus.cc:740] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.510751 26912 ts_tablet_manager.cc:1449] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.184s user 0.009s sys 0.004s
I20260928 20:02:50.510146 27857 log.cc:1199] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/385278bf2df34f4f960a0cfdebd79be5
I20260928 20:02:50.513037 26912 raft_consensus.cc:359] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.513651 26912 raft_consensus.cc:385] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.513885 26740 leader_election.cc:304] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:50.515636 27907 raft_consensus.cc:2804] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.515952 27907 raft_consensus.cc:493] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.516244 27907 raft_consensus.cc:3060] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.513885 26912 raft_consensus.cc:740] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.521673 26912 consensus_queue.cc:260] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.522814 27907 raft_consensus.cc:515] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.528328 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:50.528863 26513 raft_consensus.cc:3060] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.530797 27984 raft_consensus.cc:493] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.531190 27984 raft_consensus.cc:515] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.533030 27984 leader_election.cc:290] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.535081 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:50.535652 26511 raft_consensus.cc:2468] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:50.537684 26740 leader_election.cc:304] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.538384 27986 raft_consensus.cc:493] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.538780 27986 raft_consensus.cc:515] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.540462 27857 ts_tablet_manager.cc:1996] T 385278bf2df34f4f960a0cfdebd79be5 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:50.540656 27986 leader_election.cc:290] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.541086 27986 raft_consensus.cc:2804] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.541371 27986 raft_consensus.cc:493] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.541679 27986 raft_consensus.cc:3060] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.541523 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:50.543197 26511 raft_consensus.cc:2468] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:50.544397 26740 leader_election.cc:304] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.545158 27984 raft_consensus.cc:2804] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.545537 27984 raft_consensus.cc:493] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.545894 27984 raft_consensus.cc:3060] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.546476 26513 raft_consensus.cc:2468] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:50.550554 27986 raft_consensus.cc:515] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.512807 26916 consensus_queue.cc:260] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.556120 26916 ts_tablet_manager.cc:1480] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.049s user 0.004s sys 0.001s
I20260928 20:02:50.557658 27986 leader_election.cc:290] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.552341 27907 leader_election.cc:290] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.553344 26740 leader_election.cc:304] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.561923 27984 raft_consensus.cc:515] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.556175 26912 ts_tablet_manager.cc:1480] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20260928 20:02:50.563797 26912 tablet_bootstrap.cc:492] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.564400 27984 leader_election.cc:290] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.564976 27984 raft_consensus.cc:2804] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:02:50.565073 26221 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 -> Peer 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461): Couldn't send request to peer 0b347187d9be4ad08708acffdf4dda63. Status: Network error: Client connection negotiation failed: client connection to 127.25.129.252:44461: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260928 20:02:50.565773 27984 raft_consensus.cc:697] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:50.566674 27984 consensus_queue.cc:237] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.591498 26912 tablet_bootstrap.cc:654] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.594394 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:50.595111 26511 raft_consensus.cc:3060] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.599068 27999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.129.252:44461 every 8 connection(s)
I20260928 20:02:50.599689 27051 rpc_server.cc:307] RPC server started. Bound to: 127.25.129.252:44461
I20260928 20:02:50.600752 26916 tablet_bootstrap.cc:492] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:50.612524 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 325) took 1980 ms. Trace:
I20260928 20:02:50.613137 27857 rpcz_store.cc:276] 0928 20:02:48.632083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.648871 (+ 16788us) service_pool.cc:224] Handling call
0928 20:02:50.030841 (+1381970us) ts_tablet_manager.cc:1197] Deleting tablet 385278bf2df34f4f960a0cfdebd79be5
0928 20:02:50.030897 (+ 56us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.459016 (+428119us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.488620 (+ 29604us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.612436 (+123816us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381378}
I20260928 20:02:50.618410 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 018497a652234fbdb04cf6c034bcc5d3 (table default.Table_438a2bd078e04a3e87064ca81d283559 [id=e27528ba702740e7a7aaae54dc8503fb]) successfully deleted
W20260928 20:02:50.619230 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet d8d27cbf353246fbb7fe09f385194d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8d27cbf353246fbb7fe09f385194d8a already in progress: creating tablet
W20260928 20:02:50.619900 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4cd2204d99e14a07af962295b152d60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd2204d99e14a07af962295b152d60f already in progress: creating tablet
W20260928 20:02:50.620555 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 1dde3191a52b4254944ae1f8556e1632 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dde3191a52b4254944ae1f8556e1632 already in progress: creating tablet
W20260928 20:02:50.621186 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 already in progress: creating tablet
I20260928 20:02:50.626575 27907 raft_consensus.cc:493] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.627139 27907 raft_consensus.cc:515] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.630149 27907 leader_election.cc:290] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:50.634318 26740 leader_election.cc:343] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:50.643707 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 385278bf2df34f4f960a0cfdebd79be5 (table default.Table_ba39b68fc8f040688126ae288d501ac3 [id=5f40398fa88449218e7d77ef265d2e04]) successfully deleted
I20260928 20:02:50.635257 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:50.644851 26513 raft_consensus.cc:3060] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:50.636166 26916 tablet_bootstrap.cc:654] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.654927 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:50.657192 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.657456 26739 leader_election.cc:343] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.658388 27907 consensus_queue.cc:1048] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:50.658615 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.659868 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.660307 26450 leader_election.cc:343] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.654927 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5f5f16f2d7457799e1b96a293695f4" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.660779 26450 leader_election.cc:304] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:50.662094 26450 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:50.662344 26739 leader_election.cc:343] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.662547 26450 leader_election.cc:304] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:50.662719 26739 leader_election.cc:304] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:50.662802 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:50.663236 27965 raft_consensus.cc:2749] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.663576 27907 raft_consensus.cc:2749] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.663786 27965 raft_consensus.cc:2749] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:50.665000 26450 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.665489 26450 leader_election.cc:304] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:50.666389 26739 leader_election.cc:343] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.666483 27879 raft_consensus.cc:2749] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.675698 27879 raft_consensus.cc:493] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.676242 27879 raft_consensus.cc:515] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.676919 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:50.659456 26511 raft_consensus.cc:2468] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:50.680351 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.681144 26740 leader_election.cc:304] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:50.682126 27907 raft_consensus.cc:2804] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.682632 27907 raft_consensus.cc:697] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:50.683243 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.683538 27907 consensus_queue.cc:237] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.684803 27879 leader_election.cc:290] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.685515 27857 tablet_replica.cc:333] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:50.686400 26739 leader_election.cc:343] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:50.687179 26739 leader_election.cc:343] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.688170 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5de4a82bd41c1a8b2af2ba7417c46" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.689174 26739 leader_election.cc:343] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:50.689436 26450 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.689548 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5de4a82bd41c1a8b2af2ba7417c46" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:50.691912 26450 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.693181 26450 leader_election.cc:304] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:50.695101 27879 raft_consensus.cc:2749] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.697484 27857 raft_consensus.cc:2243] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:50.709234 27857 raft_consensus.cc:2272] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:50.711735 27857 ts_tablet_manager.cc:1962] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:50.713572 26913 tablet_bootstrap.cc:492] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:50.714190 26913 ts_tablet_manager.cc:1449] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.338s user 0.011s sys 0.014s
I20260928 20:02:50.716791 26916 tablet_bootstrap.cc:492] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:50.717367 26916 ts_tablet_manager.cc:1449] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.117s user 0.006s sys 0.009s
I20260928 20:02:50.724154 26912 tablet_bootstrap.cc:492] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.724629 26912 ts_tablet_manager.cc:1449] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.161s user 0.012s sys 0.000s
I20260928 20:02:50.725174 26561 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:50.729900 26916 raft_consensus.cc:359] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.730597 26916 raft_consensus.cc:385] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.713953 26513 raft_consensus.cc:2468] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:50.730871 26916 raft_consensus.cc:740] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.731511 26916 consensus_queue.cc:260] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.733471 26916 ts_tablet_manager.cc:1480] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260928 20:02:50.733665 27777 raft_consensus.cc:493] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.734397 26916 tablet_bootstrap.cc:492] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:50.734236 27777 raft_consensus.cc:515] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.736363 27777 leader_election.cc:290] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.727320 26912 raft_consensus.cc:359] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.738032 26912 raft_consensus.cc:385] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.738327 26912 raft_consensus.cc:740] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.743062 26740 leader_election.cc:304] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:50.744203 27907 raft_consensus.cc:2804] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:50.744972 27907 raft_consensus.cc:697] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:50.746069 26912 consensus_queue.cc:260] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.730042 27759 raft_consensus.cc:493] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.747478 27759 raft_consensus.cc:515] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.717824 26913 raft_consensus.cc:359] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.753751 26913 raft_consensus.cc:385] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.754119 26913 raft_consensus.cc:740] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.754426 27907 consensus_queue.cc:237] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.754819 26913 consensus_queue.cc:260] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.756901 26913 ts_tablet_manager.cc:1480] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.042s user 0.003s sys 0.004s
I20260928 20:02:50.758244 27759 leader_election.cc:290] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:50.760536 26916 tablet_bootstrap.cc:654] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.776098 26916 tablet_bootstrap.cc:492] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:50.776500 26916 ts_tablet_manager.cc:1449] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.003s
I20260928 20:02:50.760872 26912 ts_tablet_manager.cc:1480] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.036s user 0.003s sys 0.002s
I20260928 20:02:50.764276 27986 raft_consensus.cc:493] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.780396 26849 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:50.780967 26912 tablet_bootstrap.cc:492] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.780447 27986 raft_consensus.cc:515] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:50.781126 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:50.782505 27986 leader_election.cc:290] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:50.786022 26740 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
I20260928 20:02:50.788560 26912 tablet_bootstrap.cc:654] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.789835 26916 raft_consensus.cc:359] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.790676 26916 raft_consensus.cc:385] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.790968 26916 raft_consensus.cc:740] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.791630 26916 consensus_queue.cc:260] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.793751 26704 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:50.794209 26916 ts_tablet_manager.cc:1480] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260928 20:02:50.798530 26119 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskjF8q7O/build/tsan/bin/kudu as pid 27051
I20260928 20:02:50.798849 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edf314241784091a603907a43429b28" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.799435 26804 raft_consensus.cc:2468] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.800576 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c267b42754dbca8eb5ebec2d66a23" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:50.801030 26804 raft_consensus.cc:2468] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:50.794039 27051 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/master-2/data/info.pb
I20260928 20:02:50.807946 26561 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:50.813773 26913 tablet_bootstrap.cc:492] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:50.814467 26912 tablet_bootstrap.cc:492] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.814895 26912 ts_tablet_manager.cc:1449] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.007s
I20260928 20:02:50.817898 26912 raft_consensus.cc:359] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.818720 26912 raft_consensus.cc:385] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.819056 26912 raft_consensus.cc:740] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.820051 26912 consensus_queue.cc:260] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.824258 26912 ts_tablet_manager.cc:1480] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260928 20:02:50.825425 26912 tablet_bootstrap.cc:492] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.829778 26594 leader_election.cc:304] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.834290 26912 tablet_bootstrap.cc:654] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.840407 26916 tablet_bootstrap.cc:492] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:50.844427 27879 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.844871 27879 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.846818 27879 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.848588 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:50.849961 26450 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.851126 26916 tablet_bootstrap.cc:654] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.854090 27857 ts_tablet_manager.cc:1975] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:50.857209 27857 log.cc:1199] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/1284d1f7fa774033b90133447627df4f
I20260928 20:02:50.858474 27857 ts_tablet_manager.cc:1996] T 1284d1f7fa774033b90133447627df4f P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:50.859179 26912 tablet_bootstrap.cc:492] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.859573 26912 ts_tablet_manager.cc:1449] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.006s
I20260928 20:02:50.862406 26912 raft_consensus.cc:359] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.865749 26912 raft_consensus.cc:385] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.865991 26912 raft_consensus.cc:740] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.866667 26912 consensus_queue.cc:260] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.868340 26912 ts_tablet_manager.cc:1480] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260928 20:02:50.869127 26912 tablet_bootstrap.cc:492] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.868325 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 324) took 2236 ms. Trace:
I20260928 20:02:50.871968 27857 rpcz_store.cc:276] 0928 20:02:48.631758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.649636 (+ 17878us) service_pool.cc:224] Handling call
0928 20:02:50.672811 (+2023175us) ts_tablet_manager.cc:1197] Deleting tablet 1284d1f7fa774033b90133447627df4f
0928 20:02:50.685381 (+ 12570us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.787415 (+102034us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.853962 (+ 66547us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:50.868259 (+ 14297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2017340}
I20260928 20:02:50.874244 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 1284d1f7fa774033b90133447627df4f (table default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a]) successfully deleted
I20260928 20:02:50.875097 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 328) took 2212 ms. Trace:
I20260928 20:02:50.875749 26912 tablet_bootstrap.cc:654] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:50.876962 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b667a45712c1449384e1a288f55fd062 (table default.Table_31b3759a2ab04669a085898c9806347b [id=e2819060d01546218e8b53248ca6decd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b667a45712c1449384e1a288f55fd062 consensus state has no leader
I20260928 20:02:50.888607 26912 tablet_bootstrap.cc:492] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:50.888971 26912 ts_tablet_manager.cc:1449] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.004s
I20260928 20:02:50.891222 26912 raft_consensus.cc:359] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.891837 26912 raft_consensus.cc:385] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.892094 26912 raft_consensus.cc:740] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.891661 26916 tablet_bootstrap.cc:492] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:50.893229 26916 ts_tablet_manager.cc:1449] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.053s user 0.009s sys 0.004s
W20260928 20:02:50.895272 26740 consensus_peers.cc:597] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6544b7b405c4831900f37e052892409. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:50.895606 26912 consensus_queue.cc:260] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.897274 26912 ts_tablet_manager.cc:1480] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260928 20:02:50.897631 27879 raft_consensus.cc:493] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:50.898042 26912 tablet_bootstrap.cc:492] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:50.898056 27879 raft_consensus.cc:515] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.899930 27879 leader_election.cc:290] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:50.901459 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:50.902650 26450 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.902441 26916 raft_consensus.cc:359] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:50.903100 26916 raft_consensus.cc:385] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:50.903365 26916 raft_consensus.cc:740] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:50.903973 26916 consensus_queue.cc:260] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:50.909605 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 80015.4us
I20260928 20:02:50.910416 26916 ts_tablet_manager.cc:1480] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260928 20:02:50.910315 26594 leader_election.cc:304] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:50.911202 26916 tablet_bootstrap.cc:492] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:50.840921 28000 consensus_queue.cc:1048] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:50.920243 26916 tablet_bootstrap.cc:654] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:50.932191 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775b9a076bf048bea39423d3554babf7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:50.940162 26912 tablet_bootstrap.cc:654] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:50.872862 26595 leader_election.cc:343] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:50.878454 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.950553 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 77812.7us
W20260928 20:02:50.951191 26595 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
W20260928 20:02:50.951265 26739 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.951622 26739 leader_election.cc:304] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:50.952257 27986 raft_consensus.cc:2749] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.875862 27857 rpcz_store.cc:276] 0928 20:02:48.663062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.663207 (+ 145us) service_pool.cc:224] Handling call
0928 20:02:50.874470 (+2211263us) ts_tablet_manager.cc:1197] Deleting tablet db5f5f16f2d7457799e1b96a293695f4
0928 20:02:50.874509 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.875045 (+ 536us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2210783}
I20260928 20:02:50.966068 27759 raft_consensus.cc:2804] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.966558 27759 raft_consensus.cc:493] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.966957 27759 raft_consensus.cc:3060] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:50.967149 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet db5f5f16f2d7457799e1b96a293695f4 because the tablet was not found. No further retry: Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:50.974279 28000 raft_consensus.cc:2804] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:50.974720 28000 raft_consensus.cc:493] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:50.974905 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:50.976096 26450 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.976477 26450 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:50.977553 26450 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:50.977885 26450 leader_election.cc:304] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:50.978631 27965 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.979208 27965 raft_consensus.cc:2749] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:50.975114 28000 raft_consensus.cc:3060] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:50.994222 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 82203.3us
I20260928 20:02:50.994760 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 327) took 2332 ms. Trace:
I20260928 20:02:50.995168 27857 rpcz_store.cc:276] 0928 20:02:48.662753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.666181 (+ 3428us) service_pool.cc:224] Handling call
0928 20:02:50.974026 (+2307845us) ts_tablet_manager.cc:1197] Deleting tablet a86e8a782b3e46d09a45bbb7025546af
0928 20:02:50.994473 (+ 20447us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:50.994699 (+ 226us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2307205}
W20260928 20:02:50.996644 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet a86e8a782b3e46d09a45bbb7025546af because the tablet was not found. No further retry: Not found: Tablet not found: a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:50.997885 27759 raft_consensus.cc:515] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:51.001299 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 49329.9us
I20260928 20:02:51.002290 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1edf314241784091a603907a43429b28" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:51.002830 26800 raft_consensus.cc:3060] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:51.007714 26912 tablet_bootstrap.cc:492] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:51.008255 26912 ts_tablet_manager.cc:1449] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.110s user 0.018s sys 0.025s
I20260928 20:02:51.008654 26916 tablet_bootstrap.cc:492] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:51.009130 26916 ts_tablet_manager.cc:1449] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.098s user 0.019s sys 0.006s
I20260928 20:02:51.010818 26912 raft_consensus.cc:359] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.011436 26912 raft_consensus.cc:385] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.011498 26916 raft_consensus.cc:359] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.011756 26912 raft_consensus.cc:740] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.012151 26916 raft_consensus.cc:385] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.012392 26916 raft_consensus.cc:740] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.012492 26912 consensus_queue.cc:260] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.013001 26916 consensus_queue.cc:260] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.016508 26916 ts_tablet_manager.cc:1480] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260928 20:02:51.016844 27879 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.017287 27879 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.019076 27879 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.023654 26235 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 360) took 1348 ms. Trace:
I20260928 20:02:51.025009 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 06e7228a68b84f2aab2bfa582fa25ab8
I20260928 20:02:51.027354 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:51.027724 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6393d0583a9a47ec9eb455b30a548fc3) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:51.027993 26803 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:51.028764 26232 catalog_manager.cc:6934] ReplaceTablet: tablet 06e7228a68b84f2aab2bfa582fa25ab8 deleted and replaced by tablet 6393d0583a9a47ec9eb455b30a548fc3
I20260928 20:02:51.029103 26232 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 361) took 1178 ms. Trace:
I20260928 20:02:51.030000 26450 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:51.030728 27879 raft_consensus.cc:2804] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:51.031023 27879 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:51.031304 27879 raft_consensus.cc:3060] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:51.029389 26232 rpcz_store.cc:276] 0928 20:02:49.850903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:50.481503 (+630600us) service_pool.cc:224] Handling call
0928 20:02:50.505901 (+ 24398us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ae191 00007ff79cc72d37 00007ff79cc72cc2 00007ff79cc72bf1 00007ff79cc72b6c 00007ff79cc71e22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:51.029047 (+523146us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:50.881038 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:50.881510 (+ 472us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:50.881540 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:02:50.881557 (+ 17us) tablet.cc:662] Decoding operations
0928 20:02:50.881910 (+ 353us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:50.881950 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:50.881981 (+ 31us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:50.882233 (+ 252us) tablet.cc:701] Row locks acquired
0928 20:02:50.882246 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:50.882365 (+ 119us) write_op.cc:270] Start()
0928 20:02:50.882456 (+ 91us) write_op.cc:276] Timestamp: P: 1790625770882320 usec, L: 0
0928 20:02:50.882474 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:50.882981 (+ 507us) log.cc:844] Serialized 665 byte log entry
0928 20:02:51.019188 (+136207us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.023334 (+ 4146us) write_op.cc:301] APPLY: starting
0928 20:02:51.023385 (+ 51us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.023498 (+ 113us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.023580 (+ 82us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.023877 (+ 297us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.024060 (+ 183us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:51.024103 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:51.024258 (+ 155us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.024376 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.024434 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:51.024461 (+ 27us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":53780224,"child_traces":[["op",{"apply.queue_time_us":4032,"apply.run_cpu_time_us":1306,"apply.run_wall_time_us":1306,"num_ops":2,"prepare.queue_time_us":304295,"prepare.run_cpu_time_us":2173,"prepare.run_wall_time_us":3134,"replication_time_us":136622,"threads_started":1}]]}
I20260928 20:02:51.033978 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6393d0583a9a47ec9eb455b30a548fc3) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.034765 26916 tablet_bootstrap.cc:492] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:51.023970 26235 rpcz_store.cc:276] 0928 20:02:49.675673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:50.435570 (+759897us) service_pool.cc:224] Handling call
0928 20:02:50.440414 (+ 4844us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:50.442383 (+ 1969us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:51.023061 (+580678us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:51.023335 (+ 274us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:51.023595 (+ 260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:50.557023 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:50.557465 (+ 442us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:50.557490 (+ 25us) write_op.cc:435] Acquired schema lock
0928 20:02:50.557506 (+ 16us) tablet.cc:662] Decoding operations
0928 20:02:50.557786 (+ 280us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:50.557825 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:50.557849 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:50.558073 (+ 224us) tablet.cc:701] Row locks acquired
0928 20:02:50.558088 (+ 15us) write_op.cc:260] PREPARE: finished
0928 20:02:50.841644 (+283556us) write_op.cc:270] Start()
0928 20:02:50.841750 (+ 106us) write_op.cc:276] Timestamp: P: 1790625770841540 usec, L: 0
0928 20:02:50.841770 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 20:02:50.842342 (+ 572us) log.cc:844] Serialized 433 byte log entry
0928 20:02:51.018194 (+175852us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.021317 (+ 3123us) write_op.cc:301] APPLY: starting
0928 20:02:51.021384 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.021524 (+ 140us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.021628 (+ 104us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.022081 (+ 453us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.022310 (+ 229us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:51.022362 (+ 52us) write_op.cc:312] APPLY: finished
0928 20:02:51.022570 (+ 208us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.022731 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.022805 (+ 74us) write_op.cc:454] Released schema lock
0928 20:02:51.022848 (+ 43us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.023101 (+ 253us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.023123 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2948,"apply.run_cpu_time_us":1762,"apply.run_wall_time_us":1763,"num_ops":2,"prepare.queue_time_us":113322,"prepare.run_cpu_time_us":2360,"prepare.run_wall_time_us":323864,"raft.queue_time_us":35658,"raft.run_cpu_time_us":741,"raft.run_wall_time_us":741,"replication_time_us":176295}]]}
I20260928 20:02:51.037360 27857 tablet_replica.cc:333] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:51.038178 27857 raft_consensus.cc:2243] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:51.037865 27879 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.038586 27857 raft_consensus.cc:2272] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.040210 27857 ts_tablet_manager.cc:1962] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.040309 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:51.040766 26803 raft_consensus.cc:3060] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:51.042481 26800 raft_consensus.cc:2468] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:51.049633 26803 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:51.050653 26450 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:51.051364 27965 raft_consensus.cc:2804] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:51.055073 26912 ts_tablet_manager.cc:1480] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260928 20:02:51.055962 26912 tablet_bootstrap.cc:492] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:51.059919 27879 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.077561 26232 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_de02ea49d88141cc8f34789367523d0f" } modify_external_catalogs: true
I20260928 20:02:51.078161 26232 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_de02ea49d88141cc8f34789367523d0f" } modify_external_catalogs: true
I20260928 20:02:51.088053 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 28c285483dd7460db934a160c5706d3d (DEFAULT_TABLE table=default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.089102 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c285483dd7460db934a160c5706d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.092156 27879 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.092593 27879 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.094390 27879 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:51.094870 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 323a20314a734279a4af64e8b4f0ff0d (DEFAULT_TABLE table=default.Table_65e7aa358d65483d80d93aab4fbce62a [id=968c4c02a8aa4807b160bc13339e2022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.095803 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323a20314a734279a4af64e8b4f0ff0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.096057 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 323a20314a734279a4af64e8b4f0ff0d (DEFAULT_TABLE table=default.Table_65e7aa358d65483d80d93aab4fbce62a [id=968c4c02a8aa4807b160bc13339e2022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.097220 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 2239c466fa8e471e820173c67bc04cad (DEFAULT_TABLE table=default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.098163 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:51.098412 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 7e09ad691ec3444d938a04a5c572b0cb (DEFAULT_TABLE table=default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:51.099519 26450 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.094870 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 2239c466fa8e471e820173c67bc04cad (DEFAULT_TABLE table=default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.103040 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2239c466fa8e471e820173c67bc04cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.106068 27879 raft_consensus.cc:493] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.106539 27879 raft_consensus.cc:515] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.108407 27879 leader_election.cc:290] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.109022 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 7e09ad691ec3444d938a04a5c572b0cb (DEFAULT_TABLE table=default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.109880 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e09ad691ec3444d938a04a5c572b0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.111258 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:51.113636 26450 leader_election.cc:343] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.115006 27965 raft_consensus.cc:697] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:51.115859 27965 consensus_queue.cc:237] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.123725 26916 tablet_bootstrap.cc:654] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.128628 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 28c285483dd7460db934a160c5706d3d (DEFAULT_TABLE table=default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.130149 26912 tablet_bootstrap.cc:654] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.131978 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd962ebd7d9413e866b0cfee2cd7134 (DEFAULT_TABLE table=default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.136428 27857 ts_tablet_manager.cc:1975] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:51.136655 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 39880ebea60d4712a7e4734b100aeb11 (DEFAULT_TABLE table=default.Table_39b8a2a0083445798ec0e58e3b2db431 [id=c0c669d5c2ab41b1817259de4326ccd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.137760 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd962ebd7d9413e866b0cfee2cd7134 (DEFAULT_TABLE table=default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.152802 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd962ebd7d9413e866b0cfee2cd7134. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:51.155980 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 138458us
I20260928 20:02:51.160778 28015 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:02:51.144299 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 39880ebea60d4712a7e4734b100aeb11 (DEFAULT_TABLE table=default.Table_39b8a2a0083445798ec0e58e3b2db431 [id=c0c669d5c2ab41b1817259de4326ccd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.162068 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39880ebea60d4712a7e4734b100aeb11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.170194 28030 tablet_replica.cc:333] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:51.170622 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd962ebd7d9413e866b0cfee2cd7134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.173687 28030 raft_consensus.cc:2243] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:51.177003 27857 log.cc:1199] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:02:51.178574 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e09ad691ec3444d938a04a5c572b0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.182474 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2239c466fa8e471e820173c67bc04cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.182797 28030 raft_consensus.cc:2272] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.184724 28030 ts_tablet_manager.cc:1962] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.186515 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39880ebea60d4712a7e4734b100aeb11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.202842 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323a20314a734279a4af64e8b4f0ff0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.206404 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c285483dd7460db934a160c5706d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.206552 27857 ts_tablet_manager.cc:1996] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:51.208633 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 329) took 2289 ms. Trace:
I20260928 20:02:51.209064 27857 rpcz_store.cc:276] 0928 20:02:48.919431 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.919536 (+ 105us) service_pool.cc:224] Handling call
0928 20:02:50.996624 (+2077088us) ts_tablet_manager.cc:1197] Deleting tablet 78d5de4a82bd41c1a8b2af2ba7417c46
0928 20:02:51.015226 (+ 18602us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:51.127322 (+112096us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:51.136327 (+ 9005us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:51.208556 (+ 72229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2067771}
I20260928 20:02:51.210640 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 330) took 2237 ms. Trace:
I20260928 20:02:51.210952 27857 rpcz_store.cc:276] 0928 20:02:48.973080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.973201 (+ 121us) service_pool.cc:224] Handling call
0928 20:02:51.210315 (+2237114us) ts_tablet_manager.cc:1197] Deleting tablet d8d27cbf353246fbb7fe09f385194d8a
0928 20:02:51.210368 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:51.210588 (+ 220us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2236627}
I20260928 20:02:51.212074 27857 tablet_replica.cc:333] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:51.213100 27857 raft_consensus.cc:2243] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:51.213661 27857 raft_consensus.cc:2272] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.214586 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 78d5de4a82bd41c1a8b2af2ba7417c46 (table default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]) successfully deleted
W20260928 20:02:51.216799 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet d8d27cbf353246fbb7fe09f385194d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8d27cbf353246fbb7fe09f385194d8a already in progress: creating tablet
I20260928 20:02:51.221542 27857 ts_tablet_manager.cc:1962] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.227650 26916 tablet_bootstrap.cc:492] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:51.228037 26916 ts_tablet_manager.cc:1449] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.193s user 0.008s sys 0.001s
I20260928 20:02:51.228755 26912 tablet_bootstrap.cc:492] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:51.229158 26912 ts_tablet_manager.cc:1449] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.173s user 0.018s sys 0.041s
I20260928 20:02:51.231403 26912 raft_consensus.cc:359] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.232165 26912 raft_consensus.cc:385] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.232404 26912 raft_consensus.cc:740] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.232977 26912 consensus_queue.cc:260] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.241007 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:51.241654 27857 ts_tablet_manager.cc:1975] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:51.242002 27857 log.cc:1199] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4cd2204d99e14a07af962295b152d60f
I20260928 20:02:51.242734 27857 ts_tablet_manager.cc:1996] T 4cd2204d99e14a07af962295b152d60f P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:51.243597 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 333) took 1570 ms. Trace:
I20260928 20:02:51.246718 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b]). Expected version 2 got 0
I20260928 20:02:51.247246 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:51.247726 26912 ts_tablet_manager.cc:1480] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20260928 20:02:51.247875 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:51.243988 27857 rpcz_store.cc:276] 0928 20:02:49.673167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:49.673383 (+ 216us) service_pool.cc:224] Handling call
0928 20:02:51.211901 (+1538518us) ts_tablet_manager.cc:1197] Deleting tablet 4cd2204d99e14a07af962295b152d60f
0928 20:02:51.211950 (+ 49us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:51.234715 (+ 22765us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:51.241557 (+ 6842us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:51.243534 (+ 1977us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1537947}
I20260928 20:02:51.248780 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 4cd2204d99e14a07af962295b152d60f (table default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]) successfully deleted
I20260928 20:02:51.249125 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 334) took 1432 ms. Trace:
I20260928 20:02:51.249604 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:51.249418 27857 rpcz_store.cc:276] 0928 20:02:49.817086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:49.903459 (+ 86373us) service_pool.cc:224] Handling call
0928 20:02:51.248423 (+1344964us) ts_tablet_manager.cc:1197] Deleting tablet 1dde3191a52b4254944ae1f8556e1632
0928 20:02:51.248459 (+ 36us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:51.249074 (+ 615us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1265635}
W20260928 20:02:51.250643 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 1dde3191a52b4254944ae1f8556e1632 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dde3191a52b4254944ae1f8556e1632 already in progress: creating tablet
I20260928 20:02:51.250689 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 335) took 1136 ms. Trace:
I20260928 20:02:51.251080 27857 rpcz_store.cc:276] 0928 20:02:50.114707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:50.114891 (+ 184us) service_pool.cc:224] Handling call
0928 20:02:51.250292 (+1135401us) ts_tablet_manager.cc:1197] Deleting tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6
0928 20:02:51.250342 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:51.250626 (+ 284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1105508}
I20260928 20:02:51.252300 27857 tablet_replica.cc:333] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:02:51.252436 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 already in progress: creating tablet
I20260928 20:02:51.253150 27857 raft_consensus.cc:2243] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:51.253984 27857 raft_consensus.cc:2272] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.257023 27857 ts_tablet_manager.cc:1962] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.259662 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:51.260309 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:51.261339 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:51.261806 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]). Expected version 1 got 0
I20260928 20:02:51.263923 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 309f8fcc50e545178888846ac90afcf2 (DEFAULT_TABLE table=default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.264844 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8fcc50e545178888846ac90afcf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.273195 27965 raft_consensus.cc:493] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.273631 27965 raft_consensus.cc:515] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.274340 26916 raft_consensus.cc:359] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.275183 26916 raft_consensus.cc:385] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.275556 26916 raft_consensus.cc:740] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.275619 27965 leader_election.cc:290] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:51.276226 26916 consensus_queue.cc:260] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.278702 26916 ts_tablet_manager.cc:1480] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.050s user 0.006s sys 0.001s
I20260928 20:02:51.279794 26916 tablet_bootstrap.cc:492] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:51.280321 27857 ts_tablet_manager.cc:1975] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:51.280644 27857 log.cc:1199] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/06e7228a68b84f2aab2bfa582fa25ab8
I20260928 20:02:51.281322 27857 ts_tablet_manager.cc:1996] T 06e7228a68b84f2aab2bfa582fa25ab8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:51.282589 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 06e7228a68b84f2aab2bfa582fa25ab8 (table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]) successfully deleted
I20260928 20:02:51.289228 27676 consensus_queue.cc:1048] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.133s
I20260928 20:02:51.266611 26912 tablet_bootstrap.cc:492] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:51.266026 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 309f8fcc50e545178888846ac90afcf2 (DEFAULT_TABLE table=default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.293257 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8fcc50e545178888846ac90afcf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.296864 28030 ts_tablet_manager.cc:1975] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:51.297199 28030 log.cc:1199] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/06e7228a68b84f2aab2bfa582fa25ab8
I20260928 20:02:51.297809 26912 tablet_bootstrap.cc:654] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.297909 28030 ts_tablet_manager.cc:1996] T 06e7228a68b84f2aab2bfa582fa25ab8 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:51.288663 27759 leader_election.cc:290] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:51.312645 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 06e7228a68b84f2aab2bfa582fa25ab8 (table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]) successfully deleted
I20260928 20:02:51.325482 28015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Bootstrap starting.
I20260928 20:02:51.326077 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:51.328753 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:51.332489 26912 tablet_bootstrap.cc:492] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:51.332906 26912 ts_tablet_manager.cc:1449] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.067s user 0.018s sys 0.011s
I20260928 20:02:51.335242 26912 raft_consensus.cc:359] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.335860 26912 raft_consensus.cc:385] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.336107 26912 raft_consensus.cc:740] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.336666 26912 consensus_queue.cc:260] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.339689 26912 ts_tablet_manager.cc:1480] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260928 20:02:51.340513 26912 tablet_bootstrap.cc:492] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:51.341723 26913 tablet_bootstrap.cc:654] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.346374 27907 consensus_queue.cc:1048] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:51.346576 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:51.347280 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:51.347937 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:51.348565 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:51.349884 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:51.350443 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:02:51.350960 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]). Expected version 1 got 0
I20260928 20:02:51.346019 26912 tablet_bootstrap.cc:654] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.320425 28000 raft_consensus.cc:515] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.354048 28000 leader_election.cc:290] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:51.361425 26916 tablet_bootstrap.cc:654] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.370798 26230 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 356) took 1841 ms. Trace:
I20260928 20:02:51.371102 26230 rpcz_store.cc:276] 0928 20:02:49.529833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:49.530361 (+ 528us) service_pool.cc:224] Handling call
0928 20:02:49.531617 (+ 1256us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:49.532479 (+ 862us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:49.533167 (+ 688us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:49.533406 (+ 239us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:50.423101 (+889695us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:51.370725 (+947624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:50.348029 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:50.348477 (+ 448us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:50.348504 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:50.348519 (+ 15us) tablet.cc:662] Decoding operations
0928 20:02:50.348815 (+ 296us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:50.348861 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:50.348889 (+ 28us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:50.349087 (+ 198us) tablet.cc:701] Row locks acquired
0928 20:02:50.349104 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:02:50.349216 (+ 112us) write_op.cc:270] Start()
0928 20:02:50.349309 (+ 93us) write_op.cc:276] Timestamp: P: 1790625770349173 usec, L: 0
0928 20:02:50.349329 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 20:02:50.349874 (+ 545us) log.cc:844] Serialized 405 byte log entry
0928 20:02:50.420834 (+ 70960us) op_driver.cc:464] REPLICATION: finished
0928 20:02:50.421655 (+ 821us) write_op.cc:301] APPLY: starting
0928 20:02:50.421711 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:50.421801 (+ 90us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:50.421886 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:50.422047 (+ 161us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:50.422186 (+ 139us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:50.422233 (+ 47us) write_op.cc:312] APPLY: finished
0928 20:02:50.422402 (+ 169us) log.cc:844] Serialized 23 byte log entry
0928 20:02:50.422547 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.422605 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:50.422635 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:50.422853 (+ 218us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.422876 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":675,"apply.run_cpu_time_us":1166,"apply.run_wall_time_us":1166,"num_ops":1,"prepare.queue_time_us":811243,"prepare.run_cpu_time_us":2261,"prepare.run_wall_time_us":62322,"raft.queue_time_us":104,"raft.run_cpu_time_us":705,"raft.run_wall_time_us":706,"replication_time_us":71411}]]}
I20260928 20:02:51.374881 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet b059111d6383414890a28c2947934dd8 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:51.375263 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:51.276685 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:51.379172 26450 leader_election.cc:343] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.395398 27907 raft_consensus.cc:493] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.395855 27907 raft_consensus.cc:515] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.398963 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b059111d6383414890a28c2947934dd8
I20260928 20:02:51.401057 26230 catalog_manager.cc:6934] ReplaceTablet: tablet b059111d6383414890a28c2947934dd8 deleted and replaced by tablet eb02b1f6bf4e43a08a3331438bf8e362
I20260928 20:02:51.401444 26230 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:40138 (request call id 363) took 1344 ms. Trace:
I20260928 20:02:51.402439 27965 raft_consensus.cc:493] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.402910 27965 raft_consensus.cc:515] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.401782 26230 rpcz_store.cc:276] 0928 20:02:50.057059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.374781 (+1317722us) service_pool.cc:224] Handling call
0928 20:02:51.401395 (+ 26614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.377923 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.378408 (+ 485us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.378434 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:51.378453 (+ 19us) tablet.cc:662] Decoding operations
0928 20:02:51.378768 (+ 315us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.378807 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.378834 (+ 27us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:51.379049 (+ 215us) tablet.cc:701] Row locks acquired
0928 20:02:51.379064 (+ 15us) write_op.cc:260] PREPARE: finished
0928 20:02:51.379181 (+ 117us) write_op.cc:270] Start()
0928 20:02:51.379274 (+ 93us) write_op.cc:276] Timestamp: P: 1790625771379146 usec, L: 0
0928 20:02:51.379292 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.379776 (+ 484us) log.cc:844] Serialized 665 byte log entry
0928 20:02:51.390743 (+ 10967us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.391054 (+ 311us) write_op.cc:301] APPLY: starting
0928 20:02:51.391106 (+ 52us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.391209 (+ 103us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.391306 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.391632 (+ 326us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.391814 (+ 182us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:51.391854 (+ 40us) write_op.cc:312] APPLY: finished
0928 20:02:51.392018 (+ 164us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.392155 (+ 137us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.392223 (+ 68us) write_op.cc:454] Released schema lock
0928 20:02:51.392253 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.392466 (+ 213us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.392490 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":182,"apply.run_cpu_time_us":1374,"apply.run_wall_time_us":1373,"num_ops":2,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":2153,"prepare.run_wall_time_us":2153,"raft.queue_time_us":1184,"raft.run_cpu_time_us":640,"raft.run_wall_time_us":636,"replication_time_us":11362}]]}
I20260928 20:02:51.404848 27965 leader_election.cc:290] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.404965 26912 tablet_bootstrap.cc:492] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:51.405351 26912 ts_tablet_manager.cc:1449] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.006s
I20260928 20:02:51.405845 27907 leader_election.cc:290] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:51.407825 26912 raft_consensus.cc:359] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.408424 26912 raft_consensus.cc:385] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.408660 26912 raft_consensus.cc:740] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:02:51.409083 26740 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5
I20260928 20:02:51.409226 26912 consensus_queue.cc:260] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.410987 27965 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.411041 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet b059111d6383414890a28c2947934dd8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb02b1f6bf4e43a08a3331438bf8e362) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.411566 26912 ts_tablet_manager.cc:1480] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260928 20:02:51.411741 27965 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.413746 27857 tablet_replica.cc:333] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:51.414518 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:51.415900 26450 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.415953 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.416877 27965 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.417934 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb8477c5cb74205b4b55eb38d7f9542" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:51.418143 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.418895 26658 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
W20260928 20:02:51.419277 26450 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.422339 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fbfbe10e93f741f486e85860be3887b9" } new_table_name: "default.Table_21a9c8b591bd46a595f6762efcdb8a58" modify_external_catalogs: true
I20260928 20:02:51.423064 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:51.423552 26657 raft_consensus.cc:3060] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:51.425019 26913 tablet_bootstrap.cc:492] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:51.425232 26916 tablet_bootstrap.cc:492] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:51.425619 26916 ts_tablet_manager.cc:1449] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.146s user 0.006s sys 0.004s
I20260928 20:02:51.425416 26913 ts_tablet_manager.cc:1449] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.667s user 0.003s sys 0.010s
I20260928 20:02:51.428323 26916 raft_consensus.cc:359] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.428995 26916 raft_consensus.cc:385] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.429258 26916 raft_consensus.cc:740] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.429915 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet b059111d6383414890a28c2947934dd8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb02b1f6bf4e43a08a3331438bf8e362) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:51.432644 26657 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:51.433449 28030 tablet_replica.cc:333] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:51.434388 28030 raft_consensus.cc:2243] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:51.434901 28030 raft_consensus.cc:2272] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.434825 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.436060 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.436962 28030 ts_tablet_manager.cc:1962] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.436841 26594 leader_election.cc:304] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:51.437588 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.448163 26913 raft_consensus.cc:359] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:51.448679 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb8477c5cb74205b4b55eb38d7f9542" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:51.453703 26450 leader_election.cc:343] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.454088 26450 leader_election.cc:304] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:51.429529 26235 catalog_manager.cc:5838] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:51.454982 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:51.455662 28031 raft_consensus.cc:2749] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:51.458161 26235 catalog_manager.cc:5838] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:51.461683 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:51.464654 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:51.466804 28035 raft_consensus.cc:2804] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:51.466120 26235 catalog_manager.cc:5838] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:51.467617 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:51.468644 26235 catalog_manager.cc:5838] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:51.469772 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:51.469403 28000 raft_consensus.cc:493] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.471123 26236 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228] alter complete (version 2)
I20260928 20:02:51.471925 26232 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 8f5ee801a9354a858356fb4e055a1863
I20260928 20:02:51.470274 28000 raft_consensus.cc:515] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:51.473316 26232 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 362) took 1429 ms. Trace:
I20260928 20:02:51.477337 28000 leader_election.cc:290] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:51.477681 26230 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 364) took 1389 ms. Trace:
I20260928 20:02:51.477837 28035 raft_consensus.cc:697] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:51.478987 28035 consensus_queue.cc:237] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.477977 26230 rpcz_store.cc:276] 0928 20:02:50.087863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.422014 (+1334151us) service_pool.cc:224] Handling call
0928 20:02:51.441590 (+ 19576us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:51.454407 (+ 12817us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:51.455846 (+ 1439us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:51.456045 (+ 199us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:51.476525 (+ 20480us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:51.477628 (+ 1103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.459608 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.460059 (+ 451us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.460086 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:51.460099 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:51.460549 (+ 450us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.460599 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.460624 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:51.461249 (+ 625us) tablet.cc:701] Row locks acquired
0928 20:02:51.461267 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:02:51.461380 (+ 113us) write_op.cc:270] Start()
0928 20:02:51.461476 (+ 96us) write_op.cc:276] Timestamp: P: 1790625771461338 usec, L: 0
0928 20:02:51.461492 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.461976 (+ 484us) log.cc:844] Serialized 405 byte log entry
0928 20:02:51.471579 (+ 9603us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.474280 (+ 2701us) write_op.cc:301] APPLY: starting
0928 20:02:51.474334 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.474428 (+ 94us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.474529 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.474704 (+ 175us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.474829 (+ 125us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:51.474869 (+ 40us) write_op.cc:312] APPLY: finished
0928 20:02:51.475027 (+ 158us) log.cc:844] Serialized 23 byte log entry
0928 20:02:51.475166 (+ 139us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.475219 (+ 53us) write_op.cc:454] Released schema lock
0928 20:02:51.475250 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.475486 (+ 236us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.475510 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2559,"apply.run_cpu_time_us":1164,"apply.run_wall_time_us":1165,"num_ops":1,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":2686,"prepare.run_wall_time_us":9420,"raft.queue_time_us":89,"raft.run_cpu_time_us":608,"raft.run_wall_time_us":608,"replication_time_us":10007}]]}
I20260928 20:02:51.484922 26912 tablet_bootstrap.cc:492] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:51.486333 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_afc7904735e94895aa832ee117628bac" } modify_external_catalogs: true
I20260928 20:02:51.490880 26912 tablet_bootstrap.cc:654] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.496863 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_afc7904735e94895aa832ee117628bac" } modify_external_catalogs: true
I20260928 20:02:51.504281 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5ee801a9354a858356fb4e055a1863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:51.514829 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 355637us
I20260928 20:02:51.470355 26916 consensus_queue.cc:260] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.483258 27857 raft_consensus.cc:2243] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:51.502678 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5ee801a9354a858356fb4e055a1863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.526973 27857 raft_consensus.cc:2272] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.527660 26916 ts_tablet_manager.cc:1480] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.102s user 0.006s sys 0.001s
I20260928 20:02:51.528528 26916 tablet_bootstrap.cc:492] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:51.529358 27857 ts_tablet_manager.cc:1962] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.542209 28030 ts_tablet_manager.cc:1975] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:51.473611 26232 rpcz_store.cc:276] 0928 20:02:50.043867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.049547 (+1005680us) service_pool.cc:224] Handling call
0928 20:02:51.077425 (+ 27878us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:51.078746 (+ 1321us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:51.080237 (+ 1491us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:51.080362 (+ 125us) catalog_manager.cc:2863] Locking tablets
0928 20:02:51.129848 (+ 49486us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:51.146784 (+ 16936us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:51.150223 (+ 3439us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:51.471843 (+321620us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:51.473259 (+ 1416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.131708 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.132146 (+ 438us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.132174 (+ 28us) write_op.cc:435] Acquired schema lock
0928 20:02:51.132190 (+ 16us) tablet.cc:662] Decoding operations
0928 20:02:51.132551 (+ 361us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.132597 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.132620 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:51.132892 (+ 272us) tablet.cc:701] Row locks acquired
0928 20:02:51.132905 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:51.133018 (+ 113us) write_op.cc:270] Start()
0928 20:02:51.133104 (+ 86us) write_op.cc:276] Timestamp: P: 1790625771132953 usec, L: 0
0928 20:02:51.133118 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.133602 (+ 484us) log.cc:844] Serialized 768 byte log entry
0928 20:02:51.143126 (+ 9524us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.143362 (+ 236us) write_op.cc:301] APPLY: starting
0928 20:02:51.143416 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.143520 (+ 104us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.143598 (+ 78us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.143815 (+ 217us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.143967 (+ 152us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:51.144014 (+ 47us) write_op.cc:312] APPLY: finished
0928 20:02:51.144179 (+ 165us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.144313 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.144375 (+ 62us) write_op.cc:454] Released schema lock
0928 20:02:51.144410 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.144609 (+ 199us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.144632 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":62504192,"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":1222,"apply.run_wall_time_us":1223,"num_ops":2,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":2199,"prepare.run_wall_time_us":3311,"raft.queue_time_us":507,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":562,"replication_time_us":9927}]]}
I20260928 20:02:51.542601 28030 log.cc:1199] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b059111d6383414890a28c2947934dd8
I20260928 20:02:51.543375 28030 ts_tablet_manager.cc:1996] T b059111d6383414890a28c2947934dd8 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:51.544283 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_58732efb3f0e459c8af18aac5919b612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:51.544767 28030 tablet_replica.cc:333] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:02:51.546092 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58732efb3f0e459c8af18aac5919b612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:51.554875 28030 raft_consensus.cc:2243] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:51.556063 26234 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440] alter complete (version 1)
I20260928 20:02:51.557713 26233 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_c381dba3a9c141fe9a2aa9dfec973fbd [id=0c98275433a24292b35617002df2cf6b] alter complete (version 2)
W20260928 20:02:51.582134 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 66572.4us
W20260928 20:02:51.582914 26595 consensus_peers.cc:597] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d0308d824cf401c8cca0cf7a950fd53. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:51.584244 26236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 58) took 2807 ms (client timeout 1000 ms). Trace:
W20260928 20:02:51.584664 26236 rpcz_store.cc:269] 0928 20:02:48.776886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.790362 (+ 13476us) service_pool.cc:224] Handling call
0928 20:02:51.584174 (+2793812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:50.116731 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:50.142224 (+ 25493us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:50.142259 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:02:50.142274 (+ 15us) tablet.cc:662] Decoding operations
0928 20:02:50.143490 (+ 1216us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:50.143538 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:50.143564 (+ 26us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:50.143734 (+ 170us) tablet.cc:701] Row locks acquired
0928 20:02:50.143751 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:02:50.143868 (+ 117us) write_op.cc:270] Start()
0928 20:02:50.143971 (+ 103us) write_op.cc:276] Timestamp: P: 1790625770143800 usec, L: 0
0928 20:02:50.143990 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:02:50.235077 (+ 91087us) log.cc:844] Serialized 356 byte log entry
0928 20:02:50.244070 (+ 8993us) op_driver.cc:464] REPLICATION: finished
0928 20:02:50.244303 (+ 233us) write_op.cc:301] APPLY: starting
0928 20:02:50.244361 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:50.244463 (+ 102us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:50.244549 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:50.244710 (+ 161us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:50.244835 (+ 125us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:50.244876 (+ 41us) write_op.cc:312] APPLY: finished
0928 20:02:50.245041 (+ 165us) log.cc:844] Serialized 23 byte log entry
0928 20:02:50.245179 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.245240 (+ 61us) write_op.cc:454] Released schema lock
0928 20:02:50.245294 (+ 54us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:50.250640 (+ 5346us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.250674 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8083,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":1179,"apply.run_wall_time_us":1179,"num_ops":1,"prepare.queue_time_us":676490,"prepare.run_cpu_time_us":2574,"prepare.run_wall_time_us":135140,"raft.queue_time_us":90,"raft.run_cpu_time_us":749,"raft.run_wall_time_us":832,"replication_time_us":99981}]]}
W20260928 20:02:51.591873 26595 leader_election.cc:343] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1edf314241784091a603907a43429b28
W20260928 20:02:51.619894 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 166199us
W20260928 20:02:51.620584 26450 leader_election.cc:343] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.620957 26450 leader_election.cc:304] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:51.627449 28048 raft_consensus.cc:2749] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:51.628309 27965 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.628894 27965 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.631165 27965 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.592855 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:02:51.634697 26230 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 365) took 1316 ms. Trace:
I20260928 20:02:51.448865 26913 raft_consensus.cc:385] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.449457 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.639532 26913 raft_consensus.cc:740] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.640174 26913 consensus_queue.cc:260] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:51.634994 26230 rpcz_store.cc:276] 0928 20:02:50.318000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.486042 (+1168042us) service_pool.cc:224] Handling call
0928 20:02:51.497410 (+ 11368us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:51.497894 (+ 484us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:51.497994 (+ 100us) catalog_manager.cc:2863] Locking tablets
0928 20:02:51.498509 (+ 515us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:51.590168 (+ 91659us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:51.590357 (+ 189us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:51.592444 (+ 2087us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:51.634638 (+ 42194us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.505606 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.506031 (+ 425us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.506055 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:51.506071 (+ 16us) tablet.cc:662] Decoding operations
0928 20:02:51.506417 (+ 346us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.506458 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.506482 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:51.506771 (+ 289us) tablet.cc:701] Row locks acquired
0928 20:02:51.506787 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:51.506893 (+ 106us) write_op.cc:270] Start()
0928 20:02:51.506981 (+ 88us) write_op.cc:276] Timestamp: P: 1790625771506851 usec, L: 0
0928 20:02:51.506999 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.508567 (+ 1568us) log.cc:844] Serialized 734 byte log entry
0928 20:02:51.587969 (+ 79402us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.588515 (+ 546us) write_op.cc:301] APPLY: starting
0928 20:02:51.588572 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.588675 (+ 103us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.588811 (+ 136us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.589064 (+ 253us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.589208 (+ 144us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:51.589251 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:51.589422 (+ 171us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.589551 (+ 129us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.589610 (+ 59us) write_op.cc:454] Released schema lock
0928 20:02:51.589638 (+ 28us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.589847 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.589871 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":317,"apply.run_cpu_time_us":1340,"apply.run_wall_time_us":1341,"num_ops":2,"prepare.queue_time_us":5565,"prepare.run_cpu_time_us":2508,"prepare.run_wall_time_us":3137,"replication_time_us":80883}]]}
I20260928 20:02:51.642515 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.643111 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6393d0583a9a47ec9eb455b30a548fc3) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.643026 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_05c17087f17c40ccaef5290a60a1234d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:51.643702 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:51.644448 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05c17087f17c40ccaef5290a60a1234d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:51.645004 26595 leader_election.cc:343] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ee4c267b42754dbca8eb5ebec2d66a23
W20260928 20:02:51.598728 26227 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 59) took 1767 ms (client timeout 1000 ms). Trace:
W20260928 20:02:51.645511 26227 rpcz_store.cc:269] 0928 20:02:49.831123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:49.882117 (+ 50994us) service_pool.cc:224] Handling call
0928 20:02:49.914526 (+ 32409us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:51.598666 (+1684140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24905,"reported_tablets":22,"spinlock_wait_cycles":65254272}
I20260928 20:02:51.646986 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c6e3b12edab441c89f9e255a1a1a001c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:51.648499 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6e3b12edab441c89f9e255a1a1a001c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:51.601656 26228 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 60) took 2842 ms (client timeout 1000 ms). Trace:
W20260928 20:02:51.651374 26228 rpcz_store.cc:269] 0928 20:02:48.759127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.777494 (+ 18367us) service_pool.cc:224] Handling call
0928 20:02:51.601592 (+2824098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:50.250962 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:50.251471 (+ 509us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:50.251503 (+ 32us) write_op.cc:435] Acquired schema lock
0928 20:02:50.251523 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:50.251820 (+ 297us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:50.251872 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:50.251902 (+ 30us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:50.252099 (+ 197us) tablet.cc:701] Row locks acquired
0928 20:02:50.252115 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:50.252239 (+ 124us) write_op.cc:270] Start()
0928 20:02:50.252333 (+ 94us) write_op.cc:276] Timestamp: P: 1790625770252163 usec, L: 0
0928 20:02:50.252351 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:50.252906 (+ 555us) log.cc:844] Serialized 536 byte log entry
0928 20:02:50.272852 (+ 19946us) op_driver.cc:464] REPLICATION: finished
0928 20:02:50.273344 (+ 492us) write_op.cc:301] APPLY: starting
0928 20:02:50.273409 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:50.273510 (+ 101us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:50.273614 (+ 104us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:50.273813 (+ 199us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:50.273965 (+ 152us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:50.274017 (+ 52us) write_op.cc:312] APPLY: finished
0928 20:02:50.274234 (+ 217us) log.cc:844] Serialized 23 byte log entry
0928 20:02:50.274383 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.274455 (+ 72us) write_op.cc:454] Released schema lock
0928 20:02:50.274491 (+ 36us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:50.347462 (+ 72971us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.347493 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8865,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":335,"apply.run_cpu_time_us":1344,"apply.run_wall_time_us":1344,"num_ops":1,"prepare.queue_time_us":767125,"prepare.run_cpu_time_us":2329,"prepare.run_wall_time_us":96483,"raft.queue_time_us":101,"raft.run_cpu_time_us":694,"raft.run_wall_time_us":694,"replication_time_us":20386}]]}
W20260928 20:02:51.612780 26234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 61) took 1797 ms (client timeout 1000 ms). Trace:
I20260928 20:02:51.546834 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet b059111d6383414890a28c2947934dd8 (table default.Table_f55cc836b1a4436baefce92d942dc0ba [id=adee36b5ad4b4575a43039f4666dbb10]) successfully deleted
W20260928 20:02:51.656369 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 109558us
W20260928 20:02:51.622031 26450 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.657398 26450 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:51.658772 28048 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:51.661229 26913 ts_tablet_manager.cc:1480] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.232s user 0.006s sys 0.000s
I20260928 20:02:51.662150 26913 tablet_bootstrap.cc:492] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:51.663743 27676 raft_consensus.cc:493] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.664103 27676 raft_consensus.cc:515] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:51.665702 27676 leader_election.cc:290] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:51.665781 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 43774.9us
W20260928 20:02:51.666623 26450 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.666982 26450 leader_election.cc:304] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:51.670921 27857 ts_tablet_manager.cc:1975] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:51.671272 27857 log.cc:1199] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b059111d6383414890a28c2947934dd8
I20260928 20:02:51.671939 27857 ts_tablet_manager.cc:1996] T b059111d6383414890a28c2947934dd8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
W20260928 20:02:51.663277 26234 rpcz_store.cc:269] 0928 20:02:49.815249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:49.842441 (+ 27192us) service_pool.cc:224] Handling call
0928 20:02:51.612716 (+1770275us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:50.554714 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:50.555217 (+ 503us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:50.555254 (+ 37us) write_op.cc:435] Acquired schema lock
0928 20:02:50.555270 (+ 16us) tablet.cc:662] Decoding operations
0928 20:02:50.555571 (+ 301us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:50.555617 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:50.555645 (+ 28us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:50.555809 (+ 164us) tablet.cc:701] Row locks acquired
0928 20:02:50.555820 (+ 11us) write_op.cc:260] PREPARE: finished
0928 20:02:50.555948 (+ 128us) write_op.cc:270] Start()
0928 20:02:50.556053 (+ 105us) write_op.cc:276] Timestamp: P: 1790625770555882 usec, L: 0
0928 20:02:50.556070 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:50.556615 (+ 545us) log.cc:844] Serialized 536 byte log entry
0928 20:02:50.571243 (+ 14628us) op_driver.cc:464] REPLICATION: finished
0928 20:02:50.571658 (+ 415us) write_op.cc:301] APPLY: starting
0928 20:02:50.571714 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:50.571805 (+ 91us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:50.571892 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:50.572050 (+ 158us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:50.572168 (+ 118us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:50.572210 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:50.572387 (+ 177us) log.cc:844] Serialized 23 byte log entry
0928 20:02:50.572522 (+ 135us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.572578 (+ 56us) write_op.cc:454] Released schema lock
0928 20:02:50.572606 (+ 28us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:50.572825 (+ 219us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:50.572851 (+ 26us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 20:02:51.498807 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.499277 (+ 470us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.499303 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:51.499318 (+ 15us) tablet.cc:662] Decoding operations
0928 20:02:51.499595 (+ 277us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.499634 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.499660 (+ 26us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:51.499821 (+ 161us) tablet.cc:701] Row locks acquired
0928 20:02:51.499836 (+ 15us) write_op.cc:260] PREPARE: finished
0928 20:02:51.499961 (+ 125us) write_op.cc:270] Start()
0928 20:02:51.500049 (+ 88us) write_op.cc:276] Timestamp: P: 1790625771499899 usec, L: 0
0928 20:02:51.500065 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.500562 (+ 497us) log.cc:844] Serialized 356 byte log entry
0928 20:02:51.554151 (+ 53589us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.554770 (+ 619us) write_op.cc:301] APPLY: starting
0928 20:02:51.554840 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.554928 (+ 88us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.555018 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.555210 (+ 192us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.555325 (+ 115us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:51.555369 (+ 44us) write_op.cc:312] APPLY: finished
0928 20:02:51.555547 (+ 178us) log.cc:844] Serialized 23 byte log entry
0928 20:02:51.555694 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.555749 (+ 55us) write_op.cc:454] Released schema lock
0928 20:02:51.555783 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.556009 (+ 226us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.556030 (+ 21us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":1129,"apply.run_wall_time_us":1128,"num_ops":1,"prepare.queue_time_us":170260,"prepare.run_cpu_time_us":2194,"prepare.run_wall_time_us":2194,"raft.queue_time_us":361,"raft.run_cpu_time_us":591,"raft.run_wall_time_us":8602,"replication_time_us":15074}],["op",{"apply.queue_time_us":470,"apply.run_cpu_time_us":1206,"apply.run_wall_time_us":1206,"num_ops":1,"prepare.queue_time_us":9212,"prepare.run_cpu_time_us":1966,"prepare.run_wall_time_us":1966,"replication_time_us":53984}]]}
I20260928 20:02:51.553972 26916 tablet_bootstrap.cc:654] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.694875 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6393d0583a9a47ec9eb455b30a548fc3) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:51.699491 27857 tablet_replica.cc:333] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:51.700304 27857 raft_consensus.cc:2243] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:51.582057 27907 raft_consensus.cc:493] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.702435 28030 raft_consensus.cc:2272] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.702360 27907 raft_consensus.cc:515] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.702919 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 28c285483dd7460db934a160c5706d3d (DEFAULT_TABLE table=default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.704487 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 323a20314a734279a4af64e8b4f0ff0d (DEFAULT_TABLE table=default.Table_65e7aa358d65483d80d93aab4fbce62a [id=968c4c02a8aa4807b160bc13339e2022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.704739 27907 leader_election.cc:290] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:51.617380 26912 tablet_bootstrap.cc:492] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:51.705439 26912 ts_tablet_manager.cc:1449] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.293s user 0.016s sys 0.003s
I20260928 20:02:51.706149 28030 ts_tablet_manager.cc:1962] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.706871 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 7e09ad691ec3444d938a04a5c572b0cb (DEFAULT_TABLE table=default.Table_aea43c3f34b8444484b021f67a963b41 [id=a08b15bce53c4223a8f7731b98bf02e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.707695 26912 raft_consensus.cc:359] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.708328 26912 raft_consensus.cc:385] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.708562 26912 raft_consensus.cc:740] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.708647 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd962ebd7d9413e866b0cfee2cd7134 (DEFAULT_TABLE table=default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.709112 26912 consensus_queue.cc:260] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.709894 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 39880ebea60d4712a7e4734b100aeb11 (DEFAULT_TABLE table=default.Table_39b8a2a0083445798ec0e58e3b2db431 [id=c0c669d5c2ab41b1817259de4326ccd0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:51.632365 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 181221us
I20260928 20:02:51.633147 27986 raft_consensus.cc:493] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.711089 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 309f8fcc50e545178888846ac90afcf2 (DEFAULT_TABLE table=default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.660797 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:51.661216 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:51.662372 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:51.706041 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 2239c466fa8e471e820173c67bc04cad (DEFAULT_TABLE table=default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.662644 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:51.712982 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c285483dd7460db934a160c5706d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.711537 27986 raft_consensus.cc:515] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.714680 27986 leader_election.cc:290] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:51.715713 26739 consensus_peers.cc:597] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:51.716413 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309f8fcc50e545178888846ac90afcf2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:51.716573 26739 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.716912 26739 leader_election.cc:304] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:51.717824 26739 consensus_peers.cc:597] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:51.718508 27984 raft_consensus.cc:2749] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:51.720969 26740 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f
I20260928 20:02:51.629511 28015 log.cc:826] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Log is configured to *not* fsync() on all Append() calls
I20260928 20:02:51.722090 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:51.722663 26513 raft_consensus.cc:2468] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:51.724061 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323a20314a734279a4af64e8b4f0ff0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.727805 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd962ebd7d9413e866b0cfee2cd7134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.730583 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39880ebea60d4712a7e4734b100aeb11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.734604 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2239c466fa8e471e820173c67bc04cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:51.738678 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e09ad691ec3444d938a04a5c572b0cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:51.740195 26233 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1d945be7bea449ba8c5541b60eb18334 consensus state has no leader
I20260928 20:02:51.743620 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:51.748822 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 76) took 3750 ms (client timeout 1000 ms). Trace:
W20260928 20:02:51.749188 26231 rpcz_store.cc:269] 0928 20:02:47.998010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:48.527078 (+529068us) service_pool.cc:224] Handling call
0928 20:02:51.748750 (+3221672us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":50}
I20260928 20:02:51.759678 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:51.765003 26916 tablet_bootstrap.cc:492] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:51.765525 26916 ts_tablet_manager.cc:1449] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.237s user 0.010s sys 0.007s
I20260928 20:02:51.770628 26912 ts_tablet_manager.cc:1480] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.065s user 0.006s sys 0.000s
I20260928 20:02:51.746073 26740 leader_election.cc:304] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:51.786743 27965 raft_consensus.cc:2749] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:51.787671 27857 raft_consensus.cc:2272] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:51.789558 27857 ts_tablet_manager.cc:1962] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:51.793740 26916 raft_consensus.cc:359] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:51.794425 26916 raft_consensus.cc:385] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.794672 26916 raft_consensus.cc:740] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.795264 26916 consensus_queue.cc:260] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:51.796640 26916 ts_tablet_manager.cc:1480] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.031s user 0.001s sys 0.002s
W20260928 20:02:51.797149 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 130541us
W20260928 20:02:51.798053 26450 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.800251 26450 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:51.801792 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.802012 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d7ab92a37c4f9b865fa9fe49d46916" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:51.802413 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b91a573103c4c2d995abde8db91b821 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.802980 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.803551 28048 raft_consensus.cc:2749] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:51.803666 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.804358 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.807104 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.807826 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.809108 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd2204d99e14a07af962295b152d60f with delete_type TABLET_DATA_DELETED (replaced by tablet e8de132c03884597a311898f4d427bb1) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.813261 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet b059111d6383414890a28c2947934dd8 (table default.Table_f55cc836b1a4436baefce92d942dc0ba [id=adee36b5ad4b4575a43039f4666dbb10]) successfully deleted
I20260928 20:02:51.655764 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8543155fabf44da1970cceef9f13d261"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:51.818531 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8543155fabf44da1970cceef9f13d261 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:51.819082 27857 ts_tablet_manager.cc:1975] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:51.820554 26231 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e4aa863223cc477b9b0ce2f8de2397d9" } new_table_name: "default.Table_4ccceaec1fcb44bc83bc6823e8fb60db" modify_external_catalogs: true
I20260928 20:02:51.821811 27965 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.822225 27965 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.822649 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_31b3759a2ab04669a085898c9806347b" } modify_external_catalogs: true
I20260928 20:02:51.823200 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_31b3759a2ab04669a085898c9806347b" } modify_external_catalogs: true
I20260928 20:02:51.824182 27965 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.824183 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f77e79769ec14ab0ace5b45b517ec34d" } new_table_name: "default.Table_8da8f7658ee04ba6ab55c0854954b591" modify_external_catalogs: true
I20260928 20:02:51.824749 27857 log.cc:1199] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/8f5ee801a9354a858356fb4e055a1863
I20260928 20:02:51.825570 27857 ts_tablet_manager.cc:1996] T 8f5ee801a9354a858356fb4e055a1863 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
W20260928 20:02:51.839004 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 78) took 2579 ms (client timeout 1000 ms). Trace:
W20260928 20:02:51.839372 26233 rpcz_store.cc:269] 0928 20:02:49.259840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:49.325909 (+ 66069us) service_pool.cc:224] Handling call
0928 20:02:51.838827 (+2512918us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.500887 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.501309 (+ 422us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.501335 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:51.501352 (+ 17us) tablet.cc:662] Decoding operations
0928 20:02:51.501598 (+ 246us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.501638 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.501660 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:51.501808 (+ 148us) tablet.cc:701] Row locks acquired
0928 20:02:51.501820 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:51.501918 (+ 98us) write_op.cc:270] Start()
0928 20:02:51.502015 (+ 97us) write_op.cc:276] Timestamp: P: 1790625771501878 usec, L: 0
0928 20:02:51.502028 (+ 13us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.505276 (+ 3248us) log.cc:844] Serialized 356 byte log entry
0928 20:02:51.554366 (+ 49090us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.556244 (+ 1878us) write_op.cc:301] APPLY: starting
0928 20:02:51.556295 (+ 51us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.556388 (+ 93us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.556601 (+ 213us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.556744 (+ 143us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.556875 (+ 131us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:51.556920 (+ 45us) write_op.cc:312] APPLY: finished
0928 20:02:51.557073 (+ 153us) log.cc:844] Serialized 23 byte log entry
0928 20:02:51.557184 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.557234 (+ 50us) write_op.cc:454] Released schema lock
0928 20:02:51.557266 (+ 32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":1768,"apply.run_cpu_time_us":1185,"apply.run_wall_time_us":1185,"num_ops":1,"prepare.queue_time_us":2197,"prepare.run_cpu_time_us":1885,"prepare.run_wall_time_us":4585,"replication_time_us":52266,"thread_start_us":33190,"threads_started":1}]]}
I20260928 20:02:51.844856 26916 tablet_bootstrap.cc:492] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:51.850576 26912 tablet_bootstrap.cc:492] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:51.863451 27965 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:51.863574 26450 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.863879 27965 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.865301 27857 tablet_replica.cc:333] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:51.865684 27965 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.883456 26916 tablet_bootstrap.cc:654] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:51.893841 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c267b42754dbca8eb5ebec2d66a23" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:51.894526 26804 raft_consensus.cc:3060] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:51.772042 27984 raft_consensus.cc:493] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.899295 26232 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 366) took 1256 ms. Trace:
I20260928 20:02:51.899401 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:51.899649 26232 rpcz_store.cc:276] 0928 20:02:50.642795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.543921 (+901126us) service_pool.cc:224] Handling call
0928 20:02:51.550896 (+ 6975us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:51.552518 (+ 1622us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:51.898335 (+345817us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:51.898690 (+ 355us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:51.899107 (+ 417us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.610702 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.611149 (+ 447us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.611176 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:51.611196 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:51.611508 (+ 312us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.611551 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.611580 (+ 29us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:51.611971 (+ 391us) tablet.cc:701] Row locks acquired
0928 20:02:51.611989 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:02:51.612117 (+ 128us) write_op.cc:270] Start()
0928 20:02:51.612205 (+ 88us) write_op.cc:276] Timestamp: P: 1790625771612060 usec, L: 0
0928 20:02:51.612221 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.612716 (+ 495us) log.cc:844] Serialized 433 byte log entry
0928 20:02:51.879220 (+266504us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.893439 (+ 14219us) write_op.cc:301] APPLY: starting
0928 20:02:51.893521 (+ 82us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.893640 (+ 119us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.893751 (+ 111us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.894232 (+ 481us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.894410 (+ 178us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:51.894459 (+ 49us) write_op.cc:312] APPLY: finished
0928 20:02:51.894681 (+ 222us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.894840 (+ 159us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.894934 (+ 94us) write_op.cc:454] Released schema lock
0928 20:02:51.894986 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.895288 (+ 302us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.895319 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":13984,"apply.run_cpu_time_us":1815,"apply.run_wall_time_us":1815,"num_ops":2,"prepare.queue_time_us":57042,"prepare.run_cpu_time_us":2117,"prepare.run_wall_time_us":2247,"replication_time_us":266850}]]}
W20260928 20:02:51.909286 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d945be7bea449ba8c5541b60eb18334 consensus state has no leader
I20260928 20:02:51.911465 26227 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 368) took 1170 ms. Trace:
I20260928 20:02:51.911823 26227 rpcz_store.cc:276] 0928 20:02:50.741191 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.646661 (+905470us) service_pool.cc:224] Handling call
0928 20:02:51.648903 (+ 2242us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:51.650246 (+ 1343us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:51.910210 (+259964us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:51.910620 (+ 410us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:51.911248 (+ 628us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.844216 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.844749 (+ 533us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.844800 (+ 51us) write_op.cc:435] Acquired schema lock
0928 20:02:51.844813 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:51.845281 (+ 468us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.845357 (+ 76us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.845382 (+ 25us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:51.845679 (+ 297us) tablet.cc:701] Row locks acquired
0928 20:02:51.845696 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:02:51.845855 (+ 159us) write_op.cc:270] Start()
0928 20:02:51.845998 (+ 143us) write_op.cc:276] Timestamp: P: 1790625771845750 usec, L: 0
0928 20:02:51.846029 (+ 31us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.847003 (+ 974us) log.cc:844] Serialized 433 byte log entry
0928 20:02:51.879864 (+ 32861us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.897186 (+ 17322us) write_op.cc:301] APPLY: starting
0928 20:02:51.897230 (+ 44us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.897329 (+ 99us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.897417 (+ 88us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.897821 (+ 404us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.897944 (+ 123us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:51.897986 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:51.909660 (+ 11674us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.909835 (+ 175us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.909902 (+ 67us) write_op.cc:454] Released schema lock
0928 20:02:51.909935 (+ 33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":17203,"num_ops":2,"prepare.queue_time_us":26641,"prepare.run_cpu_time_us":3133,"prepare.run_wall_time_us":4862,"replication_time_us":33755,"threads_started":1}]]}
I20260928 20:02:51.917086 26227 master_service.cc:960] ReplaceTablet: received request to replace tablet d13562e920244194969520df564a949d from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:51.919286 26230 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:40138 (request call id 367) took 1229 ms. Trace:
I20260928 20:02:51.920804 26916 tablet_bootstrap.cc:492] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:51.921186 26916 ts_tablet_manager.cc:1449] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.000s
I20260928 20:02:51.844177 28047 raft_consensus.cc:2804] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:51.923458 26916 raft_consensus.cc:359] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:51.928406 26450 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:51.771924 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet b059111d6383414890a28c2947934dd8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb02b1f6bf4e43a08a3331438bf8e362) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:51.927839 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aad5c72e4c64b9e91082860477c78fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:51.919693 26230 rpcz_store.cc:276] 0928 20:02:50.689786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.642696 (+952910us) service_pool.cc:224] Handling call
0928 20:02:51.644844 (+ 2148us) catalog_manager.cc:2140] Acquired catalog manager lock
0928 20:02:51.673380 (+ 28536us) catalog_manager.cc:2186] Created new table and tablet info
0928 20:02:51.918344 (+244964us) catalog_manager.cc:2246] Wrote table and tablets to system table
0928 20:02:51.918716 (+ 372us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0928 20:02:51.919132 (+ 416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.677381 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:51.677838 (+ 457us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:51.677864 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:51.677877 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:51.678280 (+ 403us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:51.678317 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:51.678345 (+ 28us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:51.678571 (+ 226us) tablet.cc:701] Row locks acquired
0928 20:02:51.678589 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:02:51.678710 (+ 121us) write_op.cc:270] Start()
0928 20:02:51.678809 (+ 99us) write_op.cc:276] Timestamp: P: 1790625771678647 usec, L: 0
0928 20:02:51.678828 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.679343 (+ 515us) log.cc:844] Serialized 433 byte log entry
0928 20:02:51.879662 (+200319us) op_driver.cc:464] REPLICATION: finished
0928 20:02:51.895534 (+ 15872us) write_op.cc:301] APPLY: starting
0928 20:02:51.895601 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:51.895702 (+ 101us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:51.895800 (+ 98us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:51.896183 (+ 383us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:51.896324 (+ 141us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0928 20:02:51.896365 (+ 41us) write_op.cc:312] APPLY: finished
0928 20:02:51.896514 (+ 149us) log.cc:844] Serialized 29 byte log entry
0928 20:02:51.896639 (+ 125us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.896704 (+ 65us) write_op.cc:454] Released schema lock
0928 20:02:51.896736 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:51.896951 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:51.896975 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":15751,"apply.run_cpu_time_us":1388,"apply.run_wall_time_us":1388,"num_ops":2,"prepare.queue_time_us":2802,"prepare.run_cpu_time_us":2111,"prepare.run_wall_time_us":3437,"replication_time_us":200724}]]}
I20260928 20:02:51.771587 27907 consensus_queue.cc:1048] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.150s
I20260928 20:02:51.946835 27965 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.947289 27965 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.949214 27965 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:51.924031 26916 raft_consensus.cc:385] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:51.951434 26916 raft_consensus.cc:740] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:51.952155 26916 consensus_queue.cc:260] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:51.952667 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.953665 26916 ts_tablet_manager.cc:1480] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.032s user 0.004s sys 0.000s
I20260928 20:02:51.954692 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 8f5ee801a9354a858356fb4e055a1863 (table default.Table_de02ea49d88141cc8f34789367523d0f [id=45dc3f27b99844f68ac8ae0c288019e4]) successfully deleted
I20260928 20:02:51.930766 28047 raft_consensus.cc:493] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:51.968037 26804 raft_consensus.cc:2468] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:02:51.972040 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8cbffea517e2438d90ca234b9f72f733 consensus state has no leader
W20260928 20:02:51.975226 26231 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 311f004a7acc4d43b4b88564b57efa74 consensus state has no leader
I20260928 20:02:51.978822 26916 tablet_bootstrap.cc:492] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:51.990664 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5ee801a9354a858356fb4e055a1863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:51.997793 27965 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:51.998312 27965 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:52.000483 27965 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:52.007910 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_cc5abaa8c7cd4a05b417f7cee23527e7" } modify_external_catalogs: true
I20260928 20:02:52.008461 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_cc5abaa8c7cd4a05b417f7cee23527e7" } modify_external_catalogs: true
I20260928 20:02:51.930625 27984 raft_consensus.cc:515] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.003631 28047 raft_consensus.cc:3060] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:52.024919 26912 tablet_bootstrap.cc:654] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:52.028792 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet ee464b814dbf4e4b89b2d1c019befac6
W20260928 20:02:52.033906 26229 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 79) took 1507 ms (client timeout 1000 ms). Trace:
W20260928 20:02:52.034328 26229 rpcz_store.cc:269] 0928 20:02:50.526310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:50.538203 (+ 11893us) service_pool.cc:224] Handling call
0928 20:02:52.033700 (+1495497us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":52,"spinlock_wait_cycles":1757568}
I20260928 20:02:52.047174 27857 raft_consensus.cc:2243] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:52.047716 27857 raft_consensus.cc:2272] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:52.048429 28015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=9 ignored=0} inserts{seen=11 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260928 20:02:52.049562 27857 ts_tablet_manager.cc:1962] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:52.052242 28015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Bootstrap complete.
I20260928 20:02:52.055154 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:52.050350 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.056051 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.080786 26802 raft_consensus.cc:2468] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:52.066651 27984 leader_election.cc:290] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:52.089255 26739 consensus_peers.cc:597] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:52.089965 26739 consensus_peers.cc:597] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:52.092437 26739 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.092996 26739 leader_election.cc:304] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:52.093693 28064 raft_consensus.cc:2749] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:52.094950 26739 leader_election.cc:343] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.106773 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8fdfcb3717154d7a8da1009ef6e6b13d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.108264 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fdfcb3717154d7a8da1009ef6e6b13d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.113273 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5ee801a9354a858356fb4e055a1863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:51.929157 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aad5c72e4c64b9e91082860477c78fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.114950 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:52.117384 26450 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:52.118327 26450 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.119269 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d3b253774b324f229aed498d392a1514"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.120787 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3b253774b324f229aed498d392a1514 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.130359 26236 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:52.146979 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4654d78a319d429a8b9760da96f39a66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.148859 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4654d78a319d429a8b9760da96f39a66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:52.168910 26450 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.169275 26450 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.170414 27965 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:52.171949 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0694e341d64cdea99bb462beb1150b (DEFAULT_TABLE table=default.Table_d41c7a2638544b2b90e5398f97ad686b [id=84e0df88dcfd4d2d90bcd01c2849069b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.178571 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ccf4e77806ac4d888aa9b68621ef381d" } new_table_name: "default.Table_6ad2a1c67f69404f894b3deadc055fba" modify_external_catalogs: true
I20260928 20:02:52.178839 28048 consensus_queue.cc:1048] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:52.188115 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 62114712f2c040e6b1ae831911d68896 (DEFAULT_TABLE table=default.Table_06b8763e3d1242f796a3861e889b693a [id=ed830714739446fe8b2c5688e0b4f30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:51.946121 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d7ab92a37c4f9b865fa9fe49d46916" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.202865 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet d13562e920244194969520df564a949d
I20260928 20:02:52.204258 26227 catalog_manager.cc:6934] ReplaceTablet: tablet d13562e920244194969520df564a949d deleted and replaced by tablet 030f48d0d716450aaa4248d9fb1397ba
I20260928 20:02:52.205011 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet e70df4ddf0f9430980c967d798ed6c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:41 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.205567 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:52.212324 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 762cb728cc574a36a68fbe9033544b04 (DEFAULT_TABLE table=default.Table_7199ac53613b456991c7551d779d0e75 [id=078a3e2bf60e4991af5b1306494f4f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.113303 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:52.220074 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 115778us
I20260928 20:02:52.221596 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 2728c9979bb647a5a8f0a902c299e53d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.222862 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:52.226928 26450 leader_election.cc:343] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.227768 27676 consensus_queue.cc:1048] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:52.228242 26913 tablet_bootstrap.cc:654] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:52.237725 26594 leader_election.cc:304] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:52.239769 27676 raft_consensus.cc:2804] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:52.242471 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.214375 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.254124 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_4d246ff7bc384944a508f62c7e090eea" } new_table_name: "default.Table_3cd004ec7f3c4ada89b8477ac2847ddd" modify_external_catalogs: true
I20260928 20:02:52.254686 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_30de384ddce34033879e39169006114f" } modify_external_catalogs: true
I20260928 20:02:52.255177 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_30de384ddce34033879e39169006114f" } modify_external_catalogs: true
W20260928 20:02:52.256006 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 161084us
I20260928 20:02:52.253856 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_188a95a61c5a440dad4f7e0f583a07d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.259414 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_188a95a61c5a440dad4f7e0f583a07d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.260735 28048 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.261148 28048 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.267935 28048 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:52.274487 26631 consensus_meta.cc:287] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.517s user 0.009s sys 0.000s
I20260928 20:02:52.276171 28072 raft_consensus.cc:493] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.171681 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:52.278445 28081 raft_consensus.cc:493] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.284024 26912 tablet_bootstrap.cc:492] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:52.284480 26912 ts_tablet_manager.cc:1449] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.434s user 0.012s sys 0.002s
I20260928 20:02:52.304180 26231 master_service.cc:960] ReplaceTablet: received request to replace tablet 2239c466fa8e471e820173c67bc04cad from {username='slave'} at 127.0.0.1:40138
W20260928 20:02:52.315169 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 consensus state has no leader
W20260928 20:02:52.239516 26594 consensus_peers.cc:597] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b059111d6383414890a28c2947934dd8. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:52.324443 28081 raft_consensus.cc:515] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.326520 28081 leader_election.cc:290] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:52.322628 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.327840 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.188864 28063 raft_consensus.cc:493] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.328133 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.328580 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.328456 28063 raft_consensus.cc:515] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.330763 28063 leader_election.cc:290] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:52.320494 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 81054.4us
I20260928 20:02:52.189968 28064 raft_consensus.cc:493] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.331482 28064 raft_consensus.cc:515] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.333480 28064 leader_election.cc:290] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:52.265662 28071 raft_consensus.cc:493] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.175940 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.334770 28071 raft_consensus.cc:515] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.336709 28071 leader_election.cc:290] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:52.323319 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.323895 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.320796 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.322031 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.321431 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:52.247958 26636 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.029s sys 0.022s
I20260928 20:02:52.177139 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:52.338573 26636 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.643s user 0.030s sys 0.022s
I20260928 20:02:52.286583 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.287693 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.288499 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet 0216c99dfd8f498595f3f7dbadf8a79b with delete_type TABLET_DATA_DELETED (replaced by tablet 9db52eb6b080457583b0a59291995843) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.107205 28047 raft_consensus.cc:515] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.345010 28047 leader_election.cc:290] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:52.307911 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.289182 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.345376 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.346223 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.346379 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4056bc0590264672bd7c4f6d97050dd5
W20260928 20:02:52.310972 28026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s user 0.008s sys 0.044s
I20260928 20:02:52.349927 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 2239c466fa8e471e820173c67bc04cad
I20260928 20:02:52.276655 28072 raft_consensus.cc:515] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.351444 26231 catalog_manager.cc:6934] ReplaceTablet: tablet 2239c466fa8e471e820173c67bc04cad deleted and replaced by tablet b3ee867b0443431ba816ee5309888080
I20260928 20:02:52.351593 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet a0dd3080d50748d2ad79f472d3c17673 with delete_type TABLET_DATA_DELETED (replaced by tablet 775b9a076bf048bea39423d3554babf7) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.351581 28072 leader_election.cc:290] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:52.352101 26629 tablet_service.cc:1558] Processing DeleteTablet for tablet 93fb4e1fd0584a42a4de9eab14d5578c with delete_type TABLET_DATA_DELETED (replaced by tablet b94aed8337bb4b20b7977e91640c6710) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.327360 28030 ts_tablet_manager.cc:1975] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:52.353021 28030 log.cc:1199] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/8f5ee801a9354a858356fb4e055a1863
I20260928 20:02:52.353971 26628 tablet_service.cc:1558] Processing DeleteTablet for tablet 018497a652234fbdb04cf6c034bcc5d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.355089 28030 ts_tablet_manager.cc:1996] T 8f5ee801a9354a858356fb4e055a1863 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:52.361509 28030 tablet_replica.cc:333] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:52.368480 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2d13d16d9946c6b09f9197c165033c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.369077 28030 raft_consensus.cc:2243] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:52.372470 28030 raft_consensus.cc:2272] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:52.300428 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 03509d3602b345f69f059ae11c461920 (DEFAULT_TABLE table=default.Table_71dac26ca689411e89880e236cf117b6 [id=ceab34b317af44bf824578d2a64457c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.288523 26916 tablet_bootstrap.cc:700] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54: Time spent opening tablet: real 0.286s user 0.001s sys 0.000s
I20260928 20:02:52.335608 28085 raft_consensus.cc:493] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.341064 28031 raft_consensus.cc:493] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.349799 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:52.373946 28085 raft_consensus.cc:515] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.374246 28031 raft_consensus.cc:515] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.353397 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 2239c466fa8e471e820173c67bc04cad with delete_type TABLET_DATA_DELETED (replaced by tablet b3ee867b0443431ba816ee5309888080) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:52.376057 28085 leader_election.cc:290] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:52.376688 28031 leader_election.cc:290] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:52.377162 26916 tablet_bootstrap.cc:654] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:52.382711 28030 ts_tablet_manager.cc:1962] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:52.397789 26916 tablet_bootstrap.cc:492] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:52.398286 26916 ts_tablet_manager.cc:1449] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.420s user 0.010s sys 0.002s
W20260928 20:02:52.402702 26450 leader_election.cc:343] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.403093 26450 leader_election.cc:304] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.364596 28083 tablet.cc:1751] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:52.412413 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b414add5e6554e31905d7f0162e3abb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.414148 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b414add5e6554e31905d7f0162e3abb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.417745 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_02fef5b38f4b4eb382f4fba80de72cc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.419166 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02fef5b38f4b4eb382f4fba80de72cc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.422464 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_52834d7c9e064555a1ed3e9cd8b98e34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.424008 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52834d7c9e064555a1ed3e9cd8b98e34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.426488 28031 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.426903 28031 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:52.428774 28031 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:52.429183 28031 raft_consensus.cc:2749] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:52.438936 26450 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.439291 26450 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.438043 28030 ts_tablet_manager.cc:1975] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:52.444240 28030 log.cc:1199] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:52.444608 28081 raft_consensus.cc:2749] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:52.445957 28030 ts_tablet_manager.cc:1996] T a86e8a782b3e46d09a45bbb7025546af P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:52.448766 28030 tablet_replica.cc:333] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:52.452404 28030 raft_consensus.cc:2243] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:52.455006 28030 raft_consensus.cc:2272] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:52.353328 28035 consensus_queue.cc:1048] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.106s
I20260928 20:02:52.380987 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 62114712f2c040e6b1ae831911d68896 (DEFAULT_TABLE table=default.Table_06b8763e3d1242f796a3861e889b693a [id=ed830714739446fe8b2c5688e0b4f30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.462092 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62114712f2c040e6b1ae831911d68896. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:52.447710 26450 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.462738 28030 ts_tablet_manager.cc:1962] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:52.464165 26450 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.393250 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0694e341d64cdea99bb462beb1150b (DEFAULT_TABLE table=default.Table_d41c7a2638544b2b90e5398f97ad686b [id=84e0df88dcfd4d2d90bcd01c2849069b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.467275 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0694e341d64cdea99bb462beb1150b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.468173 28092 tablet.cc:1751] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:52.470209 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:52.375315 26627 tablet_service.cc:1558] Processing DeleteTablet for tablet 596a5540716441c49ec8185c8dc6a80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:35 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.401412 26624 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.401625 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.426070 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.381022 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 762cb728cc574a36a68fbe9033544b04 (DEFAULT_TABLE table=default.Table_7199ac53613b456991c7551d779d0e75 [id=078a3e2bf60e4991af5b1306494f4f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.474934 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762cb728cc574a36a68fbe9033544b04. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:52.476052 26450 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.476694 26450 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.377729 28005 consensus_queue.cc:1048] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.133s
W20260928 20:02:52.477656 26450 raft_consensus.cc:2686] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 20:02:52.478840 26450 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.413610 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2d13d16d9946c6b09f9197c165033c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.401857 26916 raft_consensus.cc:359] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.427688 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 03509d3602b345f69f059ae11c461920 (DEFAULT_TABLE table=default.Table_71dac26ca689411e89880e236cf117b6 [id=ceab34b317af44bf824578d2a64457c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.487335 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03509d3602b345f69f059ae11c461920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.347378 26626 tablet_service.cc:1558] Processing DeleteTablet for tablet 8163815661694d70ba4c2e36a424eaa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:34 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.485409 26916 raft_consensus.cc:385] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:52.364372 26625 tablet_service.cc:1558] Processing DeleteTablet for tablet aa4f373a46de433eabd3b35b6ed3d1e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.491535 26916 raft_consensus.cc:740] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:52.425817 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 2239c466fa8e471e820173c67bc04cad with delete_type TABLET_DATA_DELETED (replaced by tablet b3ee867b0443431ba816ee5309888080) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.492311 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]). Expected version 1 got 0
I20260928 20:02:52.403473 26628 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.492579 26916 consensus_queue.cc:260] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:52.348707 28026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s user 0.008s sys 0.044s
I20260928 20:02:52.494163 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 3e7c544b3449427dab981465e2e08a38 (table default.Table_3d54d1555a914679a1a011feaa634329 [id=8bce5ded64774186a5e753c7037b977f]). Expected version 1 got 0
I20260928 20:02:52.497035 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:52.505482 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.401867 26629 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.507443 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:52.509196 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:02:52.511219 26232 catalog_manager.cc:5838] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:02:52.479400 26450 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.524720 26913 tablet_bootstrap.cc:492] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:52.525128 26913 ts_tablet_manager.cc:1449] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.863s user 0.006s sys 0.005s
I20260928 20:02:52.519228 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_2a5441b3341b4a598fabc7fadafde28a" } new_table_name: "default.Table_5d02d49c97034e1387e569c63b067f9a" modify_external_catalogs: true
I20260928 20:02:52.526455 28059 tablet_replica.cc:333] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:52.527338 28059 raft_consensus.cc:2243] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:52.527964 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 49174.3us
W20260928 20:02:52.529155 26450 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.529702 26450 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:52.530649 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 182289us
I20260928 20:02:52.531329 28081 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:52.531553 28031 raft_consensus.cc:2749] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:52.531952 28081 consensus_queue.cc:1048] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:52.533356 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:52.534211 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:52.534808 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:02:52.535715 26658 raft_consensus.cc:3060] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:52.536140 27676 raft_consensus.cc:697] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:52.536857 27676 consensus_queue.cc:237] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.539978 28030 ts_tablet_manager.cc:1975] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:52.540330 28030 log.cc:1199] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/0e0a362efb68408d8dce96dce0130035
I20260928 20:02:52.541066 28030 ts_tablet_manager.cc:1996] T 0e0a362efb68408d8dce96dce0130035 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:52.543223 26913 raft_consensus.cc:359] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.543931 26913 raft_consensus.cc:385] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:52.544515 28030 tablet_replica.cc:333] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:52.544837 28059 raft_consensus.cc:2272] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:52.545953 28030 raft_consensus.cc:2243] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:52.546710 26916 ts_tablet_manager.cc:1480] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.148s user 0.008s sys 0.000s
I20260928 20:02:52.547482 28030 raft_consensus.cc:2272] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:52.551604 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4a912910bc1f4d59b94845c363144d28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.553169 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a912910bc1f4d59b94845c363144d28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.553486 28030 ts_tablet_manager.cc:1962] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:52.555740 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_841f8694539d49ad85dd21d2f74da8f7" } modify_external_catalogs: true
I20260928 20:02:52.556208 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_841f8694539d49ad85dd21d2f74da8f7" } modify_external_catalogs: true
I20260928 20:02:52.553165 28083 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:36268 (request call id 346) took 1049 ms. Trace:
I20260928 20:02:52.209025 28015 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:52.569002 28030 ts_tablet_manager.cc:1975] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:52.569427 28030 log.cc:1199] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/ee4c267b42754dbca8eb5ebec2d66a23
I20260928 20:02:52.570283 28030 ts_tablet_manager.cc:1996] T ee4c267b42754dbca8eb5ebec2d66a23 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:52.571425 28030 tablet_replica.cc:333] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:52.576067 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 03bd721cb5b34b9288fad286290db847 (DEFAULT_TABLE table=default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:52.578512 26739 leader_election.cc:343] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.584872 26490 tablet_service.cc:1511] Processing CreateTablet for tablet e8de132c03884597a311898f4d427bb1 (DEFAULT_TABLE table=default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.586823 27965 raft_consensus.cc:493] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.587455 27965 raft_consensus.cc:515] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.590003 28059 ts_tablet_manager.cc:1962] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:52.590878 28030 raft_consensus.cc:2243] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:52.560549 26595 leader_election.cc:343] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1edf314241784091a603907a43429b28
W20260928 20:02:52.591629 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 60469.4us
W20260928 20:02:52.591574 26450 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.573344 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.573848 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.575387 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.575847 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:52.576490 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cbde5f5dc4ff6a046b16b1e2b9786" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.593016 26450 leader_election.cc:304] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.595535 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0694e341d64cdea99bb462beb1150b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.596562 28081 raft_consensus.cc:2749] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:52.598675 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62114712f2c040e6b1ae831911d68896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.544220 26913 raft_consensus.cc:740] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:52.600816 27965 leader_election.cc:290] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:52.602734 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762cb728cc574a36a68fbe9033544b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.603335 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bd721cb5b34b9288fad286290db847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.592454 26594 leader_election.cc:304] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:52.606674 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8de132c03884597a311898f4d427bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.585615 28083 rpcz_store.cc:276] 0928 20:02:51.502689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.503025 (+ 336us) service_pool.cc:224] Handling call
0928 20:02:52.552534 (+1049509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.608465 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:51.608852 (+ 387us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:51.608886 (+ 34us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:51.608930 (+ 44us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:51.609135 (+ 205us) alter_schema_op.cc:128] START. Timestamp: 1790625771609037
0928 20:02:51.609156 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.609722 (+ 566us) log.cc:844] Serialized 173 byte log entry
0928 20:02:52.268513 (+658791us) op_driver.cc:464] REPLICATION: finished
0928 20:02:52.364332 (+ 95819us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:02:52.412720 (+ 48388us) log.cc:844] Serialized 5 byte log entry
0928 20:02:52.547563 (+134843us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:52.550942 (+ 3379us) log.cc:844] Serialized 14 byte log entry
0928 20:02:52.551483 (+ 541us) alter_schema_op.cc:73] Released schema lock
0928 20:02:52.551688 (+ 205us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":95608,"prepare.queue_time_us":104620,"prepare.run_cpu_time_us":1975,"prepare.run_wall_time_us":39696,"raft.queue_time_us":294,"raft.run_cpu_time_us":765,"raft.run_wall_time_us":765,"replication_time_us":659231,"thread_start_us":133246,"threads_started":2,"wal-append.queue_time_us":36789}]]}
I20260928 20:02:52.611140 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 6393d0583a9a47ec9eb455b30a548fc3 (DEFAULT_TABLE table=default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.612253 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6393d0583a9a47ec9eb455b30a548fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.612097 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:52.612814 26232 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:52.614387 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03509d3602b345f69f059ae11c461920. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:52.616521 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aec2497f4eac4408a37eb2a40122a672 consensus state has no leader
I20260928 20:02:52.616528 26488 tablet_service.cc:1511] Processing CreateTablet for tablet a6ce8cfd201343029b487dd6581bfb0a (DEFAULT_TABLE table=default.Table_c0cba0a8dbf4476e8c5b101a855ea68b [id=1ba1e6a48ca54423be0f36035c8308b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.617552 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ce8cfd201343029b487dd6581bfb0a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:52.618503 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f478cce587a548e1aab620721c3bb1c1 consensus state has no leader
I20260928 20:02:52.619037 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b667a45712c1449384e1a288f55fd062
I20260928 20:02:52.623435 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:52.630560 28010 raft_consensus.cc:2804] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:52.630913 28010 raft_consensus.cc:493] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:52.631191 28010 raft_consensus.cc:3060] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:52.634379 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e7228a68b84f2aab2bfa582fa25ab8 with delete_type TABLET_DATA_DELETED (replaced by tablet 6393d0583a9a47ec9eb455b30a548fc3) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.638037 26913 consensus_queue.cc:260] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.638267 28010 raft_consensus.cc:515] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:52.638873 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b91a573103c4c2d995abde8db91b821 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:52.638976 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 78458.9us
W20260928 20:02:52.639631 26595 consensus_peers.cc:597] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:52.639765 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.640579 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.641418 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.641465 28010 leader_election.cc:290] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:52.642485 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.643297 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.642753 26916 tablet_bootstrap.cc:492] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:52.644140 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.644956 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd2204d99e14a07af962295b152d60f with delete_type TABLET_DATA_DELETED (replaced by tablet e8de132c03884597a311898f4d427bb1) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.648882 26916 tablet_bootstrap.cc:654] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:52.649037 27857 ts_tablet_manager.cc:1975] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:52.649415 27857 log.cc:1199] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:02:52.657539 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_123669ff3966450d8a3dac4d2c6bd255"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.659106 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_123669ff3966450d8a3dac4d2c6bd255 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.325735 26912 raft_consensus.cc:359] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.662567 26912 raft_consensus.cc:385] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:52.662846 26912 raft_consensus.cc:740] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:52.663436 26912 consensus_queue.cc:260] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.675197 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_87c2af829d1743e89bc173be981dcbc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.676739 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c2af829d1743e89bc173be981dcbc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.682057 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_575791770cc143c88f796244c47743b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.683530 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_575791770cc143c88f796244c47743b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.685909 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.686977 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0694e341d64cdea99bb462beb1150b (DEFAULT_TABLE table=default.Table_d41c7a2638544b2b90e5398f97ad686b [id=84e0df88dcfd4d2d90bcd01c2849069b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.687959 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0694e341d64cdea99bb462beb1150b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.689330 26913 ts_tablet_manager.cc:1480] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.164s user 0.008s sys 0.001s
I20260928 20:02:52.650030 27857 ts_tablet_manager.cc:1996] T 80d7ab92a37c4f9b865fa9fe49d46916 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:52.690218 26913 tablet_bootstrap.cc:492] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:52.692507 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 347) took 1050 ms. Trace:
I20260928 20:02:52.692812 27857 rpcz_store.cc:276] 0928 20:02:51.642300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.642397 (+ 97us) service_pool.cc:224] Handling call
0928 20:02:51.865141 (+222744us) ts_tablet_manager.cc:1197] Deleting tablet 80d7ab92a37c4f9b865fa9fe49d46916
0928 20:02:51.865178 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.259420 (+394242us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:52.648915 (+389495us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:52.692450 (+ 43535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181066,"tablet-delete.queue_time_us":222243}
W20260928 20:02:52.694249 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 54159.1us
W20260928 20:02:52.694846 26595 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4b91a573103c4c2d995abde8db91b821
I20260928 20:02:52.695305 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 80d7ab92a37c4f9b865fa9fe49d46916 (table default.Table_afc7904735e94895aa832ee117628bac [id=15aa9f1d18a24b75b9d5c43329d8ddd9]) successfully deleted
I20260928 20:02:52.695945 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.700364 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.700898 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.703092 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 62114712f2c040e6b1ae831911d68896 (DEFAULT_TABLE table=default.Table_06b8763e3d1242f796a3861e889b693a [id=ed830714739446fe8b2c5688e0b4f30b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:52.703706 26595 leader_election.cc:343] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ee4c267b42754dbca8eb5ebec2d66a23
I20260928 20:02:52.704069 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62114712f2c040e6b1ae831911d68896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.705816 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.706928 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 762cb728cc574a36a68fbe9033544b04 (DEFAULT_TABLE table=default.Table_7199ac53613b456991c7551d779d0e75 [id=078a3e2bf60e4991af5b1306494f4f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.707893 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762cb728cc574a36a68fbe9033544b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.708734 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:41770
W20260928 20:02:52.709787 26595 consensus_peers.cc:597] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e0a362efb68408d8dce96dce0130035. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:52.709688 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 03509d3602b345f69f059ae11c461920 (DEFAULT_TABLE table=default.Table_71dac26ca689411e89880e236cf117b6 [id=ceab34b317af44bf824578d2a64457c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.718407 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03509d3602b345f69f059ae11c461920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.694092 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 348) took 1051 ms. Trace:
I20260928 20:02:52.718677 27857 rpcz_store.cc:276] 0928 20:02:51.642615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.642992 (+ 377us) service_pool.cc:224] Handling call
0928 20:02:52.693869 (+1050877us) ts_tablet_manager.cc:1197] Deleting tablet 06e7228a68b84f2aab2bfa582fa25ab8
0928 20:02:52.693906 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.694044 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1050342}
W20260928 20:02:52.719707 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 06e7228a68b84f2aab2bfa582fa25ab8 because the tablet was not found. No further retry: Not found: Tablet not found: 06e7228a68b84f2aab2bfa582fa25ab8
I20260928 20:02:52.753926 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:52.754665 26511 raft_consensus.cc:2393] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:52.753180 28015 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b347187d9be4ad08708acffdf4dda63, State: Initialized, Role: FOLLOWER
I20260928 20:02:52.764900 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a86cd5167c43a4beb51cd3138cdef8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:52.766201 28015 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 2.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:52.775080 28097 tablet.cc:1751] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:52.776266 28100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:52.777143 28100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:52.783211 28015 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:02:52.783419 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b4f6fb24e5d14de3afcb16e1fded33fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.785113 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4f6fb24e5d14de3afcb16e1fded33fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:52.814374 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 234686us
I20260928 20:02:52.815579 26916 tablet_bootstrap.cc:492] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:52.816008 26916 ts_tablet_manager.cc:1449] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.173s user 0.010s sys 0.000s
I20260928 20:02:52.820784 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3830bee23f7b423ab7799d67ec7eceb1" } new_table_name: "default.Table_f5715bc0d1984c5da56d3c85ec83c550" modify_external_catalogs: true
I20260928 20:02:52.829712 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_557ff1874c914338876196686cfd7c4d" } modify_external_catalogs: true
I20260928 20:02:52.830238 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_557ff1874c914338876196686cfd7c4d" } modify_external_catalogs: true
I20260928 20:02:52.836673 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_5d02d49c97034e1387e569c63b067f9a" } new_table_name: "default.Table_f6b035000ac14436b7323f69c8f92710" modify_external_catalogs: true
I20260928 20:02:52.848369 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:52.856446 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:52.857077 26512 raft_consensus.cc:2468] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:52.869807 26450 leader_election.cc:343] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:52.870486 26450 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:52.871014 26450 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:52.871361 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:52.871994 26510 raft_consensus.cc:2468] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:52.873258 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:52.873942 26512 raft_consensus.cc:2468] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:52.803731 26913 tablet_bootstrap.cc:654] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:52.825433 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 115156us
I20260928 20:02:52.883049 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:52.883430 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 03bd721cb5b34b9288fad286290db847 (DEFAULT_TABLE table=default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.883644 26512 raft_consensus.cc:3060] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:52.884455 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bd721cb5b34b9288fad286290db847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.875108 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 8f5ee801a9354a858356fb4e055a1863 (table default.Table_de02ea49d88141cc8f34789367523d0f [id=45dc3f27b99844f68ac8ae0c288019e4]) successfully deleted
I20260928 20:02:52.886344 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 349) took 1243 ms. Trace:
I20260928 20:02:52.886670 27857 rpcz_store.cc:276] 0928 20:02:51.642883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.643600 (+ 717us) service_pool.cc:224] Handling call
0928 20:02:52.734355 (+1090755us) ts_tablet_manager.cc:1197] Deleting tablet 1edf314241784091a603907a43429b28
0928 20:02:52.770131 (+ 35776us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866f1d2 00007f65515e8379 00007f65507f8c18 00007f65508bf6f9 00007f65508bfcf3 00007f65508f2080 00007f65508d84ad 00007f65508d8459 00007f65508d83e9
0928 20:02:52.886075 (+115944us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.886279 (+ 204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75047808,"tablet-delete.queue_time_us":1089875}
I20260928 20:02:52.887856 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 350) took 1089 ms. Trace:
W20260928 20:02:52.888145 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet aa4f373a46de433eabd3b35b6ed3d1e3 because the tablet was not found. No further retry: Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:52.888118 27857 rpcz_store.cc:276] 0928 20:02:51.798481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.801661 (+ 3180us) service_pool.cc:224] Handling call
0928 20:02:52.887626 (+1085965us) ts_tablet_manager.cc:1197] Deleting tablet 1284d1f7fa774033b90133447627df4f
0928 20:02:52.887661 (+ 35us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.887805 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1085437}
W20260928 20:02:52.888751 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet a0dd3080d50748d2ad79f472d3c17673 because the tablet was not found. No further retry: Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:52.889051 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 351) took 1090 ms. Trace:
W20260928 20:02:52.889266 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 018497a652234fbdb04cf6c034bcc5d3 because the tablet was not found. No further retry: Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:52.889317 27857 rpcz_store.cc:276] 0928 20:02:51.798905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.802274 (+ 3369us) service_pool.cc:224] Handling call
0928 20:02:52.888842 (+1086568us) ts_tablet_manager.cc:1197] Deleting tablet 4b91a573103c4c2d995abde8db91b821
0928 20:02:52.888875 (+ 33us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.889008 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1086090}
I20260928 20:02:52.890291 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:52.890378 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 352) took 1091 ms. Trace:
W20260928 20:02:52.890517 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 1edf314241784091a603907a43429b28 because the tablet was not found. No further retry: Not found: Tablet not found: 1edf314241784091a603907a43429b28
I20260928 20:02:52.890642 27857 rpcz_store.cc:276] 0928 20:02:51.799274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.802866 (+ 3592us) service_pool.cc:224] Handling call
0928 20:02:52.890024 (+1087158us) ts_tablet_manager.cc:1197] Deleting tablet 385278bf2df34f4f960a0cfdebd79be5
0928 20:02:52.890057 (+ 33us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.890333 (+ 276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1086686}
I20260928 20:02:52.891100 26635 tablet_service.cc:1511] Processing CreateTablet for tablet e8de132c03884597a311898f4d427bb1 (DEFAULT_TABLE table=default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.891270 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
W20260928 20:02:52.891467 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 1284d1f7fa774033b90133447627df4f because the tablet was not found. No further retry: Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f
I20260928 20:02:52.891616 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 353) took 1092 ms. Trace:
I20260928 20:02:52.892112 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8de132c03884597a311898f4d427bb1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:52.892313 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4b91a573103c4c2d995abde8db91b821 because the tablet was not found. No further retry: Not found: Tablet not found: 4b91a573103c4c2d995abde8db91b821
I20260928 20:02:52.892082 26235 catalog_manager.cc:5838] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:52.891868 27857 rpcz_store.cc:276] 0928 20:02:51.799666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.803481 (+ 3815us) service_pool.cc:224] Handling call
0928 20:02:52.891411 (+1087930us) ts_tablet_manager.cc:1197] Deleting tablet 775b9a076bf048bea39423d3554babf7
0928 20:02:52.891448 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.891572 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087311}
W20260928 20:02:52.893196 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 385278bf2df34f4f960a0cfdebd79be5 because the tablet was not found. No further retry: Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5
I20260928 20:02:52.893689 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 354) took 1093 ms. Trace:
W20260928 20:02:52.894066 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 775b9a076bf048bea39423d3554babf7 because the tablet was not found. No further retry: Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
I20260928 20:02:52.895888 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 6393d0583a9a47ec9eb455b30a548fc3 (DEFAULT_TABLE table=default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.897053 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6393d0583a9a47ec9eb455b30a548fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.893962 27857 rpcz_store.cc:276] 0928 20:02:51.800043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.804200 (+ 4157us) service_pool.cc:224] Handling call
0928 20:02:52.893492 (+1089292us) ts_tablet_manager.cc:1197] Deleting tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
0928 20:02:52.893526 (+ 34us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.893649 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088739}
I20260928 20:02:52.899082 27857 tablet_replica.cc:333] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:52.899196 26631 tablet_service.cc:1511] Processing CreateTablet for tablet a6ce8cfd201343029b487dd6581bfb0a (DEFAULT_TABLE table=default.Table_c0cba0a8dbf4476e8c5b101a855ea68b [id=1ba1e6a48ca54423be0f36035c8308b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.899224 26774 tablet_service.cc:1511] Processing CreateTablet for tablet e8de132c03884597a311898f4d427bb1 (DEFAULT_TABLE table=default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.899919 27857 raft_consensus.cc:2243] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:52.900208 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ce8cfd201343029b487dd6581bfb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.900367 27857 raft_consensus.cc:2272] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:52.900578 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8de132c03884597a311898f4d427bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.902786 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:52.912567 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet a86e8a782b3e46d09a45bbb7025546af (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]) successfully deleted
W20260928 20:02:52.913727 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e868e5a3ebd2494ca20e1e08a146850e consensus state has no leader
I20260928 20:02:52.914291 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 0e0a362efb68408d8dce96dce0130035 (table default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 [id=62b393e94fb74eb6a1103662c6a672c7]) successfully deleted
W20260928 20:02:52.914354 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 because the tablet was not found. No further retry: Not found: Tablet not found: ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:02:52.914865 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet ee4c267b42754dbca8eb5ebec2d66a23 (table default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 [id=899ddfb9d42b4edab7acc6c374382cce]) successfully deleted
I20260928 20:02:52.918264 27965 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:52.918733 27965 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.920452 27965 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:52.922621 26916 raft_consensus.cc:359] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.923187 26776 tablet_service.cc:1511] Processing CreateTablet for tablet a6ce8cfd201343029b487dd6581bfb0a (DEFAULT_TABLE table=default.Table_c0cba0a8dbf4476e8c5b101a855ea68b [id=1ba1e6a48ca54423be0f36035c8308b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.924239 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ce8cfd201343029b487dd6581bfb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.924229 26916 raft_consensus.cc:385] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:52.924479 26916 raft_consensus.cc:740] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:52.925028 26916 consensus_queue.cc:260] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:52.902015 27857 ts_tablet_manager.cc:1962] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:52.927048 26916 ts_tablet_manager.cc:1480] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.111s user 0.006s sys 0.000s
I20260928 20:02:52.930853 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet 2239c466fa8e471e820173c67bc04cad with delete_type TABLET_DATA_DELETED (replaced by tablet b3ee867b0443431ba816ee5309888080) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.932220 26913 tablet_bootstrap.cc:492] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:52.932410 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 03bd721cb5b34b9288fad286290db847 (DEFAULT_TABLE table=default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.933557 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bd721cb5b34b9288fad286290db847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.932629 26913 ts_tablet_manager.cc:1449] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.243s user 0.008s sys 0.000s
I20260928 20:02:52.939877 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 5ac6aaf0a2434c1fb74dd313fd4b7116
I20260928 20:02:52.946455 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_faf31ace80214cb19c20c46710a4efb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.947956 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faf31ace80214cb19c20c46710a4efb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.949437 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 6393d0583a9a47ec9eb455b30a548fc3 (DEFAULT_TABLE table=default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:52.950555 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6393d0583a9a47ec9eb455b30a548fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:52.954691 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:52.958447 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d945be7bea449ba8c5541b60eb18334 consensus state has no leader
I20260928 20:02:52.958488 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:52.959679 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.960561 26798 raft_consensus.cc:2468] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:52.962363 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a86cd5167c43a4beb51cd3138cdef8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.962839 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.962368 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:52.977380 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet ba87a379ae6a4feabfbc9fd6ba2d488e
W20260928 20:02:52.871558 26450 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:52.977913 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 106379us
W20260928 20:02:52.950433 26595 consensus_peers.cc:597] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b059111d6383414890a28c2947934dd8. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:52.982550 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4613895cb87549efa0173a0bc2de3828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.983057 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 69018.5us
I20260928 20:02:52.983201 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:52.984020 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4613895cb87549efa0173a0bc2de3828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:52.983933 28079 consensus_queue.cc:1048] T 534674440ee649e4afbc87b3cce5c43e P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:52.985554 26595 leader_election.cc:304] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:52.986222 28079 raft_consensus.cc:2749] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:52.986667 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c2c1220e1adf428a9a4f66e9b4d701b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:52.988092 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.003532 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet ba87a379ae6a4feabfbc9fd6ba2d488e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:53.018621 26512 raft_consensus.cc:2468] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:52.927875 26916 tablet_bootstrap.cc:492] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:53.032290 26916 tablet_bootstrap.cc:654] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.014555 26913 raft_consensus.cc:359] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:53.024915 26595 consensus_peers.cc:597] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a86e8a782b3e46d09a45bbb7025546af. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:53.042793 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8fd74e2df9b84a1e998370b85625e609"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:53.049268 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fd74e2df9b84a1e998370b85625e609 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.039959 26913 raft_consensus.cc:385] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.054296 26913 raft_consensus.cc:740] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.019902 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:53.065961 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 249389us
I20260928 20:02:53.073172 28030 raft_consensus.cc:2272] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.092927 28030 ts_tablet_manager.cc:1962] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:53.077944 26912 ts_tablet_manager.cc:1480] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.755s user 0.005s sys 0.001s
W20260928 20:02:53.094507 26912 ts_tablet_manager.cc:1513] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Tablet startup took 771ms
I20260928 20:02:53.037770 28031 raft_consensus.cc:493] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.095549 28031 raft_consensus.cc:515] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:53.095009 26912 ts_tablet_manager.cc:1515] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Trace:
0928 20:02:37.973210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:37.973326 (+ 116us) service_pool.cc:224] Handling call
0928 20:02:37.974754 (+ 1428us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:37.974842 (+ 88us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:37.992791 (+ 17949us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:38.013288 (+ 20497us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:38.013633 (+ 345us) inbound_call.cc:177] Queueing success response
0928 20:02:51.774301 (+13760668us) ts_tablet_manager.cc:1425] Bootstrapping tablet
0928 20:02:52.322917 (+548616us) ts_tablet_manager.cc:1481] Starting tablet replica
0928 20:02:52.323703 (+ 786us) tablet_replica.cc:261] Starting instrumentation
0928 20:02:52.324181 (+ 478us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":341171,"raft.queue_time_us":406187,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":280,"tablet-open.queue_time_us":13760743}
I20260928 20:02:53.097553 28031 leader_election.cc:290] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:53.097716 26912 tablet_bootstrap.cc:492] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:53.079365 28072 consensus_queue.cc:1048] T 8a616a7dbd8e4a99bc133f2bd61a4808 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:53.080509 26740 leader_election.cc:304] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:53.113058 28106 raft_consensus.cc:2804] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:53.113473 28106 raft_consensus.cc:493] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:53.113811 28106 raft_consensus.cc:3060] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.038479 26450 leader_election.cc:304] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:53.115983 28081 raft_consensus.cc:2804] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 20:02:53.116106 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 77707us
I20260928 20:02:53.116353 28081 raft_consensus.cc:493] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:53.116758 28081 raft_consensus.cc:3060] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:53.117038 26450 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.117461 26450 leader_election.cc:304] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.118556 28031 raft_consensus.cc:2749] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:53.119050 26740 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4cd2204d99e14a07af962295b152d60f
I20260928 20:02:53.119884 26740 leader_election.cc:304] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:53.120380 26450 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.120616 28072 raft_consensus.cc:2804] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:53.120785 26450 leader_election.cc:304] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.120931 28072 raft_consensus.cc:493] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:53.121258 28072 raft_consensus.cc:3060] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.121381 28031 raft_consensus.cc:2749] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:53.122321 26450 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.122666 26450 leader_election.cc:304] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.123256 28031 raft_consensus.cc:2749] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.123430 28081 raft_consensus.cc:515] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.125290 28081 leader_election.cc:290] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:53.122568 26740 leader_election.cc:304] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:53.126579 27907 raft_consensus.cc:2804] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:53.126909 27907 raft_consensus.cc:493] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:53.127185 27907 raft_consensus.cc:3060] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:53.130453 26740 leader_election.cc:343] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:02:53.139828 27984 consensus_queue.cc:1048] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:02:53.142962 26450 leader_election.cc:343] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.143004 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.147789 28081 raft_consensus.cc:493] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.148243 28081 raft_consensus.cc:515] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.149971 28081 leader_election.cc:290] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:53.147013 26913 consensus_queue.cc:260] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.154842 26630 tablet_service.cc:1558] Processing DeleteTablet for tablet ba87a379ae6a4feabfbc9fd6ba2d488e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.163817 26912 tablet_bootstrap.cc:654] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.165650 28059 ts_tablet_manager.cc:1975] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:53.166591 28059 log.cc:1199] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/06e7228a68b84f2aab2bfa582fa25ab8
I20260928 20:02:53.168047 28059 ts_tablet_manager.cc:1996] T 06e7228a68b84f2aab2bfa582fa25ab8 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:53.168975 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 322) took 1481 ms. Trace:
I20260928 20:02:53.169365 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f55cc836b1a4436baefce92d942dc0ba" } new_table_name: "default.Table_45a011677059457aad4891d7756d6e76" modify_external_catalogs: true
I20260928 20:02:53.169390 28059 rpcz_store.cc:276] 0928 20:02:51.687290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.694618 (+ 7328us) service_pool.cc:224] Handling call
0928 20:02:52.520182 (+825564us) ts_tablet_manager.cc:1197] Deleting tablet 06e7228a68b84f2aab2bfa582fa25ab8
0928 20:02:52.526291 (+ 6109us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.799495 (+273204us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.165520 (+366025us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.168918 (+ 3398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16906,"tablet-delete.queue_time_us":824844,"thread_start_us":643445,"threads_started":1}
I20260928 20:02:53.171211 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 06e7228a68b84f2aab2bfa582fa25ab8 (table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]) successfully deleted
I20260928 20:02:53.175470 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3c29918c975a40a694cdc5554d5c8a2c" } modify_external_catalogs: true
I20260928 20:02:53.175940 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3c29918c975a40a694cdc5554d5c8a2c" } modify_external_catalogs: true
I20260928 20:02:53.179010 26913 ts_tablet_manager.cc:1480] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.191s user 0.005s sys 0.000s
I20260928 20:02:53.180766 26913 tablet_bootstrap.cc:492] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:53.176245 26739 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.190258 26739 leader_election.cc:304] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:53.191073 28064 raft_consensus.cc:2749] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:53.192140 26739 leader_election.cc:343] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:53.192970 26739 leader_election.cc:343] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:53.193764 26739 leader_election.cc:343] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.194211 26916 tablet_bootstrap.cc:492] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:53.194681 26916 ts_tablet_manager.cc:1449] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.267s user 0.009s sys 0.001s
I20260928 20:02:53.178550 28106 raft_consensus.cc:515] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.197641 28106 leader_election.cc:290] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:53.198194 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 56516.2us
I20260928 20:02:53.183060 27907 raft_consensus.cc:515] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.202178 27907 leader_election.cc:290] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:53.220705 27857 ts_tablet_manager.cc:1975] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:53.221215 27857 log.cc:1199] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/3eb8477c5cb74205b4b55eb38d7f9542
I20260928 20:02:53.221940 27857 ts_tablet_manager.cc:1996] T 3eb8477c5cb74205b4b55eb38d7f9542 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:53.212136 28072 raft_consensus.cc:515] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.223763 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 355) took 1417 ms. Trace:
I20260928 20:02:53.227933 28072 leader_election.cc:290] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:53.233402 26739 leader_election.cc:343] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.233924 26739 leader_election.cc:304] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:53.236255 27907 raft_consensus.cc:2749] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.226209 26740 leader_election.cc:304] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:53.243322 28106 raft_consensus.cc:2804] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:53.243911 28106 raft_consensus.cc:697] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:53.244642 26912 tablet_bootstrap.cc:492] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:53.244779 28106 consensus_queue.cc:237] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.246718 26912 ts_tablet_manager.cc:1449] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.149s user 0.012s sys 0.000s
W20260928 20:02:53.242806 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43887.9us
I20260928 20:02:53.249289 26912 raft_consensus.cc:359] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.249894 26912 raft_consensus.cc:385] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.250214 26912 raft_consensus.cc:740] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.249536 27857 rpcz_store.cc:276] 0928 20:02:51.806826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.806950 (+ 124us) service_pool.cc:224] Handling call
0928 20:02:52.898947 (+1091997us) ts_tablet_manager.cc:1197] Deleting tablet 3eb8477c5cb74205b4b55eb38d7f9542
0928 20:02:52.898986 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:52.974234 (+ 75248us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.220562 (+246328us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.223707 (+ 3145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1091419}
I20260928 20:02:53.259037 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 3eb8477c5cb74205b4b55eb38d7f9542 (table default.Table_9383c6792e2d433ab615717932fa897e [id=b639dae4a9234107aa133677343f4d12]) successfully deleted
I20260928 20:02:53.260342 27857 tablet_replica.cc:333] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:53.250792 26912 consensus_queue.cc:260] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.267715 27857 raft_consensus.cc:2243] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:53.271283 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:53.272470 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:53.272984 26803 raft_consensus.cc:3060] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.274921 26912 ts_tablet_manager.cc:1480] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
W20260928 20:02:53.275208 26595 leader_election.cc:343] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4b91a573103c4c2d995abde8db91b821
I20260928 20:02:53.275964 26912 tablet_bootstrap.cc:492] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:53.289711 28059 tablet_replica.cc:333] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:53.290337 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:53.290586 28059 raft_consensus.cc:2243] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:53.291035 26227 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a79a8a3ed31b47348f4de573aef54ed6" } modify_external_catalogs: true
I20260928 20:02:53.291531 26227 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a79a8a3ed31b47348f4de573aef54ed6" } modify_external_catalogs: true
I20260928 20:02:53.295038 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:53.296057 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:53.297089 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:53.299077 26658 raft_consensus.cc:3060] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.300418 26229 master_service.cc:960] ReplaceTablet: received request to replace tablet ba87a379ae6a4feabfbc9fd6ba2d488e from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:53.303535 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:53.304725 28059 raft_consensus.cc:2272] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.306393 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:53.306974 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:53.307176 28059 ts_tablet_manager.cc:1962] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:53.313141 27857 raft_consensus.cc:2272] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.318364 26916 raft_consensus.cc:359] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.321303 26913 tablet_bootstrap.cc:654] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.326707 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4433b79132934b48a3f2dd089592fcaf" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:53.327239 26513 raft_consensus.cc:3060] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.319053 26916 raft_consensus.cc:385] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.334453 26916 raft_consensus.cc:740] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.335088 26916 consensus_queue.cc:260] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.336280 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:53.341889 28030 ts_tablet_manager.cc:1975] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:53.342339 28030 log.cc:1199] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/1edf314241784091a603907a43429b28
I20260928 20:02:53.345258 26513 raft_consensus.cc:2468] T 4433b79132934b48a3f2dd089592fcaf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:02:53.349575 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb02b1f6bf4e43a08a3331438bf8e362 has no consensus state
I20260928 20:02:53.349502 26803 raft_consensus.cc:2468] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:53.350904 27857 ts_tablet_manager.cc:1962] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:53.354911 26450 leader_election.cc:343] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.355288 26450 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:53.350961 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 75208us
W20260928 20:02:53.360716 26595 consensus_peers.cc:597] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1edf314241784091a603907a43429b28. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:53.363966 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:53.364475 26513 raft_consensus.cc:3060] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.343102 28030 ts_tablet_manager.cc:1996] T 1edf314241784091a603907a43429b28 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:53.374369 26913 tablet_bootstrap.cc:492] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:53.374742 26913 ts_tablet_manager.cc:1449] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.194s user 0.008s sys 0.002s
I20260928 20:02:53.376363 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.377031 26913 raft_consensus.cc:359] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.381068 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.383888 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c267b42754dbca8eb5ebec2d66a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.385728 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 1edf314241784091a603907a43429b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:37 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.386834 27907 raft_consensus.cc:493] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.387456 27907 raft_consensus.cc:515] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:53.388926 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:53.390365 27907 leader_election.cc:290] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:53.391598 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet ba87a379ae6a4feabfbc9fd6ba2d488e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:53.393990 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e0a362efb68408d8dce96dce0130035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:53.396629 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 356) took 1074 ms. Trace:
I20260928 20:02:53.396981 28030 rpcz_store.cc:276] 0928 20:02:52.322160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.323676 (+ 1516us) service_pool.cc:224] Handling call
0928 20:02:52.571275 (+247599us) ts_tablet_manager.cc:1197] Deleting tablet 1edf314241784091a603907a43429b28
0928 20:02:52.571314 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.205960 (+634646us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.341746 (+135786us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.396562 (+ 54816us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499824,"tablet-delete.queue_time_us":233453}
I20260928 20:02:53.398329 28030 tablet_replica.cc:333] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:53.399148 28030 raft_consensus.cc:2243] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:53.403945 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a6f405608c6542a6818f887b3abc1129"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:53.405674 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b97ad3f841f54aa38bbb312c50db384e
W20260928 20:02:53.406754 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f405608c6542a6818f887b3abc1129 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.405145 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b620de746d7346efac926837182aa589"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:53.407981 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b620de746d7346efac926837182aa589 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.419719 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet b97ad3f841f54aa38bbb312c50db384e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:53.377864 26913 raft_consensus.cc:385] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.421211 26913 raft_consensus.cc:740] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.422005 26912 tablet_bootstrap.cc:654] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.423856 26913 consensus_queue.cc:260] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:53.423548 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 68666.4us
I20260928 20:02:53.425678 28039 raft_consensus.cc:493] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.425731 28030 raft_consensus.cc:2272] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.426085 28039 raft_consensus.cc:515] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.427169 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b91a573103c4c2d995abde8db91b821 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e78ac2ae0124b7b859a79bd9f1c203a) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:53.427960 28039 leader_election.cc:290] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:53.429214 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 60) took 996 ms (client timeout 1000 ms). Trace:
I20260928 20:02:53.430893 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet b97ad3f841f54aa38bbb312c50db384e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:53.429531 26235 rpcz_store.cc:269] 0928 20:02:52.432349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.432511 (+ 162us) service_pool.cc:224] Handling call
0928 20:02:52.441162 (+ 8651us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:53.429147 (+987985us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:53.085325 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:53.085680 (+ 355us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:53.085702 (+ 22us) write_op.cc:435] Acquired schema lock
0928 20:02:53.085715 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:53.085929 (+ 214us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:53.085963 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:53.085985 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:53.086133 (+ 148us) tablet.cc:701] Row locks acquired
0928 20:02:53.086146 (+ 13us) write_op.cc:260] PREPARE: finished
0928 20:02:53.086240 (+ 94us) write_op.cc:270] Start()
0928 20:02:53.086316 (+ 76us) write_op.cc:276] Timestamp: P: 1790625773086183 usec, L: 0
0928 20:02:53.086330 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:53.086749 (+ 419us) log.cc:844] Serialized 536 byte log entry
0928 20:02:53.292874 (+206125us) op_driver.cc:464] REPLICATION: finished
0928 20:02:53.296493 (+ 3619us) write_op.cc:301] APPLY: starting
0928 20:02:53.296550 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:53.296641 (+ 91us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:53.296762 (+ 121us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:53.297032 (+ 270us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:53.297200 (+ 168us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:53.297263 (+ 63us) write_op.cc:312] APPLY: finished
0928 20:02:53.297473 (+ 210us) log.cc:844] Serialized 23 byte log entry
0928 20:02:53.297634 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:53.297707 (+ 73us) write_op.cc:454] Released schema lock
0928 20:02:53.297746 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:53.305513 (+ 7767us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:53.305540 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":26,"spinlock_wait_cycles":7228800,"child_traces":[["op",{"apply.queue_time_us":3478,"apply.run_cpu_time_us":1503,"apply.run_wall_time_us":8985,"num_ops":1,"prepare.queue_time_us":82903,"prepare.run_cpu_time_us":1663,"prepare.run_wall_time_us":96717,"replication_time_us":206484}]]}
I20260928 20:02:53.437709 26913 ts_tablet_manager.cc:1480] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.063s user 0.006s sys 0.000s
I20260928 20:02:53.441864 28030 ts_tablet_manager.cc:1962] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:53.445055 26740 leader_election.cc:304] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:53.445767 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:53.447211 26516 raft_consensus.cc:3060] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:53.450452 26916 ts_tablet_manager.cc:1480] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.255s user 0.006s sys 0.000s
I20260928 20:02:53.450591 27984 raft_consensus.cc:2804] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:53.451027 27984 raft_consensus.cc:697] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:53.446017 27965 raft_consensus.cc:2749] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.451754 27984 consensus_queue.cc:237] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.458879 26913 tablet_bootstrap.cc:492] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:53.460484 28059 ts_tablet_manager.cc:1975] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:53.460938 28059 log.cc:1199] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/b059111d6383414890a28c2947934dd8
I20260928 20:02:53.461788 28059 ts_tablet_manager.cc:1996] T b059111d6383414890a28c2947934dd8 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:53.461994 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 1edf314241784091a603907a43429b28 (table default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 [id=b39c31256b914e41bdb078ad90d6506b]) successfully deleted
I20260928 20:02:53.423040 28031 raft_consensus.cc:493] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.462997 28031 raft_consensus.cc:515] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.466657 28031 leader_election.cc:290] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:53.471669 26513 raft_consensus.cc:2468] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:53.476035 26916 tablet_bootstrap.cc:492] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:53.476462 26783 tablet_service.cc:1558] Processing DeleteTablet for tablet b97ad3f841f54aa38bbb312c50db384e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:53.462512 26516 raft_consensus.cc:2468] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:02:53.485487 26740 leader_election.cc:343] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:53.506553 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 331) took 1802 ms. Trace:
I20260928 20:02:53.507037 28059 rpcz_store.cc:276] 0928 20:02:51.704518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.771306 (+ 66788us) service_pool.cc:224] Handling call
0928 20:02:53.282029 (+1510723us) ts_tablet_manager.cc:1197] Deleting tablet b059111d6383414890a28c2947934dd8
0928 20:02:53.282618 (+ 589us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.366077 (+ 83459us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.460317 (+ 94240us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.506468 (+ 46151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350863}
W20260928 20:02:53.508188 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 82883.4us
I20260928 20:02:53.508744 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet b059111d6383414890a28c2947934dd8 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]) successfully deleted
W20260928 20:02:53.509169 26450 leader_election.cc:343] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:53.509754 26450 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.512115 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:53.513130 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c0d08dc9a1fc43a7962c248deaa0b135"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:53.513347 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:53.513543 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:53.514740 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0d08dc9a1fc43a7962c248deaa0b135 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.517681 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_db4ea683c5a44f919cbc94271cd36567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:53.519069 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db4ea683c5a44f919cbc94271cd36567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.520848 28097 tablet.cc:1751] T 3e7c544b3449427dab981465e2e08a38 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:53.526686 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:53.530038 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43646.3us
I20260928 20:02:53.535158 28005 raft_consensus.cc:493] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.535601 28005 raft_consensus.cc:515] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.536777 26916 tablet_bootstrap.cc:654] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.537635 28005 leader_election.cc:290] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:53.540378 26450 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.540746 26450 leader_election.cc:304] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.543668 28140 raft_consensus.cc:2749] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.545648 26450 leader_election.cc:304] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:53.554329 28140 raft_consensus.cc:2804] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:53.555104 28140 raft_consensus.cc:697] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:02:53.555969 28140 consensus_queue.cc:237] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.558373 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet f478cce587a548e1aab620721c3bb1c1 from {username='slave'} at 127.0.0.1:40138
W20260928 20:02:53.562692 26450 leader_election.cc:343] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.573812 26916 tablet_bootstrap.cc:492] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:53.574219 26916 ts_tablet_manager.cc:1449] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.098s user 0.010s sys 0.000s
I20260928 20:02:53.576056 28144 tablet.cc:1751] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:53.576478 26916 raft_consensus.cc:359] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.581574 26913 tablet_bootstrap.cc:654] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.583339 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:53.588485 27857 ts_tablet_manager.cc:1975] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:53.588946 27857 log.cc:1199] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/bd3fa371924149fb814c8458488aea61
I20260928 20:02:53.590251 27857 ts_tablet_manager.cc:1996] T bd3fa371924149fb814c8458488aea61 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:53.590931 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 356) took 1783 ms. Trace:
I20260928 20:02:53.591215 27857 rpcz_store.cc:276] 0928 20:02:51.807192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.807696 (+ 504us) service_pool.cc:224] Handling call
0928 20:02:53.260191 (+1452495us) ts_tablet_manager.cc:1197] Deleting tablet bd3fa371924149fb814c8458488aea61
0928 20:02:53.260231 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.375431 (+115200us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.588365 (+212934us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.590884 (+ 2519us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1452017}
I20260928 20:02:53.592404 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet bd3fa371924149fb814c8458488aea61 (table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]) successfully deleted
W20260928 20:02:53.602514 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 71908.8us
I20260928 20:02:53.602736 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0f2425b8a3f44839afa3d4dd8d45b246" } new_table_name: "default.Table_932f16b87c7e4e89a0cd7f710df1532d" modify_external_catalogs: true
I20260928 20:02:53.603160 28154 tablet.cc:1751] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:53.608896 28059 tablet_replica.cc:333] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:53.609917 28059 raft_consensus.cc:2243] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:53.610628 28059 raft_consensus.cc:2272] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.612893 28059 ts_tablet_manager.cc:1962] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:53.618995 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_88a3630ba1604375aba3e2ef7f7c1003" } modify_external_catalogs: true
I20260928 20:02:53.619728 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_88a3630ba1604375aba3e2ef7f7c1003" } modify_external_catalogs: true
I20260928 20:02:53.620832 26916 raft_consensus.cc:385] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.621531 26916 raft_consensus.cc:740] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.622589 26916 consensus_queue.cc:260] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.642031 26913 tablet_bootstrap.cc:492] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:53.642920 26913 ts_tablet_manager.cc:1449] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.184s user 0.009s sys 0.002s
I20260928 20:02:53.649796 28157 tablet.cc:1751] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:53.653410 26916 ts_tablet_manager.cc:1480] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
I20260928 20:02:53.662619 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91a573103c4c2d995abde8db91b821" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:02:53.662806 26595 leader_election.cc:343] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:53.663266 26802 raft_consensus.cc:3060] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:53.665536 26450 leader_election.cc:343] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.665917 26450 leader_election.cc:304] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.670008 28081 raft_consensus.cc:2749] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:53.670399 26450 leader_election.cc:343] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.670948 26913 raft_consensus.cc:359] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.672070 26913 raft_consensus.cc:385] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.672644 26913 raft_consensus.cc:740] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.673503 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_778978540feb44479e171d677565eff8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:53.675216 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_778978540feb44479e171d677565eff8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:53.679333 26450 leader_election.cc:343] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.679682 26450 leader_election.cc:304] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:53.677199 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 73912.5us
I20260928 20:02:53.680974 26740 leader_election.cc:304] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:53.683377 28081 raft_consensus.cc:2749] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.690693 28097 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 330) took 1986 ms. Trace:
I20260928 20:02:53.691061 28097 rpcz_store.cc:276] 0928 20:02:51.704187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.704385 (+ 198us) service_pool.cc:224] Handling call
0928 20:02:53.690634 (+1986249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:51.705559 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:51.705904 (+ 345us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:51.705949 (+ 45us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:51.706039 (+ 90us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:51.706183 (+ 144us) alter_schema_op.cc:128] START. Timestamp: 1790625771659268
0928 20:02:51.706203 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 20:02:51.706689 (+ 486us) log.cc:844] Serialized 173 byte log entry
0928 20:02:53.520076 (+1813387us) op_driver.cc:464] REPLICATION: finished
0928 20:02:53.520750 (+ 674us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:02:53.521887 (+ 1137us) log.cc:844] Serialized 5 byte log entry
0928 20:02:53.687592 (+165705us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.688298 (+ 706us) log.cc:844] Serialized 14 byte log entry
0928 20:02:53.690499 (+ 2201us) alter_schema_op.cc:73] Released schema lock
0928 20:02:53.690532 (+ 33us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":528,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":53214,"prepare.run_wall_time_us":789722,"replication_time_us":1813755,"thread_start_us":866487,"threads_started":2,"wal-append.queue_time_us":887144,"wal-append.run_cpu_time_us":1565,"wal-append.run_wall_time_us":1001937}]]}
I20260928 20:02:53.701115 26913 consensus_queue.cc:260] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:53.703097 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a4c5888ebf824ce6934efcc6b4257595"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:53.703727 26913 ts_tablet_manager.cc:1480] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.056s user 0.006s sys 0.000s
I20260928 20:02:53.704602 26913 tablet_bootstrap.cc:492] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:53.705363 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4c5888ebf824ce6934efcc6b4257595 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.724339 26916 tablet_bootstrap.cc:492] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:53.730528 26916 tablet_bootstrap.cc:654] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:53.744269 26595 consensus_peers.cc:597] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee4c267b42754dbca8eb5ebec2d66a23. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:53.747363 28081 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.747509 28140 raft_consensus.cc:493] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.748220 28140 raft_consensus.cc:515] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.750495 28140 leader_election.cc:290] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:53.751060 28081 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.752900 28081 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:53.765895 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 84986.3us
I20260928 20:02:53.688388 26802 raft_consensus.cc:2468] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:53.768597 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:53.770733 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:53.770887 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:53.773579 26913 tablet_bootstrap.cc:654] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.777674 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:53.704698 28160 tablet.cc:1751] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 20:02:53.782152 26450 leader_election.cc:343] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:53.782823 26450 leader_election.cc:343] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.783174 26450 leader_election.cc:304] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.711835 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:53.784137 26450 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.728259 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5f5f16f2d7457799e1b96a293695f4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:53.784709 26450 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.785009 26450 leader_election.cc:304] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.785049 26799 raft_consensus.cc:2468] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:53.786145 28140 raft_consensus.cc:2749] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.786756 28140 raft_consensus.cc:2749] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.790190 28140 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.790575 28140 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.792244 28140 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:53.795255 27984 raft_consensus.cc:2804] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:53.795751 27984 raft_consensus.cc:697] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
W20260928 20:02:53.805110 26594 consensus_peers.cc:597] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:53.810250 26740 leader_election.cc:304] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:53.810490 26594 consensus_peers.cc:597] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a86e8a782b3e46d09a45bbb7025546af. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:53.811555 28063 raft_consensus.cc:2804] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:53.812021 28063 raft_consensus.cc:697] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:53.812009 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0655fc043b9468ea51ce5ae983e8f06" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:53.812778 28063 consensus_queue.cc:237] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.814502 28059 ts_tablet_manager.cc:1975] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:53.815042 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:53.817480 26450 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.818049 28059 log.cc:1199] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/8f5ee801a9354a858356fb4e055a1863
I20260928 20:02:53.819093 28059 ts_tablet_manager.cc:1996] T 8f5ee801a9354a858356fb4e055a1863 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:53.821102 26711 tablet.cc:2433] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:02:53.826932 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d36ac45737c44b2da07aee540f3e9a13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:53.827338 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:53.830442 26450 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.830955 26450 leader_election.cc:304] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:53.831784 28081 raft_consensus.cc:2749] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:53.833505 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 332) took 1821 ms. Trace:
I20260928 20:02:53.831223 26916 tablet_bootstrap.cc:492] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:53.834138 26916 ts_tablet_manager.cc:1449] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.110s user 0.011s sys 0.000s
I20260928 20:02:53.835944 28059 rpcz_store.cc:276] 0928 20:02:52.012017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.037044 (+ 25027us) service_pool.cc:224] Handling call
0928 20:02:53.588488 (+1551444us) ts_tablet_manager.cc:1197] Deleting tablet 8f5ee801a9354a858356fb4e055a1863
0928 20:02:53.608726 (+ 20238us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.720521 (+111795us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.802296 (+ 81775us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.833430 (+ 31134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1474733}
I20260928 20:02:53.836453 26916 raft_consensus.cc:359] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.837028 26916 raft_consensus.cc:385] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.837260 26916 raft_consensus.cc:740] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.837865 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 8f5ee801a9354a858356fb4e055a1863 (table default.Table_de02ea49d88141cc8f34789367523d0f [id=45dc3f27b99844f68ac8ae0c288019e4]) successfully deleted
I20260928 20:02:53.838124 27984 consensus_queue.cc:237] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.839119 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 333) took 1638 ms. Trace:
I20260928 20:02:53.839483 28059 rpcz_store.cc:276] 0928 20:02:52.200501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.204833 (+ 4332us) service_pool.cc:224] Handling call
0928 20:02:53.838724 (+1633891us) ts_tablet_manager.cc:1197] Deleting tablet e70df4ddf0f9430980c967d798ed6c50
0928 20:02:53.838777 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.838958 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620408}
W20260928 20:02:53.840982 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet e70df4ddf0f9430980c967d798ed6c50 because the tablet was not found. No further retry: Not found: Tablet not found: e70df4ddf0f9430980c967d798ed6c50
I20260928 20:02:53.842010 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 334) took 1621 ms. Trace:
I20260928 20:02:53.842422 28059 rpcz_store.cc:276] 0928 20:02:52.221071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.221438 (+ 367us) service_pool.cc:224] Handling call
0928 20:02:53.841760 (+1620322us) ts_tablet_manager.cc:1197] Deleting tablet 2728c9979bb647a5a8f0a902c299e53d
0928 20:02:53.841799 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.841956 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1619728}
W20260928 20:02:53.843726 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 2728c9979bb647a5a8f0a902c299e53d because the tablet was not found. No further retry: Not found: Tablet not found: 2728c9979bb647a5a8f0a902c299e53d
I20260928 20:02:53.844852 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 337) took 1622 ms. Trace:
I20260928 20:02:53.845203 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 357) took 2036 ms. Trace:
I20260928 20:02:53.845193 28059 rpcz_store.cc:276] 0928 20:02:52.222151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.222725 (+ 574us) service_pool.cc:224] Handling call
0928 20:02:53.844584 (+1621859us) ts_tablet_manager.cc:1197] Deleting tablet 0216c99dfd8f498595f3f7dbadf8a79b
0928 20:02:53.844639 (+ 55us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.844804 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1621321}
I20260928 20:02:53.845561 27857 rpcz_store.cc:276] 0928 20:02:51.808880 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.808977 (+ 97us) service_pool.cc:224] Handling call
0928 20:02:53.844950 (+2035973us) ts_tablet_manager.cc:1197] Deleting tablet 4cd2204d99e14a07af962295b152d60f
0928 20:02:53.844994 (+ 44us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.845146 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2035493}
W20260928 20:02:53.846701 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 0216c99dfd8f498595f3f7dbadf8a79b because the tablet was not found. No further retry: Not found: Tablet not found: 0216c99dfd8f498595f3f7dbadf8a79b
I20260928 20:02:53.846930 27857 tablet_replica.cc:333] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:53.847599 28059 tablet_replica.cc:333] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:53.847666 27857 raft_consensus.cc:2243] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:53.848093 27857 raft_consensus.cc:2272] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.751753 26912 tablet_bootstrap.cc:492] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:53.848637 28059 raft_consensus.cc:2243] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:53.846393 26916 consensus_queue.cc:260] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.848979 26912 ts_tablet_manager.cc:1449] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.573s user 0.015s sys 0.001s
I20260928 20:02:53.849699 28059 pending_rounds.cc:70] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:53.849977 28059 pending_rounds.cc:77] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403150492028928 op_type: NO_OP noop_request { }
I20260928 20:02:53.850719 28059 raft_consensus.cc:2889] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:53.851135 28059 raft_consensus.cc:2272] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.851820 26912 raft_consensus.cc:359] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.852430 26912 raft_consensus.cc:385] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.852691 26912 raft_consensus.cc:740] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.853482 28059 ts_tablet_manager.cc:1962] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:53.854779 26916 ts_tablet_manager.cc:1480] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
W20260928 20:02:53.847116 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4cd2204d99e14a07af962295b152d60f because the tablet was not found. No further retry: Not found: Tablet not found: 4cd2204d99e14a07af962295b152d60f
I20260928 20:02:53.857702 26916 tablet_bootstrap.cc:492] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:53.872174 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d36ac45737c44b2da07aee540f3e9a13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.873116 28059 ts_tablet_manager.cc:1975] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:53.873823 28059 log.cc:1199] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/4c23636443834932852f21092be1d1ac
I20260928 20:02:53.875995 26916 tablet_bootstrap.cc:654] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.876245 28059 ts_tablet_manager.cc:1996] T 4c23636443834932852f21092be1d1ac P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:53.877022 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 341) took 1653 ms. Trace:
I20260928 20:02:53.877362 28059 rpcz_store.cc:276] 0928 20:02:52.223560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.228794 (+ 5234us) service_pool.cc:224] Handling call
0928 20:02:53.847449 (+1618655us) ts_tablet_manager.cc:1197] Deleting tablet 4c23636443834932852f21092be1d1ac
0928 20:02:53.847493 (+ 44us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.864844 (+ 17351us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.872994 (+ 8150us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.876964 (+ 3970us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1604482}
W20260928 20:02:53.878710 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 67482.6us
I20260928 20:02:53.878777 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 4c23636443834932852f21092be1d1ac (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]) successfully deleted
I20260928 20:02:53.879637 28059 tablet_replica.cc:333] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:53.880461 28059 raft_consensus.cc:2243] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:53.881354 28059 pending_rounds.cc:70] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:53.881582 28059 pending_rounds.cc:77] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403148894830592 op_type: NO_OP noop_request { }
I20260928 20:02:53.881916 28059 raft_consensus.cc:2889] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:53.882513 28059 raft_consensus.cc:2272] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:53.884528 28059 ts_tablet_manager.cc:1962] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:53.895941 26594 consensus_peers.cc:597] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e0a362efb68408d8dce96dce0130035. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:53.896876 26594 consensus_peers.cc:597] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1edf314241784091a603907a43429b28. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:53.903225 26594 consensus_peers.cc:597] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee4c267b42754dbca8eb5ebec2d66a23. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:53.907136 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_43a3511ec731472cb9111882b4c3a9a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:53.909109 26913 tablet_bootstrap.cc:492] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:53.909519 26913 ts_tablet_manager.cc:1449] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.205s user 0.007s sys 0.005s
I20260928 20:02:53.909917 26916 tablet_bootstrap.cc:492] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:53.910312 26916 ts_tablet_manager.cc:1449] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.000s
I20260928 20:02:53.912572 26916 raft_consensus.cc:359] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.913206 26916 raft_consensus.cc:385] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:53.913455 26916 raft_consensus.cc:740] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:53.920447 26916 consensus_queue.cc:260] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.928359 26916 ts_tablet_manager.cc:1480] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260928 20:02:53.929543 28030 ts_tablet_manager.cc:1975] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:53.929968 28030 log.cc:1199] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:53.930636 28030 ts_tablet_manager.cc:1996] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:53.931874 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 351) took 1611 ms. Trace:
I20260928 20:02:53.932188 28030 rpcz_store.cc:276] 0928 20:02:52.320569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.320674 (+ 105us) service_pool.cc:224] Handling call
0928 20:02:53.398173 (+1077499us) ts_tablet_manager.cc:1197] Deleting tablet b0655fc043b9468ea51ce5ae983e8f06
0928 20:02:53.398228 (+ 55us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.584023 (+185795us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.929415 (+345392us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.931796 (+ 2381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20451,"tablet-delete.queue_time_us":1060159}
I20260928 20:02:53.933395 28030 tablet_replica.cc:333] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:53.934094 26561 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
W20260928 20:02:53.945118 26739 leader_election.cc:343] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:53.946039 26739 leader_election.cc:343] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:53.946913 26739 leader_election.cc:343] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:53.950657 28144 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:36268 (request call id 374) took 1028 ms. Trace:
I20260928 20:02:53.954655 27857 ts_tablet_manager.cc:1962] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:53.955063 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet b0655fc043b9468ea51ce5ae983e8f06 (table default.Table_bed2cb6494a544afb978a8521c702d03 [id=d8c4eedc317c4c5c8a008ab4ee6d94b3]) successfully deleted
W20260928 20:02:53.956565 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43a3511ec731472cb9111882b4c3a9a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:53.960813 26912 consensus_queue.cc:260] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.969229 26916 tablet_bootstrap.cc:492] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:53.975481 26916 tablet_bootstrap.cc:654] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:53.986044 28154 tablet.cc:1751] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:53.989552 28160 tablet.cc:1751] T 29dd1355039e4bca952f13a9d174813e P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:02:53.994180 27907 raft_consensus.cc:493] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:53.994656 27907 raft_consensus.cc:515] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:53.996711 27907 leader_election.cc:290] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:54.002509 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:54.003182 26508 raft_consensus.cc:2468] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:54.006737 26916 tablet_bootstrap.cc:492] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:54.007717 26740 leader_election.cc:304] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:54.009099 26916 ts_tablet_manager.cc:1449] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.002s
I20260928 20:02:54.009617 26912 ts_tablet_manager.cc:1480] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.160s user 0.005s sys 0.001s
I20260928 20:02:54.007967 28154 tablet.cc:1751] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:54.010609 26912 tablet_bootstrap.cc:492] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:54.011888 27984 raft_consensus.cc:2804] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:54.012240 27984 raft_consensus.cc:493] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:54.012579 27984 raft_consensus.cc:3060] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:54.014925 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d945be7bea449ba8c5541b60eb18334 consensus state has no leader
I20260928 20:02:54.015380 26916 raft_consensus.cc:359] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.016819 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_4ab8d432c8da4b06acd99f3329549a73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:54.018316 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ab8d432c8da4b06acd99f3329549a73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:54.018718 26916 raft_consensus.cc:385] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.019033 26916 raft_consensus.cc:740] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.019764 26916 consensus_queue.cc:260] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:54.025132 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 77467.3us
W20260928 20:02:54.028329 26594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:02:54.032770 28059 ts_tablet_manager.cc:1975] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:54.033142 28059 log.cc:1199] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/38abbc891d9c4268820cb0faba3d08b5
I20260928 20:02:54.034258 28059 ts_tablet_manager.cc:1996] T 38abbc891d9c4268820cb0faba3d08b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:54.034830 26913 raft_consensus.cc:359] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.035547 26913 raft_consensus.cc:385] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.035841 26913 raft_consensus.cc:740] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.036686 26913 consensus_queue.cc:260] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.038275 28171 tablet.cc:1751] T 674eef4920f94d4f88aa5dc3a0b362d3 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:54.040962 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 343) took 1791 ms. Trace:
I20260928 20:02:54.041263 28059 rpcz_store.cc:276] 0928 20:02:52.249362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.277724 (+ 28362us) service_pool.cc:224] Handling call
0928 20:02:53.879490 (+1601766us) ts_tablet_manager.cc:1197] Deleting tablet 38abbc891d9c4268820cb0faba3d08b5
0928 20:02:53.879531 (+ 41us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:53.905795 (+ 26264us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.032637 (+126842us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.040909 (+ 8272us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1551219}
I20260928 20:02:54.042438 26916 ts_tablet_manager.cc:1480] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.033s user 0.004s sys 0.002s
I20260928 20:02:54.044083 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 38abbc891d9c4268820cb0faba3d08b5 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]) successfully deleted
I20260928 20:02:54.047513 28059 tablet_replica.cc:333] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:54.048276 28059 raft_consensus.cc:2243] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:54.049326 28059 pending_rounds.cc:70] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:54.049575 28059 pending_rounds.cc:77] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403154918543360 op_type: NO_OP noop_request { }
I20260928 20:02:54.049911 28059 raft_consensus.cc:2889] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:54.050274 28059 raft_consensus.cc:2272] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:54.050810 26913 ts_tablet_manager.cc:1480] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.141s user 0.007s sys 0.001s
I20260928 20:02:54.052028 26913 tablet_bootstrap.cc:492] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:54.053736 28059 ts_tablet_manager.cc:1962] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:54.069154 26570 tablet.cc:2433] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:02:54.077773 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 51992.6us
I20260928 20:02:53.951081 28144 rpcz_store.cc:276] 0928 20:02:52.922367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.923301 (+ 934us) service_pool.cc:224] Handling call
0928 20:02:53.950593 (+1027292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:52.928533 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:52.928864 (+ 331us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:52.928892 (+ 28us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:52.928932 (+ 40us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:52.929040 (+ 108us) alter_schema_op.cc:128] START. Timestamp: 1790625772928972
0928 20:02:52.929059 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:02:52.929522 (+ 463us) log.cc:844] Serialized 173 byte log entry
0928 20:02:53.511078 (+581556us) op_driver.cc:464] REPLICATION: finished
0928 20:02:53.575971 (+ 64893us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:02:53.577534 (+ 1563us) log.cc:844] Serialized 5 byte log entry
0928 20:02:53.948741 (+371207us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.949556 (+ 815us) log.cc:844] Serialized 14 byte log entry
0928 20:02:53.950449 (+ 893us) alter_schema_op.cc:73] Released schema lock
0928 20:02:53.950477 (+ 28us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64719,"prepare.queue_time_us":4497,"prepare.run_cpu_time_us":1289,"prepare.run_wall_time_us":22182,"raft.queue_time_us":130,"raft.run_cpu_time_us":641,"raft.run_wall_time_us":641,"replication_time_us":581915,"thread_start_us":100583,"threads_started":2}]]}
I20260928 20:02:54.098136 26739 leader_election.cc:304] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:02:54.098730 26739 raft_consensus.cc:2686] T b0655fc043b9468ea51ce5ae983e8f06 P b2d286f4404146278f5e0785ed9fcee4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:54.117301 26594 leader_election.cc:304] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:54.118983 28035 raft_consensus.cc:2749] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:54.118763 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:54.120594 28047 raft_consensus.cc:493] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:54.120637 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:54.121022 28047 raft_consensus.cc:515] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.123129 28047 leader_election.cc:290] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:54.123736 28030 raft_consensus.cc:2243] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:54.128636 28030 raft_consensus.cc:2272] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:54.131753 28030 ts_tablet_manager.cc:1962] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:54.134073 26913 tablet_bootstrap.cc:654] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.134308 26916 tablet_bootstrap.cc:492] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:54.142872 26916 tablet_bootstrap.cc:654] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.073697 27984 raft_consensus.cc:515] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:54.148763 26740 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
I20260928 20:02:54.149524 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:54.150177 26508 raft_consensus.cc:3060] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.165217 26912 tablet_bootstrap.cc:654] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.173311 27984 leader_election.cc:290] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:54.148626 26594 leader_election.cc:304] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:54.182322 28160 tablet.cc:1751] T 3e7c544b3449427dab981465e2e08a38 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:02:54.192306 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 43768us
I20260928 20:02:54.193292 26594 leader_election.cc:304] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:54.152091 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:54.195266 28035 raft_consensus.cc:2804] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:54.195592 28035 raft_consensus.cc:493] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:54.195889 28035 raft_consensus.cc:3060] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.198287 28005 raft_consensus.cc:2804] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:54.198747 28005 raft_consensus.cc:697] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:54.199548 28005 consensus_queue.cc:237] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.159873 26654 raft_consensus.cc:3060] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.205435 26916 tablet_bootstrap.cc:492] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:54.205828 26916 ts_tablet_manager.cc:1449] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.072s user 0.014s sys 0.000s
I20260928 20:02:54.160777 28039 raft_consensus.cc:493] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.206292 28039 raft_consensus.cc:515] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.208150 28039 leader_election.cc:290] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:54.210618 26595 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
I20260928 20:02:54.210453 26916 raft_consensus.cc:359] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.211112 26916 raft_consensus.cc:385] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.211372 26916 raft_consensus.cc:740] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.211987 26916 consensus_queue.cc:260] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.213828 26916 ts_tablet_manager.cc:1480] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260928 20:02:54.213754 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775b9a076bf048bea39423d3554babf7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:54.214313 26658 raft_consensus.cc:2468] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:54.215318 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:54.228166 26916 tablet_bootstrap.cc:492] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:54.242398 28035 raft_consensus.cc:515] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:54.246680 26595 leader_election.cc:343] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:54.244596 28035 leader_election.cc:290] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:54.259389 28059 ts_tablet_manager.cc:1975] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:54.259778 28059 log.cc:1199] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:02:54.260463 28059 ts_tablet_manager.cc:1996] T b0655fc043b9468ea51ce5ae983e8f06 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:54.267663 26739 leader_election.cc:343] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:54.234097 26916 tablet_bootstrap.cc:654] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.292228 27857 ts_tablet_manager.cc:1975] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:54.292659 27857 log.cc:1199] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:02:54.296273 26916 tablet_bootstrap.cc:492] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:54.296682 26916 ts_tablet_manager.cc:1449] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.002s
W20260928 20:02:54.298290 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 67345.4us
I20260928 20:02:54.298923 26916 raft_consensus.cc:359] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.299523 26916 raft_consensus.cc:385] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.299757 26916 raft_consensus.cc:740] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.300355 26916 consensus_queue.cc:260] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.283262 26739 leader_election.cc:304] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:54.302510 27907 raft_consensus.cc:2804] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:54.302860 27907 raft_consensus.cc:493] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:54.303170 27907 raft_consensus.cc:3060] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.311070 27907 raft_consensus.cc:515] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.311741 26916 ts_tablet_manager.cc:1480] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260928 20:02:54.312588 26916 tablet_bootstrap.cc:492] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:54.313679 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
W20260928 20:02:54.314437 26740 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
W20260928 20:02:54.316725 26739 leader_election.cc:343] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:54.317463 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:54.318701 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775b9a076bf048bea39423d3554babf7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:54.318974 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db5f5f16f2d7457799e1b96a293695f4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:54.319069 26229 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:54.319410 26803 raft_consensus.cc:3060] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.319486 26794 raft_consensus.cc:2393] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:54.325624 26803 raft_consensus.cc:2468] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:54.333432 26916 tablet_bootstrap.cc:654] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.341425 27907 leader_election.cc:290] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:54.343259 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 344) took 1998 ms. Trace:
I20260928 20:02:54.350185 26783 tablet_service.cc:1511] Processing CreateTablet for tablet bc58b27db848454196f75b9077a203cb (DEFAULT_TABLE table=default.Table_8fdfcb3717154d7a8da1009ef6e6b13d [id=eecba72bbe4b47d5908cb12d57e2eece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.351253 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc58b27db848454196f75b9077a203cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.351689 26490 tablet_service.cc:1511] Processing CreateTablet for tablet bc58b27db848454196f75b9077a203cb (DEFAULT_TABLE table=default.Table_8fdfcb3717154d7a8da1009ef6e6b13d [id=eecba72bbe4b47d5908cb12d57e2eece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.352669 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc58b27db848454196f75b9077a203cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.363502 26912 tablet_bootstrap.cc:492] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:54.363986 26912 ts_tablet_manager.cc:1449] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.354s user 0.013s sys 0.003s
I20260928 20:02:54.365335 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:54.366569 28081 consensus_queue.cc:1048] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:54.368064 26508 raft_consensus.cc:2468] T 4ba5d2cc979241c4918a154f25dcd305 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:54.373632 26912 raft_consensus.cc:359] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.374224 26912 raft_consensus.cc:385] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.374456 26912 raft_consensus.cc:740] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.293331 27857 ts_tablet_manager.cc:1996] T 12a86cd5167c43a4beb51cd3138cdef8 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:54.376309 26916 tablet_bootstrap.cc:492] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:54.376710 26916 ts_tablet_manager.cc:1449] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.002s
I20260928 20:02:54.379966 26916 raft_consensus.cc:359] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.380568 26916 raft_consensus.cc:385] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.380808 26916 raft_consensus.cc:740] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.383249 28081 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.383663 28081 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.387428 28081 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:54.388082 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:54.389166 26450 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:54.347702 26632 tablet_service.cc:1511] Processing CreateTablet for tablet bc58b27db848454196f75b9077a203cb (DEFAULT_TABLE table=default.Table_8fdfcb3717154d7a8da1009ef6e6b13d [id=eecba72bbe4b47d5908cb12d57e2eece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.391178 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc58b27db848454196f75b9077a203cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.349965 28035 raft_consensus.cc:493] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.394315 28035 raft_consensus.cc:515] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.390535 28059 rpcz_store.cc:276] 0928 20:02:52.344400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.345228 (+ 828us) service_pool.cc:224] Handling call
0928 20:02:54.042289 (+1697061us) ts_tablet_manager.cc:1197] Deleting tablet b0655fc043b9468ea51ce5ae983e8f06
0928 20:02:54.047380 (+ 5091us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.110407 (+ 63027us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.259267 (+148860us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.343198 (+ 83931us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1696575}
W20260928 20:02:54.398073 26853 tablet.cc:2433] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:02:54.363009 26913 tablet_bootstrap.cc:492] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:54.398716 26913 ts_tablet_manager.cc:1449] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.347s user 0.012s sys 0.000s
I20260928 20:02:54.400606 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:54.403652 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 358) took 2451 ms. Trace:
I20260928 20:02:54.404006 27857 rpcz_store.cc:276] 0928 20:02:51.952398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.952521 (+ 123us) service_pool.cc:224] Handling call
0928 20:02:53.846776 (+1894255us) ts_tablet_manager.cc:1197] Deleting tablet 12a86cd5167c43a4beb51cd3138cdef8
0928 20:02:53.846824 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.135716 (+288892us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.292097 (+156381us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.403591 (+111494us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1893738}
W20260928 20:02:54.405081 26450 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:54.405444 26450 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:54.412159 26913 raft_consensus.cc:359] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.412781 26913 raft_consensus.cc:385] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.413039 26913 raft_consensus.cc:740] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.412985 28081 raft_consensus.cc:2749] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:54.428591 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet f478cce587a548e1aab620721c3bb1c1
I20260928 20:02:54.429922 26228 catalog_manager.cc:6934] ReplaceTablet: tablet f478cce587a548e1aab620721c3bb1c1 deleted and replaced by tablet 11216db10dc54e9fa8a7466643f8e413
I20260928 20:02:54.431778 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet f478cce587a548e1aab620721c3bb1c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 11216db10dc54e9fa8a7466643f8e413) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:54.432107 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet f478cce587a548e1aab620721c3bb1c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 11216db10dc54e9fa8a7466643f8e413) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:54.432598 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet 01533b61bad74ddb9056aeacef13a126 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:54.366830 28181 tablet.cc:1751] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260928 20:02:54.438827 26450 consensus_peers.cc:597] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:54.371889 28180 tablet.cc:1751] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:54.377822 26631 tablet_service.cc:1511] Processing CreateTablet for tablet c1cb96cab3e647908f3e99981e7147c7 (DEFAULT_TABLE table=default.Table_05c17087f17c40ccaef5290a60a1234d [id=45a830baeeb54dcdb2109f053a9413ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.378163 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775b9a076bf048bea39423d3554babf7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:54.382391 26594 leader_election.cc:304] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:54.439920 26650 raft_consensus.cc:3060] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.440128 28005 raft_consensus.cc:2804] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:54.440586 28005 raft_consensus.cc:697] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:54.441356 28005 consensus_queue.cc:237] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:54.444171 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 61867.9us
I20260928 20:02:54.445578 26594 leader_election.cc:304] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:54.446373 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cb96cab3e647908f3e99981e7147c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.447592 26650 raft_consensus.cc:2468] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:54.448017 28079 raft_consensus.cc:2749] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:54.449790 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:54.452265 26912 consensus_queue.cc:260] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.453087 27907 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.453521 27907 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.457388 27907 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:54.468840 26773 tablet_service.cc:1511] Processing CreateTablet for tablet c1cb96cab3e647908f3e99981e7147c7 (DEFAULT_TABLE table=default.Table_05c17087f17c40ccaef5290a60a1234d [id=45a830baeeb54dcdb2109f053a9413ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:54.471951 26739 consensus_peers.cc:597] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:54.472389 26916 consensus_queue.cc:260] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.473850 26916 ts_tablet_manager.cc:1480] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.097s user 0.004s sys 0.003s
I20260928 20:02:54.474896 26916 tablet_bootstrap.cc:492] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:54.475972 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 12a86cd5167c43a4beb51cd3138cdef8 (table default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]) successfully deleted
I20260928 20:02:54.477461 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:54.477994 26494 tablet_service.cc:1511] Processing CreateTablet for tablet c1cb96cab3e647908f3e99981e7147c7 (DEFAULT_TABLE table=default.Table_05c17087f17c40ccaef5290a60a1234d [id=45a830baeeb54dcdb2109f053a9413ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.478165 26513 raft_consensus.cc:2468] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:02:54.479045 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cb96cab3e647908f3e99981e7147c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.480011 28081 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.480400 28081 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.481463 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 360) took 2491 ms. Trace:
I20260928 20:02:54.481748 27857 rpcz_store.cc:276] 0928 20:02:51.990399 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.990517 (+ 118us) service_pool.cc:224] Handling call
0928 20:02:54.481230 (+2490713us) ts_tablet_manager.cc:1197] Deleting tablet 8f5ee801a9354a858356fb4e055a1863
0928 20:02:54.481269 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.481412 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2490150}
I20260928 20:02:54.482558 26740 leader_election.cc:304] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:54.482956 27857 tablet_replica.cc:333] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:54.483256 28072 raft_consensus.cc:2804] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:54.483652 26740 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:54.483678 28072 raft_consensus.cc:697] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
W20260928 20:02:54.484730 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 8f5ee801a9354a858356fb4e055a1863 because the tablet was not found. No further retry: Not found: Tablet not found: 8f5ee801a9354a858356fb4e055a1863
I20260928 20:02:54.484699 28072 consensus_queue.cc:237] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.486807 27984 raft_consensus.cc:2804] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:54.487154 27984 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:54.487450 27984 raft_consensus.cc:3060] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.487715 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:54.496707 26450 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:54.514201 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 335) took 2292 ms. Trace:
I20260928 20:02:54.514667 28059 rpcz_store.cc:276] 0928 20:02:52.221428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.223998 (+ 2570us) service_pool.cc:224] Handling call
0928 20:02:54.513905 (+2289907us) ts_tablet_manager.cc:1197] Deleting tablet a0dd3080d50748d2ad79f472d3c17673
0928 20:02:54.513953 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.514139 (+ 186us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2161951}
I20260928 20:02:54.517066 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 336) took 2295 ms. Trace:
I20260928 20:02:54.519258 28185 raft_consensus.cc:493] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.521013 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:02:54.523939 26774 tablet_service.cc:1511] Processing CreateTablet for tablet c49aa062e7674a47ac68fdadf68980b8 (DEFAULT_TABLE table=default.Table_58732efb3f0e459c8af18aac5919b612 [id=f3479b39c6f7407fbd7b818cddb09f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.525453 26496 tablet_service.cc:1511] Processing CreateTablet for tablet c49aa062e7674a47ac68fdadf68980b8 (DEFAULT_TABLE table=default.Table_58732efb3f0e459c8af18aac5919b612 [id=f3479b39c6f7407fbd7b818cddb09f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.526460 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49aa062e7674a47ac68fdadf68980b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.526399 28185 raft_consensus.cc:515] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.528362 28185 leader_election.cc:290] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:54.497363 26916 tablet_bootstrap.cc:654] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.476766 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet f478cce587a548e1aab620721c3bb1c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 11216db10dc54e9fa8a7466643f8e413) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:54.533044 26490 tablet_service.cc:1511] Processing CreateTablet for tablet b3ee867b0443431ba816ee5309888080 (DEFAULT_TABLE table=default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.534017 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ee867b0443431ba816ee5309888080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.534400 28081 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:54.534912 28081 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.535395 28081 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.539870 28081 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:54.543577 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cb96cab3e647908f3e99981e7147c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.527215 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet b0655fc043b9468ea51ce5ae983e8f06 (table default.Table_bed2cb6494a544afb978a8521c702d03 [id=d8c4eedc317c4c5c8a008ab4ee6d94b3]) successfully deleted
W20260928 20:02:54.545133 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet a0dd3080d50748d2ad79f472d3c17673 because the tablet was not found. No further retry: Not found: Tablet not found: a0dd3080d50748d2ad79f472d3c17673
I20260928 20:02:54.545953 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:54.548038 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 3e7c544b3449427dab981465e2e08a38 (table default.Table_3d54d1555a914679a1a011feaa634329 [id=8bce5ded64774186a5e753c7037b977f]). Expected version 1 got 0
I20260928 20:02:54.550196 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:54.554628 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49aa062e7674a47ac68fdadf68980b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.557581 26776 tablet_service.cc:1511] Processing CreateTablet for tablet b3ee867b0443431ba816ee5309888080 (DEFAULT_TABLE table=default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.558531 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ee867b0443431ba816ee5309888080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.563607 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:54.571360 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:02:54.521160 28035 leader_election.cc:290] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:54.525909 26913 consensus_queue.cc:260] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.575313 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 91b11022fc774d18b92e0c694f834375 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]). Expected version 1 got 0
I20260928 20:02:54.575136 28059 rpcz_store.cc:276] 0928 20:02:52.221749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.227180 (+ 5431us) service_pool.cc:224] Handling call
0928 20:02:54.516819 (+2289639us) ts_tablet_manager.cc:1197] Deleting tablet 93fb4e1fd0584a42a4de9eab14d5578c
0928 20:02:54.516867 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.517018 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2164243}
I20260928 20:02:54.576337 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 338) took 2353 ms. Trace:
I20260928 20:02:54.576889 26913 ts_tablet_manager.cc:1480] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.178s user 0.007s sys 0.000s
I20260928 20:02:54.577723 26913 tablet_bootstrap.cc:492] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:54.577700 26783 tablet_service.cc:1511] Processing CreateTablet for tablet d3c3cffa96f043629e4bbfcf282d86bd (DEFAULT_TABLE table=default.Table_188a95a61c5a440dad4f7e0f583a07d2 [id=de8ca1bb519941c19146335d14ba155d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.531281 26632 tablet_service.cc:1511] Processing CreateTablet for tablet c49aa062e7674a47ac68fdadf68980b8 (DEFAULT_TABLE table=default.Table_58732efb3f0e459c8af18aac5919b612 [id=f3479b39c6f7407fbd7b818cddb09f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.531719 26633 tablet_service.cc:1511] Processing CreateTablet for tablet b3ee867b0443431ba816ee5309888080 (DEFAULT_TABLE table=default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.579072 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ee867b0443431ba816ee5309888080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.579072 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c3cffa96f043629e4bbfcf282d86bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.583797 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49aa062e7674a47ac68fdadf68980b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.562307 26631 tablet_service.cc:1511] Processing CreateTablet for tablet d3c3cffa96f043629e4bbfcf282d86bd (DEFAULT_TABLE table=default.Table_188a95a61c5a440dad4f7e0f583a07d2 [id=de8ca1bb519941c19146335d14ba155d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.591473 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c3cffa96f043629e4bbfcf282d86bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.597100 28071 consensus_queue.cc:1048] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:02:54.576992 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 93fb4e1fd0584a42a4de9eab14d5578c because the tablet was not found. No further retry: Not found: Tablet not found: 93fb4e1fd0584a42a4de9eab14d5578c
I20260928 20:02:54.598223 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:02:54.598753 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]). Expected version 2 got 0
I20260928 20:02:54.599351 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:54.599948 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 19331ec575fa42d79c0dc18123d26d71 (DEFAULT_TABLE table=default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.600278 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 030f48d0d716450aaa4248d9fb1397ba (DEFAULT_TABLE table=default.Table_a47e5f225c19417296342e60482d31d1 [id=4b0f8fae05494c8087442a15e25109aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.600854 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19331ec575fa42d79c0dc18123d26d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.600881 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]). Expected version 3 got 0
I20260928 20:02:54.601169 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030f48d0d716450aaa4248d9fb1397ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.601743 26234 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:54.605276 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 19331ec575fa42d79c0dc18123d26d71 (DEFAULT_TABLE table=default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.606207 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19331ec575fa42d79c0dc18123d26d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.576617 28059 rpcz_store.cc:276] 0928 20:02:52.222508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.330050 (+107542us) service_pool.cc:224] Handling call
0928 20:02:54.576095 (+2246045us) ts_tablet_manager.cc:1197] Deleting tablet 018497a652234fbdb04cf6c034bcc5d3
0928 20:02:54.576137 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.576288 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2220719}
I20260928 20:02:54.631901 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 339) took 2409 ms. Trace:
I20260928 20:02:54.632638 26629 tablet_service.cc:1511] Processing CreateTablet for tablet 74f9252dd72c46b3acf84be7feb6a4f1 (DEFAULT_TABLE table=default.Table_52834d7c9e064555a1ed3e9cd8b98e34 [id=4e50219ff53c4c6c94eec881bb4cfe75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.634008 26629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f9252dd72c46b3acf84be7feb6a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:54.635144 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 162624us
W20260928 20:02:54.639760 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 018497a652234fbdb04cf6c034bcc5d3 because the tablet was not found. No further retry: Not found: Tablet not found: 018497a652234fbdb04cf6c034bcc5d3
I20260928 20:02:54.641256 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 61b2ba7635fd4a22ac367d3fdc4dd847 (DEFAULT_TABLE table=default.Table_c6e3b12edab441c89f9e255a1a1a001c [id=54949ec9d297437d8f79a73d487f9b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.643220 26231 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:54.643925 26231 catalog_manager.cc:5838] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:54.645244 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 74f9252dd72c46b3acf84be7feb6a4f1 (DEFAULT_TABLE table=default.Table_52834d7c9e064555a1ed3e9cd8b98e34 [id=4e50219ff53c4c6c94eec881bb4cfe75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.646426 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f9252dd72c46b3acf84be7feb6a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:54.638455 26739 consensus_peers.cc:597] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:54.657001 26739 leader_election.cc:304] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:02:54.660161 27907 raft_consensus.cc:2804] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:54.660859 27907 raft_consensus.cc:697] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:54.661926 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 61b2ba7635fd4a22ac367d3fdc4dd847 (DEFAULT_TABLE table=default.Table_c6e3b12edab441c89f9e255a1a1a001c [id=54949ec9d297437d8f79a73d487f9b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.662907 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b2ba7635fd4a22ac367d3fdc4dd847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.664285 27907 consensus_queue.cc:237] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.632289 28059 rpcz_store.cc:276] 0928 20:02:52.222843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.329987 (+107144us) service_pool.cc:224] Handling call
0928 20:02:54.631592 (+2301605us) ts_tablet_manager.cc:1197] Deleting tablet 596a5540716441c49ec8185c8dc6a80c
0928 20:02:54.631647 (+ 55us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.631836 (+ 189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2159223}
W20260928 20:02:54.669258 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 596a5540716441c49ec8185c8dc6a80c because the tablet was not found. No further retry: Not found: Tablet not found: 596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:54.680740 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 01533b61bad74ddb9056aeacef13a126
I20260928 20:02:54.682096 26228 catalog_manager.cc:6934] ReplaceTablet: tablet 01533b61bad74ddb9056aeacef13a126 deleted and replaced by tablet 9d2a20c1c6464f228baae236015349c5
I20260928 20:02:54.682472 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 01533b61bad74ddb9056aeacef13a126 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d2a20c1c6464f228baae236015349c5) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:54.682940 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 01533b61bad74ddb9056aeacef13a126 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d2a20c1c6464f228baae236015349c5) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:54.687219 28030 ts_tablet_manager.cc:1975] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:54.687588 28030 log.cc:1199] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/c6544b7b405c4831900f37e052892409
I20260928 20:02:54.688251 28030 ts_tablet_manager.cc:1996] T c6544b7b405c4831900f37e052892409 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:54.569584 27857 raft_consensus.cc:2243] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:54.582826 26493 tablet_service.cc:1511] Processing CreateTablet for tablet d3c3cffa96f043629e4bbfcf282d86bd (DEFAULT_TABLE table=default.Table_188a95a61c5a440dad4f7e0f583a07d2 [id=de8ca1bb519941c19146335d14ba155d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.708128 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1791bc36c1449ebac8d1cef490be0a (DEFAULT_TABLE table=default.Table_b414add5e6554e31905d7f0162e3abb4 [id=9f809908d5c3416c895ea4d839c956ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.708413 27857 raft_consensus.cc:2272] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:54.708765 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c3cffa96f043629e4bbfcf282d86bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.710752 27857 ts_tablet_manager.cc:1962] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:54.595968 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 030f48d0d716450aaa4248d9fb1397ba (DEFAULT_TABLE table=default.Table_a47e5f225c19417296342e60482d31d1 [id=4b0f8fae05494c8087442a15e25109aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.714707 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030f48d0d716450aaa4248d9fb1397ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.716418 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1791bc36c1449ebac8d1cef490be0a (DEFAULT_TABLE table=default.Table_b414add5e6554e31905d7f0162e3abb4 [id=9f809908d5c3416c895ea4d839c956ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.717512 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1791bc36c1449ebac8d1cef490be0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.602929 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 19331ec575fa42d79c0dc18123d26d71 (DEFAULT_TABLE table=default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.718698 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19331ec575fa42d79c0dc18123d26d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.724623 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1791bc36c1449ebac8d1cef490be0a (DEFAULT_TABLE table=default.Table_b414add5e6554e31905d7f0162e3abb4 [id=9f809908d5c3416c895ea4d839c956ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.725605 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1791bc36c1449ebac8d1cef490be0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.725489 26628 tablet_service.cc:1511] Processing CreateTablet for tablet 56b3ac3820e34f519f593a794b7e0899 (DEFAULT_TABLE table=default.Table_4a912910bc1f4d59b94845c363144d28 [id=44987915fb2445b5b13c7df9db3e40e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.729269 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 56b3ac3820e34f519f593a794b7e0899 (DEFAULT_TABLE table=default.Table_4a912910bc1f4d59b94845c363144d28 [id=44987915fb2445b5b13c7df9db3e40e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.734316 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b3ac3820e34f519f593a794b7e0899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.738173 26638 tablet_service.cc:1511] Processing CreateTablet for tablet eb02b1f6bf4e43a08a3331438bf8e362 (DEFAULT_TABLE table=default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.739136 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 56b3ac3820e34f519f593a794b7e0899 (DEFAULT_TABLE table=default.Table_4a912910bc1f4d59b94845c363144d28 [id=44987915fb2445b5b13c7df9db3e40e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.740052 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b3ac3820e34f519f593a794b7e0899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.746254 28190 raft_consensus.cc:493] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.746685 28190 raft_consensus.cc:515] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.748780 28190 leader_election.cc:290] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:54.752661 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:02:54.753335 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:54.753294 26778 tablet_service.cc:1511] Processing CreateTablet for tablet eb02b1f6bf4e43a08a3331438bf8e362 (DEFAULT_TABLE table=default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.754460 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb02b1f6bf4e43a08a3331438bf8e362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.755029 26485 tablet_service.cc:1511] Processing CreateTablet for tablet eb02b1f6bf4e43a08a3331438bf8e362 (DEFAULT_TABLE table=default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.756108 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb02b1f6bf4e43a08a3331438bf8e362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.756102 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:54.757613 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]). Expected version 1 got 0
I20260928 20:02:54.760653 26625 tablet_service.cc:1511] Processing CreateTablet for tablet d0f9b3c3b4c84b19b4325152899e6b26 (DEFAULT_TABLE table=default.Table_8543155fabf44da1970cceef9f13d261 [id=d3d2473850b84badb95103c3973c6cd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.762236 26775 tablet_service.cc:1511] Processing CreateTablet for tablet d0f9b3c3b4c84b19b4325152899e6b26 (DEFAULT_TABLE table=default.Table_8543155fabf44da1970cceef9f13d261 [id=d3d2473850b84badb95103c3973c6cd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.763231 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f9b3c3b4c84b19b4325152899e6b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.775064 26913 tablet_bootstrap.cc:654] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:54.778290 26626 tablet_service.cc:1511] Processing CreateTablet for tablet d8c3346e3db1400c98623724cdf54901 (DEFAULT_TABLE table=default.Table_d3b253774b324f229aed498d392a1514 [id=e370d4e71e194623b62982406b02dfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.780517 26777 tablet_service.cc:1511] Processing CreateTablet for tablet d8c3346e3db1400c98623724cdf54901 (DEFAULT_TABLE table=default.Table_d3b253774b324f229aed498d392a1514 [id=e370d4e71e194623b62982406b02dfec]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:54.633839 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 114942us
I20260928 20:02:54.781078 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 585030449f204e5782c3200758324ebc (DEFAULT_TABLE table=default.Table_02fef5b38f4b4eb382f4fba80de72cc3 [id=e1a9ab96f14847059cea861f9b9c3492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.781467 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c3346e3db1400c98623724cdf54901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.640177 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 74f9252dd72c46b3acf84be7feb6a4f1 (DEFAULT_TABLE table=default.Table_52834d7c9e064555a1ed3e9cd8b98e34 [id=4e50219ff53c4c6c94eec881bb4cfe75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.782218 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f9252dd72c46b3acf84be7feb6a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.781993 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:54.784812 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:54.787377 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:54.787838 26772 tablet_service.cc:1511] Processing CreateTablet for tablet 585030449f204e5782c3200758324ebc (DEFAULT_TABLE table=default.Table_02fef5b38f4b4eb382f4fba80de72cc3 [id=e1a9ab96f14847059cea861f9b9c3492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.788954 26772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585030449f204e5782c3200758324ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.788713 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:54.795717 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13562e920244194969520df564a949d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:54.758080 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:02:54.797468 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:02:54.797735 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13562e920244194969520df564a949d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:54.799042 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:54.807124 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 353) took 2486 ms. Trace:
I20260928 20:02:54.807499 28030 rpcz_store.cc:276] 0928 20:02:52.321184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.321817 (+ 633us) service_pool.cc:224] Handling call
0928 20:02:53.933235 (+1611418us) ts_tablet_manager.cc:1197] Deleting tablet c6544b7b405c4831900f37e052892409
0928 20:02:53.933293 (+ 58us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.298567 (+365274us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.687098 (+388531us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.807055 (+119957us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1595055}
I20260928 20:02:54.808799 28030 tablet_replica.cc:333] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:54.809065 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet c6544b7b405c4831900f37e052892409 (table default.Table_9a00e08127ea41d988decb4e501ae54c [id=4ef471359f6a44ec8e83d75b99cf05c5]) successfully deleted
I20260928 20:02:54.808349 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:54.810695 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b2ba7635fd4a22ac367d3fdc4dd847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.810441 27984 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.811125 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 353) took 2431 ms. Trace:
I20260928 20:02:54.811187 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 91b11022fc774d18b92e0c694f834375 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]). Expected version 1 got 0
I20260928 20:02:54.811655 26233 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:54.811446 28059 rpcz_store.cc:276] 0928 20:02:52.381216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.381449 (+ 233us) service_pool.cc:224] Handling call
0928 20:02:54.669953 (+2288504us) ts_tablet_manager.cc:1197] Deleting tablet d13562e920244194969520df564a949d
0928 20:02:54.810798 (+140845us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.811068 (+ 270us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197077}
I20260928 20:02:54.812572 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 347) took 2434 ms. Trace:
W20260928 20:02:54.812623 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet d13562e920244194969520df564a949d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d13562e920244194969520df564a949d already in progress: creating tablet
I20260928 20:02:54.812851 28059 rpcz_store.cc:276] 0928 20:02:52.378460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.381662 (+ 3202us) service_pool.cc:224] Handling call
0928 20:02:54.812273 (+2430611us) ts_tablet_manager.cc:1197] Deleting tablet 80d7ab92a37c4f9b865fa9fe49d46916
0928 20:02:54.812310 (+ 37us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.812527 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2338982}
I20260928 20:02:54.813902 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 355) took 2388 ms. Trace:
W20260928 20:02:54.813992 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 80d7ab92a37c4f9b865fa9fe49d46916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80d7ab92a37c4f9b865fa9fe49d46916 already in progress: creating tablet
I20260928 20:02:54.814188 28059 rpcz_store.cc:276] 0928 20:02:52.425211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.425949 (+ 738us) service_pool.cc:224] Handling call
0928 20:02:54.813634 (+2387685us) ts_tablet_manager.cc:1197] Deleting tablet 4056bc0590264672bd7c4f6d97050dd5
0928 20:02:54.813668 (+ 34us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.813859 (+ 191us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2339947}
I20260928 20:02:54.815171 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 340) took 2592 ms. Trace:
W20260928 20:02:54.815272 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4056bc0590264672bd7c4f6d97050dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4056bc0590264672bd7c4f6d97050dd5 already in progress: creating tablet
I20260928 20:02:54.815460 28059 rpcz_store.cc:276] 0928 20:02:52.223195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.277912 (+ 54717us) service_pool.cc:224] Handling call
0928 20:02:54.814958 (+2537046us) ts_tablet_manager.cc:1197] Deleting tablet 8163815661694d70ba4c2e36a424eaa1
0928 20:02:54.814992 (+ 34us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.815125 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2323497}
I20260928 20:02:54.817384 27984 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:54.818555 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11216db10dc54e9fa8a7466643f8e413 has no consensus state
I20260928 20:02:54.818440 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:02:54.818964 26510 raft_consensus.cc:3060] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.819008 26236 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 394) took 1990 ms. Trace:
I20260928 20:02:54.819630 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1791bc36c1449ebac8d1cef490be0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.819262 26236 rpcz_store.cc:276] 0928 20:02:52.828571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.829248 (+ 677us) service_pool.cc:224] Handling call
0928 20:02:52.836574 (+ 7326us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0abc96 00007ff79cc5b634 00007ff79cc5b5c2 00007ff79cc5b4f1 00007ff79cc5b46c 00007ff79cc5a722 00007ff79aefc15c 00007ff79aefb596
0928 20:02:52.837262 (+ 688us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:52.837872 (+ 610us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:52.849353 (+ 11481us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:52.849528 (+ 175us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:53.162930 (+313402us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:54.818955 (+1656025us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:52.966255 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:53.004203 (+ 37948us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:53.004229 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:53.004241 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:53.004506 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:53.004545 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:53.004569 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:53.004710 (+ 141us) tablet.cc:701] Row locks acquired
0928 20:02:53.004722 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:53.004820 (+ 98us) write_op.cc:270] Start()
0928 20:02:53.004891 (+ 71us) write_op.cc:276] Timestamp: P: 1790625773004773 usec, L: 0
0928 20:02:53.004908 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:53.005384 (+ 476us) log.cc:844] Serialized 405 byte log entry
0928 20:02:53.158373 (+152989us) op_driver.cc:464] REPLICATION: finished
0928 20:02:53.159475 (+ 1102us) write_op.cc:301] APPLY: starting
0928 20:02:53.159534 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:53.159627 (+ 93us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:53.159721 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:53.159870 (+ 149us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:53.160002 (+ 132us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:53.160043 (+ 41us) write_op.cc:312] APPLY: finished
0928 20:02:53.160208 (+ 165us) log.cc:844] Serialized 23 byte log entry
0928 20:02:53.160352 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:53.160427 (+ 75us) write_op.cc:454] Released schema lock
0928 20:02:53.160458 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:53.160674 (+ 216us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:53.160697 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":10205056,"child_traces":[["op",{"apply.queue_time_us":943,"apply.run_cpu_time_us":1165,"apply.run_wall_time_us":1165,"num_ops":1,"prepare.queue_time_us":111173,"prepare.run_cpu_time_us":1922,"prepare.run_wall_time_us":77254,"raft.queue_time_us":77,"raft.run_cpu_time_us":584,"raft.run_wall_time_us":584,"replication_time_us":153371}]]}
I20260928 20:02:54.823243 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b3ac3820e34f519f593a794b7e0899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.826536 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb02b1f6bf4e43a08a3331438bf8e362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.832635 26912 ts_tablet_manager.cc:1480] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.468s user 0.006s sys 0.001s
I20260928 20:02:54.833220 26625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f9b3c3b4c84b19b4325152899e6b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.834493 26510 raft_consensus.cc:2468] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:02:54.836107 28158 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 1735704245299129521) tablet 00000000000000000000000000000000 cur holder 0x7b5800011d00
I20260928 20:02:54.837080 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585030449f204e5782c3200758324ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.837838 26626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c3346e3db1400c98623724cdf54901. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:54.852659 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 8163815661694d70ba4c2e36a424eaa1 because the tablet was not found. No further retry: Not found: Tablet not found: 8163815661694d70ba4c2e36a424eaa1
I20260928 20:02:54.853413 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 342) took 2629 ms. Trace:
I20260928 20:02:54.853746 28059 rpcz_store.cc:276] 0928 20:02:52.223864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.330072 (+106208us) service_pool.cc:224] Handling call
0928 20:02:54.853158 (+2523086us) ts_tablet_manager.cc:1197] Deleting tablet aa4f373a46de433eabd3b35b6ed3d1e3
0928 20:02:54.853205 (+ 47us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.853360 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2361080}
W20260928 20:02:54.855055 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet aa4f373a46de433eabd3b35b6ed3d1e3 because the tablet was not found. No further retry: Not found: Tablet not found: aa4f373a46de433eabd3b35b6ed3d1e3
I20260928 20:02:54.855499 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 356) took 2430 ms. Trace:
I20260928 20:02:54.855760 28059 rpcz_store.cc:276] 0928 20:02:52.425557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.425672 (+ 115us) service_pool.cc:224] Handling call
0928 20:02:54.855202 (+2429530us) ts_tablet_manager.cc:1197] Deleting tablet 2239c466fa8e471e820173c67bc04cad
0928 20:02:54.855242 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.855454 (+ 212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2362697}
W20260928 20:02:54.856696 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 2239c466fa8e471e820173c67bc04cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2239c466fa8e471e820173c67bc04cad already in progress: creating tablet
I20260928 20:02:54.856920 28059 tablet_replica.cc:333] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:54.857636 28059 raft_consensus.cc:2243] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:54.858394 28059 raft_consensus.cc:2272] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:54.860641 28059 ts_tablet_manager.cc:1962] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:54.863833 26493 tablet_service.cc:1511] Processing CreateTablet for tablet d8c3346e3db1400c98623724cdf54901 (DEFAULT_TABLE table=default.Table_d3b253774b324f229aed498d392a1514 [id=e370d4e71e194623b62982406b02dfec]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:54.867424 26912 ts_tablet_manager.cc:1513] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Tablet startup took 503ms
I20260928 20:02:54.880997 26740 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:54.881060 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:54.882237 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 647a383938f947108890ae2042e3edc3 consensus state has no leader
I20260928 20:02:54.882750 26235 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:40138 (request call id 409) took 1322 ms. Trace:
I20260928 20:02:54.883037 26235 rpcz_store.cc:276] 0928 20:02:53.560687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.602401 (+ 41714us) service_pool.cc:224] Handling call
0928 20:02:53.603352 (+ 951us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:53.604184 (+ 832us) catalog_manager.cc:3764] Apply alter schema
0928 20:02:53.604743 (+ 559us) catalog_manager.cc:3796] Acquired catalog manager lock
0928 20:02:53.604958 (+ 215us) catalog_manager.cc:3954] Updating metadata on disk
0928 20:02:53.671543 (+ 66585us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:53.671584 (+ 41us) write_op.cc:454] Released schema lock
0928 20:02:53.671872 (+ 288us) catalog_manager.cc:3985] Committing alterations to in-memory state
0928 20:02:54.882691 (+1210819us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:53.633406 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:53.633861 (+ 455us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:53.633896 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:02:53.633916 (+ 20us) tablet.cc:662] Decoding operations
0928 20:02:53.634300 (+ 384us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:53.634354 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:53.634387 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:53.634570 (+ 183us) tablet.cc:701] Row locks acquired
0928 20:02:53.634588 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:02:53.634719 (+ 131us) write_op.cc:270] Start()
0928 20:02:53.634818 (+ 99us) write_op.cc:276] Timestamp: P: 1790625773634649 usec, L: 0
0928 20:02:53.634840 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:02:53.635462 (+ 622us) log.cc:844] Serialized 405 byte log entry
0928 20:02:53.647255 (+ 11793us) op_driver.cc:464] REPLICATION: finished
0928 20:02:53.647485 (+ 230us) write_op.cc:301] APPLY: starting
0928 20:02:53.647535 (+ 50us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:53.647628 (+ 93us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:53.647724 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:53.647902 (+ 178us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:53.648050 (+ 148us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:53.648098 (+ 48us) write_op.cc:312] APPLY: finished
0928 20:02:53.648269 (+ 171us) log.cc:844] Serialized 23 byte log entry
0928 20:02:53.648424 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:53.648485 (+ 61us) write_op.cc:454] Released schema lock
0928 20:02:53.648520 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":1235,"apply.run_wall_time_us":1234,"num_ops":1,"prepare.queue_time_us":27219,"prepare.run_cpu_time_us":2403,"prepare.run_wall_time_us":21370,"raft.queue_time_us":85,"raft.run_cpu_time_us":766,"raft.run_wall_time_us":766,"replication_time_us":12311}]]}
I20260928 20:02:54.886634 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a902e3fae2f041f2bbf4a0b16b4984d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:54.686234 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 01533b61bad74ddb9056aeacef13a126 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d2a20c1c6464f228baae236015349c5) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:54.705585 28189 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:54.707330 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 61b2ba7635fd4a22ac367d3fdc4dd847 (DEFAULT_TABLE table=default.Table_c6e3b12edab441c89f9e255a1a1a001c [id=54949ec9d297437d8f79a73d487f9b7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:54.888206 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:54.887881 28189 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:54.888811 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b2ba7635fd4a22ac367d3fdc4dd847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.888890 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:54.890190 28189 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:54.891254 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c3346e3db1400c98623724cdf54901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.893931 26650 raft_consensus.cc:3060] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:54.865105 26494 tablet_service.cc:1511] Processing CreateTablet for tablet d0f9b3c3b4c84b19b4325152899e6b26 (DEFAULT_TABLE table=default.Table_8543155fabf44da1970cceef9f13d261 [id=d3d2473850b84badb95103c3973c6cd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.898959 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f9b3c3b4c84b19b4325152899e6b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.655646 26916 tablet_bootstrap.cc:492] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:54.901419 26916 ts_tablet_manager.cc:1449] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.427s user 0.008s sys 0.003s
I20260928 20:02:54.870635 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 585030449f204e5782c3200758324ebc (DEFAULT_TABLE table=default.Table_02fef5b38f4b4eb382f4fba80de72cc3 [id=e1a9ab96f14847059cea861f9b9c3492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.904122 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585030449f204e5782c3200758324ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:54.903825 26916 raft_consensus.cc:359] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.904456 26916 raft_consensus.cc:385] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:54.904700 26916 raft_consensus.cc:740] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:54.905241 26916 consensus_queue.cc:260] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:54.910517 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6161480f563f4672a8ae27fe327141a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:54.915184 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6161480f563f4672a8ae27fe327141a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:54.948482 28059 ts_tablet_manager.cc:1975] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:54.948850 28059 log.cc:1199] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:54.949540 28059 ts_tablet_manager.cc:1996] T 4d0308d824cf401c8cca0cf7a950fd53 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:54.926657 26227 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:02:54.987577 26227 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 402) took 1781 ms. Trace:
I20260928 20:02:54.987973 26227 rpcz_store.cc:276] 0928 20:02:53.206416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.206522 (+ 106us) service_pool.cc:224] Handling call
0928 20:02:53.290901 (+ 84379us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0ab926 00007ff79cc56b34 00007ff79cc56ac2 00007ff79cc569f1 00007ff79cc5696c 00007ff79cc55c22 00007ff79aefc15c 00007ff79aefb596
0928 20:02:53.291876 (+ 975us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:53.292311 (+ 435us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:53.292452 (+ 141us) catalog_manager.cc:2863] Locking tablets
0928 20:02:54.239738 (+947286us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:54.260423 (+ 20685us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:54.260605 (+ 182us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:54.926564 (+665959us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:54.987505 (+ 60941us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:54.241499 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:54.241866 (+ 367us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:54.241891 (+ 25us) write_op.cc:435] Acquired schema lock
0928 20:02:54.241903 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:54.242223 (+ 320us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:54.242269 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:54.242295 (+ 26us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:54.242587 (+ 292us) tablet.cc:701] Row locks acquired
0928 20:02:54.242603 (+ 16us) write_op.cc:260] PREPARE: finished
0928 20:02:54.242719 (+ 116us) write_op.cc:270] Start()
0928 20:02:54.242800 (+ 81us) write_op.cc:276] Timestamp: P: 1790625774242546 usec, L: 0
0928 20:02:54.242819 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:02:54.243303 (+ 484us) log.cc:844] Serialized 734 byte log entry
0928 20:02:54.254046 (+ 10743us) op_driver.cc:464] REPLICATION: finished
0928 20:02:54.257689 (+ 3643us) write_op.cc:301] APPLY: starting
0928 20:02:54.257744 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:54.257848 (+ 104us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:54.257950 (+ 102us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:54.258210 (+ 260us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:54.258356 (+ 146us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:54.258400 (+ 44us) write_op.cc:312] APPLY: finished
0928 20:02:54.258567 (+ 167us) log.cc:844] Serialized 29 byte log entry
0928 20:02:54.260141 (+ 1574us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.260208 (+ 67us) write_op.cc:454] Released schema lock
0928 20:02:54.260239 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:54.261784 (+ 1545us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.261811 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":192314752,"child_traces":[["op",{"apply.queue_time_us":3513,"apply.run_cpu_time_us":1340,"apply.run_wall_time_us":4054,"num_ops":2,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":2109,"prepare.run_wall_time_us":16068,"raft.queue_time_us":83,"raft.run_cpu_time_us":668,"raft.run_wall_time_us":668,"replication_time_us":11142}]]}
I20260928 20:02:54.993323 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b6e9471784104b748304857c18d1c3c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:54.995078 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6e9471784104b748304857c18d1c3c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:54.997516 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 030f48d0d716450aaa4248d9fb1397ba (DEFAULT_TABLE table=default.Table_a47e5f225c19417296342e60482d31d1 [id=4b0f8fae05494c8087442a15e25109aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:54.998622 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030f48d0d716450aaa4248d9fb1397ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:54.868907 26912 ts_tablet_manager.cc:1515] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Trace:
0928 20:02:38.313540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:38.313665 (+ 125us) service_pool.cc:224] Handling call
0928 20:02:38.314767 (+ 1102us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:38.314849 (+ 82us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:38.322360 (+ 7511us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:38.504081 (+181721us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:38.504463 (+ 382us) inbound_call.cc:177] Queueing success response
0928 20:02:54.010297 (+15505834us) ts_tablet_manager.cc:1425] Bootstrapping tablet
0928 20:02:54.364273 (+353976us) ts_tablet_manager.cc:1481] Starting tablet replica
0928 20:02:54.364744 (+ 471us) tablet_replica.cc:261] Starting instrumentation
0928 20:02:54.372560 (+ 7816us) tablet_replica.cc:280] Starting consensus
0928 20:02:54.831834 (+459274us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400119ed4. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0d00935b01 00007f0d009c39be 00007f0d009c251d 00007f0d00e1645e 00007f0d01a807ea 00007f0d01a95971 00007f0d01a95919 00007f0d01a958a9 00007f0d01a95871 00007f0d01a94b4d 00000000005bd5a4
Metrics: {"raft.queue_time_us":3383,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"spinlock_wait_cycles":670809472,"tablet-open.queue_time_us":15505904}
W20260928 20:02:54.953168 26232 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 80) took 3140 ms (client timeout 1000 ms). Trace:
I20260928 20:02:54.958244 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:55.020864 26228 catalog_manager.cc:5838] T 4433b79132934b48a3f2dd089592fcaf P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:55.023412 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:55.024515 26228 catalog_manager.cc:5838] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:55.026582 26228 catalog_manager.cc:5838] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:54.934201 28072 raft_consensus.cc:2804] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:02:55.040233 26450 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.045855 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 345) took 2680 ms. Trace:
I20260928 20:02:55.046197 28059 rpcz_store.cc:276] 0928 20:02:52.365292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.383369 (+ 18077us) service_pool.cc:224] Handling call
0928 20:02:54.856771 (+2473402us) ts_tablet_manager.cc:1197] Deleting tablet 4d0308d824cf401c8cca0cf7a950fd53
0928 20:02:54.856813 (+ 42us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.933975 (+ 77162us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:54.948373 (+ 14398us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.045793 (+ 97420us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2363911}
I20260928 20:02:55.048277 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:55.063823 28030 raft_consensus.cc:2243] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:55.064404 28030 raft_consensus.cc:2272] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:55.082089 28059 tablet_replica.cc:333] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:55.086540 26228 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:55.088343 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet b94aed8337bb4b20b7977e91640c6710
I20260928 20:02:55.089859 26230 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 410) took 1471 ms. Trace:
I20260928 20:02:55.090222 26230 rpcz_store.cc:276] 0928 20:02:53.618510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.618638 (+ 128us) service_pool.cc:224] Handling call
0928 20:02:53.620203 (+ 1565us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:53.734613 (+114410us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:53.734870 (+ 257us) catalog_manager.cc:2863] Locking tablets
0928 20:02:54.274160 (+539290us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:54.308314 (+ 34154us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:54.308503 (+ 189us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:55.088244 (+779741us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:55.089799 (+ 1555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:54.276157 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:54.276544 (+ 387us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:54.276568 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:54.276580 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:54.276855 (+ 275us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:54.276893 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:54.276915 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:54.277155 (+ 240us) tablet.cc:701] Row locks acquired
0928 20:02:54.277169 (+ 14us) write_op.cc:260] PREPARE: finished
0928 20:02:54.277269 (+ 100us) write_op.cc:270] Start()
0928 20:02:54.277355 (+ 86us) write_op.cc:276] Timestamp: P: 1790625774277098 usec, L: 0
0928 20:02:54.277371 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:54.277835 (+ 464us) log.cc:844] Serialized 765 byte log entry
0928 20:02:54.289108 (+ 11273us) op_driver.cc:464] REPLICATION: finished
0928 20:02:54.306602 (+ 17494us) write_op.cc:301] APPLY: starting
0928 20:02:54.306654 (+ 52us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:54.306757 (+ 103us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:54.306839 (+ 82us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:54.307106 (+ 267us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:54.307233 (+ 127us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:54.307279 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:02:54.307456 (+ 177us) log.cc:844] Serialized 29 byte log entry
0928 20:02:54.308038 (+ 582us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.308105 (+ 67us) write_op.cc:454] Released schema lock
0928 20:02:54.308135 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:54.309098 (+ 963us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.309122 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":17336,"apply.run_cpu_time_us":1284,"apply.run_wall_time_us":2035,"num_ops":2,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":1973,"prepare.run_wall_time_us":16470,"raft.queue_time_us":83,"raft.run_cpu_time_us":690,"raft.run_wall_time_us":690,"replication_time_us":11612}]]}
I20260928 20:02:55.096632 28059 raft_consensus.cc:2243] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
W20260928 20:02:55.099663 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_932f16b87c7e4e89a0cd7f710df1532d [id=1e0af613169c4eb7b1bc6dbca175a3c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 647a383938f947108890ae2042e3edc3 consensus state has no leader
W20260928 20:02:55.101621 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 54799.3us
I20260928 20:02:55.095860 28079 raft_consensus.cc:493] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.106539 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_4adff15039a443e4a3b9450d5b0cc415" } new_table_name: "default.Table_73bad59d2f45422d9e7f0409bdc4a2f4" modify_external_catalogs: true
I20260928 20:02:55.108323 28059 raft_consensus.cc:2272] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:55.102986 26595 leader_election.cc:304] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:55.105672 28079 raft_consensus.cc:515] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.111505 28079 leader_election.cc:290] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:55.114315 28059 ts_tablet_manager.cc:1962] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:55.130833 28030 ts_tablet_manager.cc:1962] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:55.144263 26913 tablet_bootstrap.cc:492] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:55.068735 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c2e7429ecbd942bd908a88d634de17c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.147365 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2e7429ecbd942bd908a88d634de17c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:55.027585 26232 rpcz_store.cc:269] 0928 20:02:51.812854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.902883 (+ 90029us) service_pool.cc:224] Handling call
0928 20:02:52.040284 (+137401us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:52.767370 (+727086us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:52.767397 (+ 27us) write_op.cc:454] Released schema lock
0928 20:02:54.953099 (+2185702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:52.710560 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:52.710988 (+ 428us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:52.711015 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:52.711027 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:52.711267 (+ 240us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:52.711306 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:52.711327 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:52.711477 (+ 150us) tablet.cc:701] Row locks acquired
0928 20:02:52.711511 (+ 34us) write_op.cc:260] PREPARE: finished
0928 20:02:52.711612 (+ 101us) write_op.cc:270] Start()
0928 20:02:52.711690 (+ 78us) write_op.cc:276] Timestamp: P: 1790625772711539 usec, L: 0
0928 20:02:52.711707 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:52.712187 (+ 480us) log.cc:844] Serialized 536 byte log entry
0928 20:02:52.727567 (+ 15380us) op_driver.cc:464] REPLICATION: finished
0928 20:02:52.728139 (+ 572us) write_op.cc:301] APPLY: starting
0928 20:02:52.728188 (+ 49us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:52.728291 (+ 103us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:52.728385 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:52.728548 (+ 163us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:52.728664 (+ 116us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:52.728706 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:02:52.728879 (+ 173us) log.cc:844] Serialized 23 byte log entry
0928 20:02:52.729023 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:52.729077 (+ 54us) write_op.cc:454] Released schema lock
0928 20:02:52.729105 (+ 28us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":54,"spinlock_wait_cycles":192109440,"child_traces":[["op",{"apply.queue_time_us":433,"apply.run_cpu_time_us":1130,"apply.run_wall_time_us":1129,"num_ops":1,"prepare.queue_time_us":1759,"prepare.run_cpu_time_us":1901,"prepare.run_wall_time_us":1901,"raft.queue_time_us":2567,"raft.run_cpu_time_us":897,"raft.run_wall_time_us":897,"replication_time_us":15771,"spinlock_wait_cycles":190720}]]}
I20260928 20:02:55.152725 26912 tablet_bootstrap.cc:492] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:55.152263 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8dac60ef95054a91bc0db9395475e806"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:55.153338 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 4d0308d824cf401c8cca0cf7a950fd53 (table default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]) successfully deleted
I20260928 20:02:55.152359 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet b94aed8337bb4b20b7977e91640c6710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:55.154223 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dac60ef95054a91bc0db9395475e806 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.154762 26913 ts_tablet_manager.cc:1449] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.577s user 0.032s sys 0.027s
I20260928 20:02:55.154871 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 0aad5c72e4c64b9e91082860477c78fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:55.079110 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c337753d93e448c28340ef32cc51734d" } new_table_name: "default.Table_5ba4c601ff274fa3a64efd31ccbc6074" modify_external_catalogs: true
I20260928 20:02:55.171681 26913 raft_consensus.cc:359] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.172405 26913 raft_consensus.cc:385] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.172695 26913 raft_consensus.cc:740] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.173408 26913 consensus_queue.cc:260] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.188398 26913 ts_tablet_manager.cc:1480] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20260928 20:02:55.195540 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_71dac26ca689411e89880e236cf117b6" } modify_external_catalogs: true
I20260928 20:02:55.196593 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_71dac26ca689411e89880e236cf117b6" } modify_external_catalogs: true
I20260928 20:02:55.189266 26913 tablet_bootstrap.cc:492] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:55.074229 26496 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.075043 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 0aad5c72e4c64b9e91082860477c78fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.078308 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet b059111d6383414890a28c2947934dd8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb02b1f6bf4e43a08a3331438bf8e362) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.078714 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.079136 26488 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.079226 28185 raft_consensus.cc:493] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.203902 28185 raft_consensus.cc:515] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.205590 26913 tablet_bootstrap.cc:654] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.205837 28185 leader_election.cc:290] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:55.203563 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 163358us
W20260928 20:02:55.206665 26450 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:55.207202 26450 leader_election.cc:343] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:55.207719 26450 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.083690 26916 ts_tablet_manager.cc:1480] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.182s user 0.003s sys 0.002s
I20260928 20:02:55.209492 26916 tablet_bootstrap.cc:492] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:55.088564 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.102046 26486 tablet_service.cc:1558] Processing DeleteTablet for tablet b94aed8337bb4b20b7977e91640c6710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.106858 28190 raft_consensus.cc:493] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.214357 28190 raft_consensus.cc:515] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.216352 28190 leader_election.cc:290] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:55.108300 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.222896 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f5ee801a9354a858356fb4e055a1863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.121069 27857 ts_tablet_manager.cc:1975] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:55.224118 27857 log.cc:1199] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/ee464b814dbf4e4b89b2d1c019befac6
I20260928 20:02:55.225131 27857 ts_tablet_manager.cc:1996] T ee464b814dbf4e4b89b2d1c019befac6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:55.226279 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 361) took 3171 ms. Trace:
I20260928 20:02:55.226634 27857 rpcz_store.cc:276] 0928 20:02:52.054881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.055009 (+ 128us) service_pool.cc:224] Handling call
0928 20:02:54.482820 (+2427811us) ts_tablet_manager.cc:1197] Deleting tablet ee464b814dbf4e4b89b2d1c019befac6
0928 20:02:54.482865 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:54.806598 (+323733us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.120938 (+314340us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.226226 (+105288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85894,"tablet-delete.queue_time_us":2427266}
I20260928 20:02:55.231860 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]) successfully deleted
I20260928 20:02:55.250789 26913 tablet_bootstrap.cc:492] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:55.251178 26913 ts_tablet_manager.cc:1449] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.001s
I20260928 20:02:55.253443 26913 raft_consensus.cc:359] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.254050 26913 raft_consensus.cc:385] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.254323 26913 raft_consensus.cc:740] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.258368 26913 consensus_queue.cc:260] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.260951 26913 ts_tablet_manager.cc:1480] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260928 20:02:55.261770 26913 tablet_bootstrap.cc:492] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:55.270056 26913 tablet_bootstrap.cc:654] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.276298 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:55.278455 28079 raft_consensus.cc:2749] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:55.282301 27857 tablet_replica.cc:333] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:55.283227 27857 raft_consensus.cc:2243] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:55.287004 26236 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:55.288193 26233 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_3d54d1555a914679a1a011feaa634329 [id=8bce5ded64774186a5e753c7037b977f] alter complete (version 1)
I20260928 20:02:55.288196 26229 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_21a9c8b591bd46a595f6762efcdb8a58 [id=7eeccc44c73f46b88801b8107c5b1cc9] alter complete (version 2)
W20260928 20:02:55.297573 26231 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 65) took 1833 ms (client timeout 1000 ms). Trace:
I20260928 20:02:55.302974 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 38abbc891d9c4268820cb0faba3d08b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 91b11022fc774d18b92e0c694f834375) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:55.303637 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet db5f5f16f2d7457799e1b96a293695f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:46 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:55.304339 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet b0655fc043b9468ea51ce5ae983e8f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:33 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:55.306270 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d0308d824cf401c8cca0cf7a950fd53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:55.306849 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23636443834932852f21092be1d1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1d945be7bea449ba8c5541b60eb18334) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:55.293830 26229 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 61) took 1837 ms (client timeout 1000 ms). Trace:
W20260928 20:02:55.314498 26229 rpcz_store.cc:269] 0928 20:02:53.456850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.456991 (+ 141us) service_pool.cc:224] Handling call
0928 20:02:54.462409 (+1005418us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.462437 (+ 28us) write_op.cc:454] Released schema lock
0928 20:02:55.293766 (+831329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:54.384464 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:54.384821 (+ 357us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:54.384847 (+ 26us) write_op.cc:435] Acquired schema lock
0928 20:02:54.384859 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:54.385103 (+ 244us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:54.385142 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:54.385166 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:54.385332 (+ 166us) tablet.cc:701] Row locks acquired
0928 20:02:54.385354 (+ 22us) write_op.cc:260] PREPARE: finished
0928 20:02:54.385458 (+ 104us) write_op.cc:270] Start()
0928 20:02:54.385530 (+ 72us) write_op.cc:276] Timestamp: P: 1790625774385419 usec, L: 0
0928 20:02:54.385546 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:54.385989 (+ 443us) log.cc:844] Serialized 356 byte log entry
0928 20:02:54.395706 (+ 9717us) op_driver.cc:464] REPLICATION: finished
0928 20:02:54.402732 (+ 7026us) write_op.cc:301] APPLY: starting
0928 20:02:54.402786 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:54.402874 (+ 88us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:54.402956 (+ 82us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:54.403116 (+ 160us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:54.403241 (+ 125us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:54.403284 (+ 43us) write_op.cc:312] APPLY: finished
0928 20:02:54.403454 (+ 170us) log.cc:844] Serialized 23 byte log entry
0928 20:02:54.403592 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.403650 (+ 58us) write_op.cc:454] Released schema lock
0928 20:02:54.403682 (+ 32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":391,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":6888,"apply.run_cpu_time_us":1115,"apply.run_wall_time_us":1114,"num_ops":1,"prepare.queue_time_us":51542,"prepare.run_cpu_time_us":1812,"prepare.run_wall_time_us":1812,"raft.queue_time_us":1242,"raft.run_cpu_time_us":623,"raft.run_wall_time_us":622,"replication_time_us":10082}]]}
I20260928 20:02:55.319857 27857 raft_consensus.cc:2272] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:55.322456 27857 ts_tablet_manager.cc:1962] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:55.298020 26231 rpcz_store.cc:269] 0928 20:02:53.464495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.464616 (+ 121us) service_pool.cc:224] Handling call
0928 20:02:55.297492 (+1832876us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:54.646603 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:54.646964 (+ 361us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:54.646988 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:54.647001 (+ 13us) tablet.cc:662] Decoding operations
0928 20:02:54.647235 (+ 234us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:54.647275 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:54.647297 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:54.647428 (+ 131us) tablet.cc:701] Row locks acquired
0928 20:02:54.647440 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:54.647539 (+ 99us) write_op.cc:270] Start()
0928 20:02:54.647618 (+ 79us) write_op.cc:276] Timestamp: P: 1790625774647479 usec, L: 0
0928 20:02:54.647634 (+ 16us) op_driver.cc:348] REPLICATION: starting
0928 20:02:54.648212 (+ 578us) log.cc:844] Serialized 536 byte log entry
0928 20:02:54.657149 (+ 8937us) op_driver.cc:464] REPLICATION: finished
0928 20:02:54.657466 (+ 317us) write_op.cc:301] APPLY: starting
0928 20:02:54.657526 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:54.657633 (+ 107us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:54.657728 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:54.657909 (+ 181us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:54.658056 (+ 147us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:54.658108 (+ 52us) write_op.cc:312] APPLY: finished
0928 20:02:54.658315 (+ 207us) log.cc:844] Serialized 23 byte log entry
0928 20:02:54.658471 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.658534 (+ 63us) write_op.cc:454] Released schema lock
0928 20:02:54.658572 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:54.658792 (+ 220us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:54.658819 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":183,"apply.run_cpu_time_us":1298,"apply.run_wall_time_us":1297,"num_ops":1,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":1888,"prepare.run_wall_time_us":1889,"raft.queue_time_us":157,"raft.run_cpu_time_us":585,"raft.run_wall_time_us":585,"replication_time_us":9436}]]}
I20260928 20:02:55.325935 26625 tablet_service.cc:1558] Processing DeleteTablet for tablet b059111d6383414890a28c2947934dd8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb02b1f6bf4e43a08a3331438bf8e362) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:55.331791 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 123550us
W20260928 20:02:55.332384 26450 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.332726 26450 leader_election.cc:304] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:55.333660 28185 raft_consensus.cc:2749] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:02:55.334702 26450 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.335040 26450 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:55.335943 28185 raft_consensus.cc:2749] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:55.336063 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f8219cfe619d4917a68dc3e0eee210a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.336992 26450 leader_election.cc:343] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:55.337915 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8219cfe619d4917a68dc3e0eee210a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.340732 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.342387 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.345582 26231 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7199ac53613b456991c7551d779d0e75" } modify_external_catalogs: true
I20260928 20:02:55.346095 26231 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7199ac53613b456991c7551d779d0e75" } modify_external_catalogs: true
W20260928 20:02:55.364681 26234 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 91b11022fc774d18b92e0c694f834375 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 91b11022fc774d18b92e0c694f834375 consensus state has no leader
I20260928 20:02:55.387537 28185 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.388211 28185 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.390413 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet ee464b814dbf4e4b89b2d1c019befac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.392006 28185 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:55.399772 26234 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 81) took 2448 ms (client timeout 1000 ms). Trace:
W20260928 20:02:55.400158 26234 rpcz_store.cc:269] 0928 20:02:52.951381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.951481 (+ 100us) service_pool.cc:224] Handling call
0928 20:02:55.399705 (+2448224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48280,"reported_tablets":55}
I20260928 20:02:55.407913 28059 ts_tablet_manager.cc:1975] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:55.408265 28059 log.cc:1199] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/ee464b814dbf4e4b89b2d1c019befac6
I20260928 20:02:55.408933 28059 ts_tablet_manager.cc:1996] T ee464b814dbf4e4b89b2d1c019befac6 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:55.409618 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 349) took 3030 ms. Trace:
W20260928 20:02:55.417531 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01e47444ae914b07a7e3e64711423635 consensus state has no leader
I20260928 20:02:55.419603 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547] alter complete (version 1)
I20260928 20:02:55.422284 26916 tablet_bootstrap.cc:654] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.425583 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e3f31a7190fb467592f9ddce456e89b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.427058 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3f31a7190fb467592f9ddce456e89b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.433349 28030 ts_tablet_manager.cc:1975] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:55.436528 26233 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152] alter complete (version 3)
I20260928 20:02:55.462730 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:55.464682 26228 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 66) took 955 ms (client timeout 1000 ms). Trace:
I20260928 20:02:55.469677 26625 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:02:55.471508 26236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:41889 (request call id 62) took 885 ms (client timeout 1000 ms). Trace:
W20260928 20:02:55.475250 26236 rpcz_store.cc:269] 0928 20:02:54.586372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.836589 (+250217us) service_pool.cc:224] Handling call
0928 20:02:55.471448 (+634859us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":17}
W20260928 20:02:55.465083 26228 rpcz_store.cc:269] 0928 20:02:54.509772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.682593 (+172821us) service_pool.cc:224] Handling call
0928 20:02:55.464626 (+782033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:55.239451 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:55.239875 (+ 424us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:55.239899 (+ 24us) write_op.cc:435] Acquired schema lock
0928 20:02:55.239913 (+ 14us) tablet.cc:662] Decoding operations
0928 20:02:55.240363 (+ 450us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:55.240398 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:55.240420 (+ 22us) tablet.cc:685] Acquiring locks for 3 operations
0928 20:02:55.240659 (+ 239us) tablet.cc:701] Row locks acquired
0928 20:02:55.240671 (+ 12us) write_op.cc:260] PREPARE: finished
0928 20:02:55.240776 (+ 105us) write_op.cc:270] Start()
0928 20:02:55.240856 (+ 80us) write_op.cc:276] Timestamp: P: 1790625775240707 usec, L: 0
0928 20:02:55.240870 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:55.241348 (+ 478us) log.cc:844] Serialized 1302 byte log entry
0928 20:02:55.259128 (+ 17780us) op_driver.cc:464] REPLICATION: finished
0928 20:02:55.262069 (+ 2941us) write_op.cc:301] APPLY: starting
0928 20:02:55.262130 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:55.262236 (+ 106us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:55.262323 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:55.262618 (+ 295us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:55.262751 (+ 133us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0928 20:02:55.262796 (+ 45us) write_op.cc:312] APPLY: finished
0928 20:02:55.262955 (+ 159us) log.cc:844] Serialized 35 byte log entry
0928 20:02:55.263091 (+ 136us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.263168 (+ 77us) write_op.cc:454] Released schema lock
0928 20:02:55.263199 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0928 20:02:55.350474 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:55.350833 (+ 359us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:55.350856 (+ 23us) write_op.cc:435] Acquired schema lock
0928 20:02:55.350868 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:55.351133 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:55.351175 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:55.351200 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:55.351352 (+ 152us) tablet.cc:701] Row locks acquired
0928 20:02:55.351367 (+ 15us) write_op.cc:260] PREPARE: finished
0928 20:02:55.351475 (+ 108us) write_op.cc:270] Start()
0928 20:02:55.351557 (+ 82us) write_op.cc:276] Timestamp: P: 1790625775351394 usec, L: 0
0928 20:02:55.351575 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:55.352023 (+ 448us) log.cc:844] Serialized 356 byte log entry
0928 20:02:55.411181 (+ 59158us) op_driver.cc:464] REPLICATION: finished
0928 20:02:55.414682 (+ 3501us) write_op.cc:301] APPLY: starting
0928 20:02:55.414731 (+ 49us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:55.414817 (+ 86us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:55.414918 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:55.415096 (+ 178us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:55.415224 (+ 128us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:55.415272 (+ 48us) write_op.cc:312] APPLY: finished
0928 20:02:55.415442 (+ 170us) log.cc:844] Serialized 23 byte log entry
0928 20:02:55.415560 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.415615 (+ 55us) write_op.cc:454] Released schema lock
0928 20:02:55.415641 (+ 26us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:55.422275 (+ 6634us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.422301 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26419,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":2725,"apply.run_cpu_time_us":1332,"apply.run_wall_time_us":19093,"mutex_wait_us":38958,"num_ops":3,"prepare.queue_time_us":65115,"prepare.run_cpu_time_us":2177,"prepare.run_wall_time_us":16847,"raft.queue_time_us":422,"raft.run_cpu_time_us":640,"raft.run_wall_time_us":640,"replication_time_us":18090}],["op",{"apply.queue_time_us":3386,"apply.run_cpu_time_us":1157,"apply.run_wall_time_us":7549,"num_ops":1,"prepare.queue_time_us":41139,"prepare.run_cpu_time_us":1832,"prepare.run_wall_time_us":8343,"raft.queue_time_us":1365,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":59528}]]}
I20260928 20:02:55.472666 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_aea43c3f34b8444484b021f67a963b41" } new_table_name: "default.Table_9bd62df93b6941469bc0076ad8615256" modify_external_catalogs: true
I20260928 20:02:55.514768 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3df208002e624823846e63d97d7d9038"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.516327 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3df208002e624823846e63d97d7d9038 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.546123 26483 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.547314 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:55.337443 26450 leader_election.cc:304] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:55.551097 26450 raft_consensus.cc:2686] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260928 20:02:55.551987 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 215018us
W20260928 20:02:55.552860 26450 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.553368 26450 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:55.555056 28185 raft_consensus.cc:2749] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:55.557168 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:02:55.567796 26233 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 82) took 1412 ms (client timeout 1000 ms). Trace:
I20260928 20:02:55.575690 26913 tablet_bootstrap.cc:492] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:55.576116 26913 ts_tablet_manager.cc:1449] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.315s user 0.033s sys 0.091s
I20260928 20:02:55.578902 26913 raft_consensus.cc:359] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.579504 26913 raft_consensus.cc:385] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.579741 26913 raft_consensus.cc:740] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.585125 26913 consensus_queue.cc:260] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.590639 26913 ts_tablet_manager.cc:1480] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
W20260928 20:02:55.592159 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e09ad691ec3444d938a04a5c572b0cb consensus state has no leader
W20260928 20:02:55.568123 26233 rpcz_store.cc:269] 0928 20:02:54.155007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.186877 (+ 31870us) service_pool.cc:224] Handling call
0928 20:02:55.567718 (+1380841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:55.182333 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:55.182690 (+ 357us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:55.182712 (+ 22us) write_op.cc:435] Acquired schema lock
0928 20:02:55.182724 (+ 12us) tablet.cc:662] Decoding operations
0928 20:02:55.182949 (+ 225us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:55.183010 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:55.183029 (+ 19us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:55.183158 (+ 129us) tablet.cc:701] Row locks acquired
0928 20:02:55.183169 (+ 11us) write_op.cc:260] PREPARE: finished
0928 20:02:55.183265 (+ 96us) write_op.cc:270] Start()
0928 20:02:55.183340 (+ 75us) write_op.cc:276] Timestamp: P: 1790625775183202 usec, L: 0
0928 20:02:55.183354 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:55.183769 (+ 415us) log.cc:844] Serialized 356 byte log entry
0928 20:02:55.196764 (+ 12995us) op_driver.cc:464] REPLICATION: finished
0928 20:02:55.197724 (+ 960us) write_op.cc:301] APPLY: starting
0928 20:02:55.197783 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:55.197878 (+ 95us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:55.197995 (+ 117us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:55.198192 (+ 197us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:55.198349 (+ 157us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:55.198400 (+ 51us) write_op.cc:312] APPLY: finished
0928 20:02:55.198578 (+ 178us) log.cc:844] Serialized 23 byte log entry
0928 20:02:55.198720 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.198783 (+ 63us) write_op.cc:454] Released schema lock
0928 20:02:55.198815 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:55.199057 (+ 242us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.199084 (+ 27us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 20:02:55.358954 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:55.359339 (+ 385us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:55.359366 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:02:55.359383 (+ 17us) tablet.cc:662] Decoding operations
0928 20:02:55.359627 (+ 244us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:55.359665 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:55.359690 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:02:55.359826 (+ 136us) tablet.cc:701] Row locks acquired
0928 20:02:55.359840 (+ 14us) write_op.cc:260] PREPARE: finished
0928 20:02:55.359941 (+ 101us) write_op.cc:270] Start()
0928 20:02:55.360028 (+ 87us) write_op.cc:276] Timestamp: P: 1790625775359862 usec, L: 0
0928 20:02:55.360045 (+ 17us) op_driver.cc:348] REPLICATION: starting
0928 20:02:55.360507 (+ 462us) log.cc:844] Serialized 356 byte log entry
0928 20:02:55.424195 (+ 63688us) op_driver.cc:464] REPLICATION: finished
0928 20:02:55.430854 (+ 6659us) write_op.cc:301] APPLY: starting
0928 20:02:55.430903 (+ 49us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:55.431002 (+ 99us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:55.431089 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:55.431246 (+ 157us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:55.431363 (+ 117us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:02:55.431425 (+ 62us) write_op.cc:312] APPLY: finished
0928 20:02:55.434659 (+ 3234us) log.cc:844] Serialized 23 byte log entry
0928 20:02:55.435862 (+ 1203us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.435919 (+ 57us) write_op.cc:454] Released schema lock
0928 20:02:55.435948 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:55.436161 (+ 213us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:55.436191 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":434,"apply.run_cpu_time_us":1302,"apply.run_wall_time_us":1302,"num_ops":1,"prepare.queue_time_us":45351,"prepare.run_cpu_time_us":1683,"prepare.run_wall_time_us":1683,"raft.queue_time_us":3488,"raft.run_cpu_time_us":713,"raft.run_wall_time_us":714,"replication_time_us":13331}],["op",{"apply.queue_time_us":6521,"apply.run_cpu_time_us":1183,"apply.run_wall_time_us":5283,"num_ops":1,"prepare.queue_time_us":30016,"prepare.run_cpu_time_us":1862,"prepare.run_wall_time_us":34953,"raft.queue_time_us":3055,"raft.run_cpu_time_us":607,"raft.run_wall_time_us":1406,"replication_time_us":64059}]]}
I20260928 20:02:55.606052 28079 raft_consensus.cc:493] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.606529 28079 raft_consensus.cc:515] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.608741 28079 leader_election.cc:290] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:55.625059 26234 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8dac60ef95054a91bc0db9395475e806" } new_table_name: "default.Table_c613dc346aaa4561a9d6a48a884880ac" modify_external_catalogs: true
I20260928 20:02:55.461275 26778 tablet_service.cc:1558] Processing DeleteTablet for tablet 0aad5c72e4c64b9e91082860477c78fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:55.471544 26772 tablet_service.cc:1558] Processing DeleteTablet for tablet b94aed8337bb4b20b7977e91640c6710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:55.481190 26912 tablet_bootstrap.cc:654] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.518361 28072 raft_consensus.cc:697] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:55.526896 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet c6544b7b405c4831900f37e052892409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:55.546128 28219 tablet.cc:1751] T 718a2abfe21b4a2986b77e14e4e52152 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:55.562927 28199 consensus_queue.cc:1048] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:55.578869 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:55.652670 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3bbea633f65b40279f5e069f2cf18cd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.658252 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bbea633f65b40279f5e069f2cf18cd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.605931 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:55.667495 26802 raft_consensus.cc:2468] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:55.672537 28072 consensus_queue.cc:237] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.686715 28030 log.cc:1199] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:02:55.687863 28030 ts_tablet_manager.cc:1996] T 4d0308d824cf401c8cca0cf7a950fd53 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:55.690456 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 352) took 3369 ms. Trace:
I20260928 20:02:55.699579 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a8441fd485464204a3f365c57858acfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.701097 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8441fd485464204a3f365c57858acfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.701754 26913 tablet_bootstrap.cc:492] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:55.708323 26913 tablet_bootstrap.cc:654] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:02:55.715525 26234 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eeea1c0042ae4b6ebeab7d5a1eaf6c22 has no consensus state
I20260928 20:02:55.723585 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_12847c70617446c79bef47447bba6e7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:55.724380 26913 tablet_bootstrap.cc:492] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:55.724757 26913 ts_tablet_manager.cc:1449] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.000s
W20260928 20:02:55.725018 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12847c70617446c79bef47447bba6e7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.727069 26913 raft_consensus.cc:359] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.727676 26913 raft_consensus.cc:385] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.727922 26913 raft_consensus.cc:740] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.728689 26913 consensus_queue.cc:260] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.730827 26913 ts_tablet_manager.cc:1480] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260928 20:02:55.737092 27857 ts_tablet_manager.cc:1975] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:55.737737 27857 log.cc:1199] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/d13562e920244194969520df564a949d
I20260928 20:02:55.738595 27857 ts_tablet_manager.cc:1996] T d13562e920244194969520df564a949d P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:55.740512 26916 tablet_bootstrap.cc:492] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:55.740900 26916 ts_tablet_manager.cc:1449] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.532s user 0.010s sys 0.000s
I20260928 20:02:55.744148 26916 raft_consensus.cc:359] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.744817 26916 raft_consensus.cc:385] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.745131 26916 raft_consensus.cc:740] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.745906 26916 consensus_queue.cc:260] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.747964 26916 ts_tablet_manager.cc:1480] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260928 20:02:55.749590 26650 raft_consensus.cc:3060] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:55.759159 26916 tablet_bootstrap.cc:492] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:55.409938 28059 rpcz_store.cc:276] 0928 20:02:52.379087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.505354 (+126267us) service_pool.cc:224] Handling call
0928 20:02:55.047093 (+2541739us) ts_tablet_manager.cc:1197] Deleting tablet ee464b814dbf4e4b89b2d1c019befac6
0928 20:02:55.081950 (+ 34857us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.107238 (+ 25288us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b58000a37d0. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5dfc9d2b01 00007f5dfc9c563a 00007f5dfca47a47 00007f5dfca71c15 00007f5dfceb3c7c 00007f5dfdb1f06a 00007f5dfdb51080 00007f5dfdb374ad 00007f5dfdb37459 00007f5dfdb373e9 00007f5dfdb373b1
0928 20:02:55.136078 (+ 28840us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.407801 (+271723us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.409563 (+ 1762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17762944,"tablet-delete.queue_time_us":2541131}
I20260928 20:02:55.788497 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]) successfully deleted
I20260928 20:02:55.797436 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3caa6aa87b0d4322b7aa92ef4e177f09" } new_table_name: "default.Table_eaf2b74a92f54fbead13035a6b095ebc" modify_external_catalogs: true
I20260928 20:02:55.806783 26234 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d90e6a6913a54889810926926798a1b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:55.809015 26234 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90e6a6913a54889810926926798a1b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:55.813841 26913 tablet_bootstrap.cc:492] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:55.820452 26654 raft_consensus.cc:3060] T 4433b79132934b48a3f2dd089592fcaf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:55.829448 26913 tablet_bootstrap.cc:654] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.818418 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 364) took 3613 ms. Trace:
I20260928 20:02:55.833390 28059 tablet_replica.cc:333] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:55.834167 28059 raft_consensus.cc:2243] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:02:55.836644 28158 lock_manager.cc:585] Waited 2 seconds to obtain row lock on key '<redacted>' (key hash 1735704245299129521) tablet 00000000000000000000000000000000 cur holder 0x7b5800011d00
I20260928 20:02:55.843609 26913 tablet_bootstrap.cc:492] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:55.844036 26913 ts_tablet_manager.cc:1449] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.003s
I20260928 20:02:55.762181 28219 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41770 (request call id 390) took 1288 ms. Trace:
I20260928 20:02:55.771512 28205 consensus_queue.cc:1048] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:55.833523 27857 rpcz_store.cc:276] 0928 20:02:52.205002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.205445 (+ 443us) service_pool.cc:224] Handling call
0928 20:02:55.232064 (+3026619us) ts_tablet_manager.cc:1197] Deleting tablet d13562e920244194969520df564a949d
0928 20:02:55.282164 (+ 50100us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.329814 (+ 47650us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.736928 (+407114us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.818349 (+ 81421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36051,"tablet-delete.queue_time_us":3026103}
I20260928 20:02:55.848259 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet d13562e920244194969520df564a949d (table default.Table_a47e5f225c19417296342e60482d31d1 [id=4b0f8fae05494c8087442a15e25109aa]) successfully deleted
I20260928 20:02:55.848803 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 367) took 3499 ms. Trace:
I20260928 20:02:55.842723 28072 raft_consensus.cc:493] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.849105 27857 rpcz_store.cc:276] 0928 20:02:52.349540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.349671 (+ 131us) service_pool.cc:224] Handling call
0928 20:02:55.848462 (+3498791us) ts_tablet_manager.cc:1197] Deleting tablet 4056bc0590264672bd7c4f6d97050dd5
0928 20:02:55.848505 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.848746 (+ 241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3474266}
I20260928 20:02:55.847096 28219 rpcz_store.cc:276] 0928 20:02:54.473828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.473934 (+ 106us) service_pool.cc:224] Handling call
0928 20:02:55.762081 (+1288147us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:54.474835 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:54.475172 (+ 337us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:54.475210 (+ 38us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:54.475251 (+ 41us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:54.475356 (+ 105us) alter_schema_op.cc:128] START. Timestamp: 1790625774475286
0928 20:02:54.475374 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:02:54.475814 (+ 440us) log.cc:844] Serialized 173 byte log entry
0928 20:02:55.529988 (+1054174us) op_driver.cc:464] REPLICATION: finished
0928 20:02:55.546012 (+ 16024us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:02:55.642668 (+ 96656us) log.cc:844] Serialized 5 byte log entry
0928 20:02:55.759369 (+116701us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.760955 (+ 1586us) log.cc:844] Serialized 14 byte log entry
0928 20:02:55.761928 (+ 973us) alter_schema_op.cc:73] Released schema lock
0928 20:02:55.761962 (+ 34us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":15813,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":11177,"prepare.run_wall_time_us":112767,"raft.queue_time_us":177,"raft.run_cpu_time_us":763,"raft.run_wall_time_us":63778,"replication_time_us":1054484,"thread_start_us":230658,"threads_started":3,"wal-append.queue_time_us":211298,"wal-append.run_cpu_time_us":1098,"wal-append.run_wall_time_us":1003384}]]}
W20260928 20:02:55.850593 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 4056bc0590264672bd7c4f6d97050dd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4056bc0590264672bd7c4f6d97050dd5 already in progress: creating tablet
I20260928 20:02:55.849504 28072 raft_consensus.cc:515] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:55.853077 28072 leader_election.cc:290] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:55.853835 28059 raft_consensus.cc:2272] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:55.855671 28059 ts_tablet_manager.cc:1962] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:55.860941 26912 tablet_bootstrap.cc:492] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:55.861403 26912 ts_tablet_manager.cc:1449] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.709s user 0.010s sys 0.009s
I20260928 20:02:55.863763 26912 raft_consensus.cc:359] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:55.864234 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 311385us
W20260928 20:02:55.866897 26450 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.867241 26450 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:55.867933 28185 raft_consensus.cc:2749] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:55.870342 26913 raft_consensus.cc:359] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.871025 26913 raft_consensus.cc:385] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.871279 26913 raft_consensus.cc:740] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.872022 26913 consensus_queue.cc:260] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.874406 26913 ts_tablet_manager.cc:1480] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.030s user 0.005s sys 0.002s
I20260928 20:02:55.874959 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 368) took 3521 ms. Trace:
I20260928 20:02:55.875236 26913 tablet_bootstrap.cc:492] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:55.881261 26913 tablet_bootstrap.cc:654] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.888309 28059 ts_tablet_manager.cc:1975] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:55.888739 28059 log.cc:1199] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/c6544b7b405c4831900f37e052892409
I20260928 20:02:55.891857 28059 ts_tablet_manager.cc:1996] T c6544b7b405c4831900f37e052892409 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:55.893815 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 346) took 3515 ms. Trace:
I20260928 20:02:55.894579 28059 rpcz_store.cc:276] 0928 20:02:52.378066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.401712 (+ 23646us) service_pool.cc:224] Handling call
0928 20:02:55.789218 (+3387506us) ts_tablet_manager.cc:1197] Deleting tablet c6544b7b405c4831900f37e052892409
0928 20:02:55.833267 (+ 44049us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.863781 (+ 30514us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.888193 (+ 24412us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.893748 (+ 5555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19148,"tablet-delete.queue_time_us":3282634}
I20260928 20:02:55.895977 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet c6544b7b405c4831900f37e052892409 (table default.Table_9a00e08127ea41d988decb4e501ae54c [id=4ef471359f6a44ec8e83d75b99cf05c5]) successfully deleted
I20260928 20:02:55.897024 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 361) took 2994 ms. Trace:
I20260928 20:02:55.897352 28059 rpcz_store.cc:276] 0928 20:02:52.902463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.902671 (+ 208us) service_pool.cc:224] Handling call
0928 20:02:55.896711 (+2994040us) ts_tablet_manager.cc:1197] Deleting tablet b667a45712c1449384e1a288f55fd062
0928 20:02:55.896749 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.896977 (+ 228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2993532}
W20260928 20:02:55.898587 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet b667a45712c1449384e1a288f55fd062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b667a45712c1449384e1a288f55fd062 already in progress: creating tablet
I20260928 20:02:55.899627 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 362) took 2765 ms. Trace:
I20260928 20:02:55.900080 28059 rpcz_store.cc:276] 0928 20:02:53.134546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.134681 (+ 135us) service_pool.cc:224] Handling call
0928 20:02:55.899320 (+2764639us) ts_tablet_manager.cc:1197] Deleting tablet 5ac6aaf0a2434c1fb74dd313fd4b7116
0928 20:02:55.899358 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.899584 (+ 226us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2755941}
W20260928 20:02:55.901845 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 already in progress: creating tablet
I20260928 20:02:55.902799 28059 tablet_replica.cc:333] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:55.906517 28059 raft_consensus.cc:2243] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:55.908700 28059 raft_consensus.cc:2272] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:55.908633 27857 rpcz_store.cc:276] 0928 20:02:52.353121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.353248 (+ 127us) service_pool.cc:224] Handling call
0928 20:02:55.874639 (+3521391us) ts_tablet_manager.cc:1197] Deleting tablet 2239c466fa8e471e820173c67bc04cad
0928 20:02:55.874678 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.874907 (+ 229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3498449}
W20260928 20:02:55.909788 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 2239c466fa8e471e820173c67bc04cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2239c466fa8e471e820173c67bc04cad already in progress: creating tablet
I20260928 20:02:55.911875 26916 tablet_bootstrap.cc:700] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54: Time spent opening tablet: real 0.147s user 0.004s sys 0.000s
I20260928 20:02:55.912196 28059 ts_tablet_manager.cc:1962] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:55.914088 26913 tablet_bootstrap.cc:492] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:55.914636 26913 ts_tablet_manager.cc:1449] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.011s
I20260928 20:02:55.918838 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6ec1e12c8d3f4b0495f644ddc8ba7ad9" } new_table_name: "default.Table_a72e3f79d3d14d36b9c10099dbdde698" modify_external_catalogs: true
I20260928 20:02:55.919448 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626a876a51d04095b5dd54726bb995f3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:55.907694 28185 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.898962 28225 tablet.cc:1751] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:55.920738 28185 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.922647 28185 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:55.923874 26916 tablet_bootstrap.cc:654] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.924507 26913 raft_consensus.cc:359] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.925180 26913 raft_consensus.cc:385] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.925473 26913 raft_consensus.cc:740] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.847035 28030 rpcz_store.cc:276] 0928 20:02:52.320876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.321191 (+ 315us) service_pool.cc:224] Handling call
0928 20:02:54.808645 (+2487454us) ts_tablet_manager.cc:1197] Deleting tablet 4d0308d824cf401c8cca0cf7a950fd53
0928 20:02:54.808701 (+ 56us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.180951 (+372250us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.433191 (+252240us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.690386 (+257195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":318443,"tablet-delete.queue_time_us":2470259}
I20260928 20:02:55.872489 26774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 394) took 1273 ms. Trace:
I20260928 20:02:55.892977 28072 raft_consensus.cc:493] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.930518 28072 raft_consensus.cc:515] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.932408 28072 leader_election.cc:290] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:55.845904 26739 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.919632 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626a876a51d04095b5dd54726bb995f3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:55.933218 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 87367.4us
I20260928 20:02:55.920915 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:55.933892 26739 consensus_peers.cc:597] T 6c37ee6dd0e14f038c557985ab4c5b0b P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:55.934336 26913 consensus_queue.cc:260] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.936497 26913 ts_tablet_manager.cc:1480] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.022s user 0.004s sys 0.002s
W20260928 20:02:55.937153 26739 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:55.937424 26913 tablet_bootstrap.cc:492] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:02:55.938846 26739 consensus_peers.cc:597] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:55.938766 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_8987a47618464005976aa4f3131ab8fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:55.940542 26774 rpcz_store.cc:276] 0928 20:02:54.599004 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.934606 (+335602us) service_pool.cc:224] Handling call
0928 20:02:54.998182 (+ 63576us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:54.998290 (+ 108us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:55.403429 (+405139us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:55.872066 (+468637us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:55.872434 (+ 368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:55.940681 26232 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_415d1f100c494194b1cdf75679f205c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:55.942704 26913 tablet_bootstrap.cc:654] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:55.944573 28185 raft_consensus.cc:493] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.945039 28185 raft_consensus.cc:515] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:55.947315 28185 leader_election.cc:290] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:55.949576 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:02:55.949797 26912 raft_consensus.cc:385] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:55.950186 26912 raft_consensus.cc:740] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:55.950215 26509 raft_consensus.cc:2468] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:55.950460 26595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:02:55.955850 28185 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:55.956295 28185 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:55.957424 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 346) took 3671 ms. Trace:
I20260928 20:02:55.958076 28185 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:55.958284 28030 rpcz_store.cc:276] 0928 20:02:52.285551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.286457 (+ 906us) service_pool.cc:224] Handling call
0928 20:02:55.930144 (+3643687us) ts_tablet_manager.cc:1197] Deleting tablet 93fb4e1fd0584a42a4de9eab14d5578c
0928 20:02:55.956883 (+ 26739us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.957286 (+ 403us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3591085}
I20260928 20:02:55.961179 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 347) took 3675 ms. Trace:
I20260928 20:02:55.961877 28030 rpcz_store.cc:276] 0928 20:02:52.285844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.287559 (+ 1715us) service_pool.cc:224] Handling call
0928 20:02:55.960562 (+3673003us) ts_tablet_manager.cc:1197] Deleting tablet 596a5540716441c49ec8185c8dc6a80c
0928 20:02:55.960657 (+ 95us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.961089 (+ 432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3621082}
I20260928 20:02:55.964365 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 348) took 3678 ms. Trace:
I20260928 20:02:55.964480 27984 consensus_queue.cc:1048] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:55.951287 26912 consensus_queue.cc:260] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:55.968588 26593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:02:55.972295 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_13e7d4498d47478a98380826507fb5db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:55.979207 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:55.981508 26704 heartbeater.cc:344] Connected to a master server at 127.25.129.252:44461
I20260928 20:02:55.990636 28201 consensus_queue.cc:1048] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:55.996029 27857 tablet_replica.cc:333] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:55.996860 27857 raft_consensus.cc:2243] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:55.997359 27857 raft_consensus.cc:2272] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:55.999588 27857 ts_tablet_manager.cc:1962] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:56.011950 26740 consensus_peers.cc:597] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:56.021111 28059 ts_tablet_manager.cc:1975] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260928 20:02:56.029667 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8987a47618464005976aa4f3131ab8fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:56.031327 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13e7d4498d47478a98380826507fb5db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:56.034221 26232 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_415d1f100c494194b1cdf75679f205c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.012917 28030 rpcz_store.cc:276] 0928 20:02:52.286136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.288343 (+ 2207us) service_pool.cc:224] Handling call
0928 20:02:55.963643 (+3675300us) ts_tablet_manager.cc:1197] Deleting tablet 0216c99dfd8f498595f3f7dbadf8a79b
0928 20:02:55.963731 (+ 88us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.964237 (+ 506us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3623958}
I20260928 20:02:56.007771 26916 tablet_bootstrap.cc:492] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:56.045600 26916 ts_tablet_manager.cc:1449] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.287s user 0.008s sys 0.004s
I20260928 20:02:56.024525 28079 consensus_queue.cc:1048] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:56.027268 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.031316 28005 raft_consensus.cc:493] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.047952 28059 log.cc:1199] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/ba87a379ae6a4feabfbc9fd6ba2d488e
I20260928 20:02:56.049253 28059 ts_tablet_manager.cc:1996] T ba87a379ae6a4feabfbc9fd6ba2d488e P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:56.051065 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 363) took 2906 ms. Trace:
I20260928 20:02:56.054778 28059 rpcz_store.cc:276] 0928 20:02:53.144227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.144438 (+ 211us) service_pool.cc:224] Handling call
0928 20:02:55.902661 (+2758223us) ts_tablet_manager.cc:1197] Deleting tablet ba87a379ae6a4feabfbc9fd6ba2d488e
0928 20:02:55.902696 (+ 35us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:55.933090 (+ 30394us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:56.020991 (+ 87901us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:56.050999 (+ 30008us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747435}
I20260928 20:02:56.057437 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet ba87a379ae6a4feabfbc9fd6ba2d488e (table default.Table_841f8694539d49ad85dd21d2f74da8f7 [id=785cc43f9b7d4d02aa025ab9ec645ce1]) successfully deleted
I20260928 20:02:56.060370 28059 tablet_replica.cc:333] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:56.064996 28059 raft_consensus.cc:2243] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:56.066892 26916 raft_consensus.cc:359] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:56.071484 26916 raft_consensus.cc:385] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:56.072409 26228 master_service.cc:960] ReplaceTablet: received request to replace tablet 0de800a9344d4507b7903d08fcf8e988 from {username='slave'} at 127.0.0.1:40138
I20260928 20:02:56.073431 26916 raft_consensus.cc:740] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:56.075524 26916 consensus_queue.cc:260] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:56.088173 26916 ts_tablet_manager.cc:1480] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.042s user 0.001s sys 0.005s
I20260928 20:02:56.090409 26912 ts_tablet_manager.cc:1480] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.229s user 0.003s sys 0.003s
I20260928 20:02:56.104000 28185 raft_consensus.cc:493] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.104745 26916 tablet_bootstrap.cc:492] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:56.104471 28185 raft_consensus.cc:515] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.106942 28185 leader_election.cc:290] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:56.110466 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d945be7bea449ba8c5541b60eb18334 consensus state has no leader
I20260928 20:02:56.123000 27857 ts_tablet_manager.cc:1975] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:56.136400 27857 log.cc:1199] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b667a45712c1449384e1a288f55fd062
I20260928 20:02:56.143913 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_636f6d3fbd7f43a68d2d233b97ee65b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.145628 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.147542 27857 ts_tablet_manager.cc:1996] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:56.149282 26916 tablet_bootstrap.cc:654] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:56.155203 28185 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.155797 28185 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.157905 28185 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:56.177353 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:56.177909 26235 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:56.180624 26912 tablet_bootstrap.cc:492] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:56.185322 28059 raft_consensus.cc:2272] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:56.185207 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.184767 26234 catalog_manager.cc:5838] T 4ba5d2cc979241c4918a154f25dcd305 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:02:56.187834 28240 consensus_queue.cc:1048] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:02:56.197899 28059 ts_tablet_manager.cc:1962] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:56.215922 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 162986us
I20260928 20:02:56.217972 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 373) took 3528 ms. Trace:
I20260928 20:02:56.224507 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 350) took 3937 ms. Trace:
I20260928 20:02:56.224858 28030 rpcz_store.cc:276] 0928 20:02:52.286669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.307757 (+ 21088us) service_pool.cc:224] Handling call
0928 20:02:56.154786 (+3847029us) ts_tablet_manager.cc:1197] Deleting tablet 38abbc891d9c4268820cb0faba3d08b5
0928 20:02:56.179155 (+ 24369us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.224441 (+ 45286us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3809219}
I20260928 20:02:56.186199 28005 raft_consensus.cc:515] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.234933 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.218717 27857 rpcz_store.cc:276] 0928 20:02:52.622929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.623161 (+ 232us) service_pool.cc:224] Handling call
0928 20:02:55.953464 (+3330303us) ts_tablet_manager.cc:1197] Deleting tablet b667a45712c1449384e1a288f55fd062
0928 20:02:55.995897 (+ 42433us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.096670 (+100773us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:56.122888 (+ 26218us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:56.151222 (+ 28334us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3329503}
I20260928 20:02:56.244602 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 375) took 3290 ms. Trace:
I20260928 20:02:56.244961 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet b667a45712c1449384e1a288f55fd062 (table default.Table_31b3759a2ab04669a085898c9806347b [id=e2819060d01546218e8b53248ca6decd]) successfully deleted
I20260928 20:02:56.252985 26594 leader_election.cc:304] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:56.254048 28079 raft_consensus.cc:2804] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:56.254482 28079 raft_consensus.cc:493] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:56.254845 28079 raft_consensus.cc:3060] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:56.256314 26231 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 762cb728cc574a36a68fbe9033544b04
I20260928 20:02:56.266541 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 03509d3602b345f69f059ae11c461920
I20260928 20:02:56.268046 26230 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:40138 (request call id 425) took 1073 ms. Trace:
I20260928 20:02:56.268349 26230 rpcz_store.cc:276] 0928 20:02:55.194920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.195192 (+ 272us) service_pool.cc:224] Handling call
0928 20:02:55.197057 (+ 1865us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0928 20:02:55.197707 (+ 650us) catalog_manager.cc:2854] Modifying in-memory table state
0928 20:02:55.197821 (+ 114us) catalog_manager.cc:2863] Locking tablets
0928 20:02:56.169411 (+971590us) catalog_manager.cc:2877] Removing table and tablets from system table
0928 20:02:56.266204 (+ 96793us) catalog_manager.cc:2895] Removing table from by-name map
0928 20:02:56.266383 (+ 179us) catalog_manager.cc:2911] Committing in-memory state
0928 20:02:56.266464 (+ 81us) catalog_manager.cc:2915] Aborting table tasks
0928 20:02:56.267982 (+ 1518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:56.208314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:02:56.208656 (+ 342us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:02:56.208677 (+ 21us) write_op.cc:435] Acquired schema lock
0928 20:02:56.208688 (+ 11us) tablet.cc:662] Decoding operations
0928 20:02:56.208953 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:02:56.208984 (+ 31us) write_op.cc:641] Partition lock acquired for write op
0928 20:02:56.209005 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:02:56.209247 (+ 242us) tablet.cc:701] Row locks acquired
0928 20:02:56.209280 (+ 33us) write_op.cc:260] PREPARE: finished
0928 20:02:56.209377 (+ 97us) write_op.cc:270] Start()
0928 20:02:56.209449 (+ 72us) write_op.cc:276] Timestamp: P: 1790625776209321 usec, L: 0
0928 20:02:56.209464 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:02:56.209872 (+ 408us) log.cc:844] Serialized 734 byte log entry
0928 20:02:56.252585 (+ 42713us) op_driver.cc:464] REPLICATION: finished
0928 20:02:56.252858 (+ 273us) write_op.cc:301] APPLY: starting
0928 20:02:56.252926 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0928 20:02:56.253057 (+ 131us) tablet.cc:1397] finished BulkCheckPresence
0928 20:02:56.253183 (+ 126us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:02:56.253498 (+ 315us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:02:56.253680 (+ 182us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:02:56.253747 (+ 67us) write_op.cc:312] APPLY: finished
0928 20:02:56.253956 (+ 209us) log.cc:844] Serialized 29 byte log entry
0928 20:02:56.263433 (+ 9477us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:56.263507 (+ 74us) write_op.cc:454] Released schema lock
0928 20:02:56.263541 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0928 20:02:56.263742 (+ 201us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:02:56.263765 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":128,"apply.run_cpu_time_us":1548,"apply.run_wall_time_us":10857,"mutex_wait_us":32670,"num_ops":2,"prepare.queue_time_us":37161,"prepare.run_cpu_time_us":1763,"prepare.run_wall_time_us":2703,"replication_time_us":43039}]]}
W20260928 20:02:56.283715 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 128897us
I20260928 20:02:56.284394 26740 leader_election.cc:304] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:56.259910 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 762cb728cc574a36a68fbe9033544b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:56.271541 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:56.290220 27857 rpcz_store.cc:276] 0928 20:02:52.954439 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.954553 (+ 114us) service_pool.cc:224] Handling call
0928 20:02:56.244186 (+3289633us) ts_tablet_manager.cc:1197] Deleting tablet 5ac6aaf0a2434c1fb74dd313fd4b7116
0928 20:02:56.244240 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.244537 (+ 297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289012}
W20260928 20:02:56.292870 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 already in progress: creating tablet
I20260928 20:02:56.293069 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6705a1b4132644408979a6ed69958eba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:56.299240 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 349) took 4012 ms. Trace:
I20260928 20:02:56.299584 28030 rpcz_store.cc:276] 0928 20:02:52.286411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.289075 (+ 2664us) service_pool.cc:224] Handling call
0928 20:02:56.229037 (+3939962us) ts_tablet_manager.cc:1197] Deleting tablet 4c23636443834932852f21092be1d1ac
0928 20:02:56.229098 (+ 61us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.299180 (+ 70082us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3883270}
I20260928 20:02:56.300689 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 357) took 3978 ms. Trace:
I20260928 20:02:56.301039 28030 rpcz_store.cc:276] 0928 20:02:52.634096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.634243 (+ 147us) service_pool.cc:224] Handling call
0928 20:02:56.300421 (+3666178us) ts_tablet_manager.cc:1197] Deleting tablet 06e7228a68b84f2aab2bfa582fa25ab8
0928 20:02:56.300480 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.300640 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3665611}
I20260928 20:02:56.268235 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.306160 26802 raft_consensus.cc:2468] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:56.309649 28030 tablet_replica.cc:333] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:56.318640 26230 master_service.cc:960] ReplaceTablet: received request to replace tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 from {username='slave'} at 127.0.0.1:40138
W20260928 20:02:56.343087 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6705a1b4132644408979a6ed69958eba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.326076 26912 tablet_bootstrap.cc:654] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:56.346341 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a73a2c4a6d294cb987df6ae48260e81f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.347746 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a73a2c4a6d294cb987df6ae48260e81f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.352584 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_83090de75bd14a7898987c9d0c93b871"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.353995 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83090de75bd14a7898987c9d0c93b871 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.369793 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.375095 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.375470 26849 heartbeater.cc:499] Master 127.25.129.252:44461 was elected leader, sending a full tablet report...
I20260928 20:02:56.375646 28245 raft_consensus.cc:2804] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:56.376055 28245 raft_consensus.cc:493] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:56.376487 28245 raft_consensus.cc:3060] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:56.381170 28005 leader_election.cc:290] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:56.382557 26654 raft_consensus.cc:3060] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:56.384920 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_4633f47f18b74a04b0ab07132b8f7c4c [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 1 got 0
I20260928 20:02:56.386397 28030 raft_consensus.cc:2243] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:56.386883 28030 raft_consensus.cc:2272] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:56.388679 28030 ts_tablet_manager.cc:1962] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:56.388157 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.389405 26651 raft_consensus.cc:2468] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:02:56.375161 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 90857.2us
I20260928 20:02:56.404368 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 4d0308d824cf401c8cca0cf7a950fd53 (table default.Table_2721556696834890a816325ba8ace11f [id=8d3951d0fcf94169894c951c2436a9f9]) successfully deleted
W20260928 20:02:56.412593 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 596a5540716441c49ec8185c8dc6a80c because the tablet was not found. No further retry: Not found: Tablet not found: 596a5540716441c49ec8185c8dc6a80c
I20260928 20:02:56.415944 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.418673 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:02:56.418766 26594 leader_election.cc:304] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:56.347301 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 9491e639008c4678814d2f72beb04c3c (DEFAULT_TABLE table=default.Table_43a3511ec731472cb9111882b4c3a9a0 [id=8ba59aca002240cd8e1141423f0e6e68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.374691 28185 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.420537 28185 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:56.378903 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 727fac90955d49caac8f1fa1567336b5 (DEFAULT_TABLE table=default.Table_a4c5888ebf824ce6934efcc6b4257595 [id=462e52b478724a6eb3ce35b6206673e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.292616 26485 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ac58577c345ee817e45b340601185 (DEFAULT_TABLE table=default.Table_4ab8d432c8da4b06acd99f3329549a73 [id=6f52e21fc32e4be58ef89782db2ebd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.422556 28185 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:56.395859 26487 tablet_service.cc:1511] Processing CreateTablet for tablet f7017fddff974abda74574e39fd4e37c (DEFAULT_TABLE table=default.Table_778978540feb44479e171d677565eff8 [id=47c4c20178a8433dac9f644c8de48ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.423547 28185 raft_consensus.cc:493] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:56.423985 26739 leader_election.cc:343] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.423956 28185 raft_consensus.cc:515] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.424731 26739 leader_election.cc:304] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:56.420936 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491e639008c4678814d2f72beb04c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.426837 28205 raft_consensus.cc:2804] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:56.427143 28205 raft_consensus.cc:493] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:56.427436 28205 raft_consensus.cc:3060] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:56.430670 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ac58577c345ee817e45b340601185. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:56.373466 26450 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.434554 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727fac90955d49caac8f1fa1567336b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.436401 28185 leader_election.cc:290] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:02:56.434573 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 61148.1us
I20260928 20:02:56.414561 26486 tablet_service.cc:1511] Processing CreateTablet for tablet 292fce41d80d47db93f95e2d4ee784ec (DEFAULT_TABLE table=default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:56.438508 26450 leader_election.cc:343] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.439458 26486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292fce41d80d47db93f95e2d4ee784ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:56.439499 26450 consensus_peers.cc:597] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba87a379ae6a4feabfbc9fd6ba2d488e. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:02:56.440299 26450 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:56.440791 26450 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.441824 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7017fddff974abda74574e39fd4e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.453970 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:02:56.456277 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
W20260928 20:02:56.457962 26450 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.468443 26450 leader_election.cc:304] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:56.468200 28241 consensus_queue.cc:1048] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:02:56.469601 26450 leader_election.cc:343] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.470258 28259 raft_consensus.cc:2749] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:56.471750 28199 consensus_queue.cc:1048] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:02:56.462069 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a47e5f225c19417296342e60482d31d1" } modify_external_catalogs: true
I20260928 20:02:56.469743 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_41eb33d0c44a48a28f171db5335aea9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:56.478843 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a47e5f225c19417296342e60482d31d1" } modify_external_catalogs: true
W20260928 20:02:56.479673 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41eb33d0c44a48a28f171db5335aea9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.480957 28205 raft_consensus.cc:515] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.482652 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_932f16b87c7e4e89a0cd7f710df1532d [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 1 got 0
I20260928 20:02:56.483348 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]). Expected version 3 got 0
I20260928 20:02:56.484004 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.470011 26450 leader_election.cc:304] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:56.488023 28259 raft_consensus.cc:2749] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:56.488250 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3566ccc08d42d3a01d567430d1bc4b (DEFAULT_TABLE table=default.Table_a6f405608c6542a6818f887b3abc1129 [id=ef08155a9e7b478a94ef141960781541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.489372 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3566ccc08d42d3a01d567430d1bc4b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:56.495999 26450 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.496371 26450 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:56.498402 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 91b11022fc774d18b92e0c694f834375 (table default.Table_3caa6aa87b0d4322b7aa92ef4e177f09 [id=23d8489ab3c9424ba65aa2299ec32809]). Expected version 1 got 0
I20260928 20:02:56.500947 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.504825 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.506349 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.506536 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 48d1af02ecb8456c8354ede7872b1ffb (DEFAULT_TABLE table=default.Table_4613895cb87549efa0173a0bc2de3828 [id=d3f0079cf16841ecb1f72fb8f91e79f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.507033 26796 raft_consensus.cc:2468] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:56.507555 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d1af02ecb8456c8354ede7872b1ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.492690 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f5715bc0d1984c5da56d3c85ec83c550" } modify_external_catalogs: true
I20260928 20:02:56.515501 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f5715bc0d1984c5da56d3c85ec83c550" } modify_external_catalogs: true
I20260928 20:02:56.519833 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:02:56.526467 28185 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:56.537725 26916 tablet_bootstrap.cc:492] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:56.538298 26916 ts_tablet_manager.cc:1449] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.434s user 0.013s sys 0.001s
I20260928 20:02:56.539618 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:02:56.291513 27857 tablet_replica.cc:333] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:56.541723 26229 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:56.551493 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet e868e5a3ebd2494ca20e1e08a146850e
I20260928 20:02:56.552064 26234 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8] alter complete (version 3)
I20260928 20:02:56.556422 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet e868e5a3ebd2494ca20e1e08a146850e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:56.558411 26233 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91b11022fc774d18b92e0c694f834375 consensus state has no leader
I20260928 20:02:56.562659 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 030f48d0d716450aaa4248d9fb1397ba
I20260928 20:02:56.570865 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:56.581435 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 0de800a9344d4507b7903d08fcf8e988
I20260928 20:02:56.582791 26228 catalog_manager.cc:6934] ReplaceTablet: tablet 0de800a9344d4507b7903d08fcf8e988 deleted and replaced by tablet e1f21c71dc0e41aba85bb01c9fddc12d
I20260928 20:02:56.590585 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 0de800a9344d4507b7903d08fcf8e988 with delete_type TABLET_DATA_DELETED (replaced by tablet e1f21c71dc0e41aba85bb01c9fddc12d) from {username='slave'} at 127.0.0.1:36268
W20260928 20:02:56.595650 28233 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Append to log took a long time: real 0.486s user 0.036s sys 0.003s
I20260928 20:02:56.596779 26493 tablet_service.cc:1511] Processing CreateTablet for tablet fe680423497941578a5dfff2507e3334 (DEFAULT_TABLE table=default.Table_faf31ace80214cb19c20c46710a4efb4 [id=fedfe53ba2ec45d4bc2d1cb282b51463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.608094 28205 leader_election.cc:290] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:56.608477 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_0823e9b9b5284c5bb8c2752223dc68a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.610559 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0823e9b9b5284c5bb8c2752223dc68a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.439638 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:56.612982 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 195346us
I20260928 20:02:56.441710 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.441051 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:56.614707 26594 consensus_peers.cc:597] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:56.443567 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:56.450868 26913 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.506s user 0.021s sys 0.063s
W20260928 20:02:56.458834 26595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 20:02:56.615464 26913 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.670s user 0.021s sys 0.063s
I20260928 20:02:56.619024 26913 tablet_bootstrap.cc:492] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:56.619493 26913 ts_tablet_manager.cc:1449] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.682s user 0.030s sys 0.063s
I20260928 20:02:56.531587 28079 raft_consensus.cc:515] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.623101 28079 leader_election.cc:290] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:56.579269 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:56.623703 26659 raft_consensus.cc:3060] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:56.627933 26495 tablet_service.cc:1511] Processing CreateTablet for tablet a3717aae560f428b9cb7cf732dc71497 (DEFAULT_TABLE table=default.Table_b4f6fb24e5d14de3afcb16e1fded33fd [id=2c8fc0970bcb4a83bfd995dcb6ecdf1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.637730 26659 raft_consensus.cc:2468] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:56.640178 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_75a90a6806eb4588bfc09ac96125f4df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.641702 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75a90a6806eb4588bfc09ac96125f4df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.643391 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b82018a06c354d9291408f9811be2c33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.644819 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b82018a06c354d9291408f9811be2c33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.645423 28005 raft_consensus.cc:2764] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 20:02:56.651733 26739 leader_election.cc:304] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:56.653369 28047 raft_consensus.cc:2804] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:56.653883 28047 raft_consensus.cc:697] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:56.654709 28047 consensus_queue.cc:237] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.656795 28267 tablet.cc:1751] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:56.678241 26912 tablet_bootstrap.cc:492] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:56.678866 26912 ts_tablet_manager.cc:1449] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.498s user 0.016s sys 0.000s
I20260928 20:02:56.681228 26912 raft_consensus.cc:359] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:56.687731 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 0216c99dfd8f498595f3f7dbadf8a79b because the tablet was not found. No further retry: Not found: Tablet not found: 0216c99dfd8f498595f3f7dbadf8a79b
W20260928 20:02:56.688699 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 38abbc891d9c4268820cb0faba3d08b5 because the tablet was not found. No further retry: Not found: Tablet not found: 38abbc891d9c4268820cb0faba3d08b5
W20260928 20:02:56.689725 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 4c23636443834932852f21092be1d1ac because the tablet was not found. No further retry: Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
W20260928 20:02:56.690603 26222 catalog_manager.cc:5030] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 06e7228a68b84f2aab2bfa582fa25ab8 because the tablet was not found. No further retry: Not found: Tablet not found: 06e7228a68b84f2aab2bfa582fa25ab8
I20260928 20:02:56.698751 28265 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.699085 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd4297f4aa400aa3be253bc3168390 (DEFAULT_TABLE table=default.Table_87c2af829d1743e89bc173be981dcbc7 [id=7edfca25231e43ef87f78fcc7816d969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.699249 28265 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.701663 28265 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:56.701674 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe680423497941578a5dfff2507e3334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.702283 28265 raft_consensus.cc:493] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.702687 28265 raft_consensus.cc:515] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.704403 28265 leader_election.cc:290] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:56.706350 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3717aae560f428b9cb7cf732dc71497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.712555 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd4297f4aa400aa3be253bc3168390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.719141 28265 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.719072 28134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:02:56.719576 28265 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.719990 28134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:02:56.720530 28100 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:02:56.721346 28265 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:56.721062 28100 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:56.731396 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 04a3511e5f1b42e4b48342a50f013fd0 (DEFAULT_TABLE table=default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.732509 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a3511e5f1b42e4b48342a50f013fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.740425 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_d1bf1dcc17344ef382feacc0e3e6739f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.741959 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1bf1dcc17344ef382feacc0e3e6739f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.756515 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_faf31ace80214cb19c20c46710a4efb4" } modify_external_catalogs: true
I20260928 20:02:56.757042 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_faf31ace80214cb19c20c46710a4efb4" } modify_external_catalogs: true
I20260928 20:02:56.766492 26227 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_778978540feb44479e171d677565eff8" } new_table_name: "default.Table_a40c2456c9084a4c8d24b485658b34dc" modify_external_catalogs: true
I20260928 20:02:56.767961 28100 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:02:56.771888 26484 tablet_service.cc:1511] Processing CreateTablet for tablet dc5b576c03794c9287959b5f94f42420 (DEFAULT_TABLE table=default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 [id=1eebb242f3974ae697935ddbe3403669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.773047 26484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5b576c03794c9287959b5f94f42420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.733400 26496 tablet_service.cc:1511] Processing CreateTablet for tablet d1b2dd9c6b864bb68925bf0687fb67d7 (DEFAULT_TABLE table=default.Table_db4ea683c5a44f919cbc94271cd36567 [id=fc063b01e61e4f5987f5a014fc218959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.735339 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba200d6ef33438187dd643fe3ded009" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:02:56.733827 26450 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:56.776994 26595 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f
W20260928 20:02:56.781778 26595 consensus_peers.cc:597] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b91a573103c4c2d995abde8db91b821. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:56.776458 27857 raft_consensus.cc:2243] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:56.774915 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b2dd9c6b864bb68925bf0687fb67d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:56.782312 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 48610.5us
I20260928 20:02:56.782747 27857 raft_consensus.cc:2272] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:02:56.782857 26450 leader_election.cc:343] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:56.783437 26450 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:56.783951 26450 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:56.784832 26450 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.785128 26450 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:56.785876 26450 raft_consensus.cc:2686] T b667a45712c1449384e1a288f55fd062 P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:02:56.797685 26233 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_4633f47f18b74a04b0ab07132b8f7c4c" } new_table_name: "default.Table_f0822cba073a4ff5a7062f55af0df8e1" modify_external_catalogs: true
I20260928 20:02:56.803718 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fa94560a66aa4d9891c359c5cc04bc63" } modify_external_catalogs: true
I20260928 20:02:56.804344 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fa94560a66aa4d9891c359c5cc04bc63" } modify_external_catalogs: true
I20260928 20:02:56.806226 26916 raft_consensus.cc:359] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.807013 26916 raft_consensus.cc:385] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:56.807348 26916 raft_consensus.cc:740] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:56.774878 28260 raft_consensus.cc:493] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.639858 26913 raft_consensus.cc:359] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:56.814625 26913 raft_consensus.cc:385] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:56.814950 26913 raft_consensus.cc:740] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:56.815536 26913 consensus_queue.cc:260] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:56.639649 28059 ts_tablet_manager.cc:1975] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:56.816893 28059 log.cc:1199] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/0e0a362efb68408d8dce96dce0130035
I20260928 20:02:56.817565 26913 ts_tablet_manager.cc:1480] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.198s user 0.004s sys 0.001s
I20260928 20:02:56.817854 28059 ts_tablet_manager.cc:1996] T 0e0a362efb68408d8dce96dce0130035 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:56.818529 26913 tablet_bootstrap.cc:492] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:56.788614 28270 tablet.cc:1751] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:56.805699 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aad5c72e4c64b9e91082860477c78fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.806458 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.640899 28257 tablet.cc:1751] T 718a2abfe21b4a2986b77e14e4e52152 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:02:56.839521 27924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56002 (request call id 0) took 5217 ms. Trace:
W20260928 20:02:56.842685 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 57866.7us
I20260928 20:02:56.843458 26489 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2a20c1c6464f228baae236015349c5 (DEFAULT_TABLE table=default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.843935 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_41f900344d434a3aa235b7a49f202b4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.845391 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41f900344d434a3aa235b7a49f202b4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.822556 28240 raft_consensus.cc:493] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.849480 26916 consensus_queue.cc:260] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.850132 28240 raft_consensus.cc:515] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.852114 28240 leader_election.cc:290] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:56.825184 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43512.6us
W20260928 20:02:56.857666 26595 consensus_peers.cc:597] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:02:56.847246 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.824486 26913 tablet_bootstrap.cc:654] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:56.826916 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2d13d16d9946c6b09f9197c165033c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:56.872411 28263 raft_consensus.cc:493] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:56.872928 28263 raft_consensus.cc:515] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.877687 28263 leader_election.cc:290] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:56.843466 26492 tablet_service.cc:1511] Processing CreateTablet for tablet af1a7a5ed5914712b8fb3ceb487e03ff (DEFAULT_TABLE table=default.Table_d36ac45737c44b2da07aee540f3e9a13 [id=be5fa7ea994c4cd5a37001168b4ef9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.883669 26491 tablet_service.cc:1511] Processing CreateTablet for tablet d1535def17b14663b42b76f3bc27001a (DEFAULT_TABLE table=default.Table_8fd74e2df9b84a1e998370b85625e609 [id=334efebe93f24b3d98e6a649ec121da4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:56.884830 26595 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5
I20260928 20:02:56.862046 28273 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260928 20:02:56.890565 26450 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.890995 26450 leader_election.cc:304] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:56.892033 26450 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:56.892390 26450 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:56.737427 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aad5c72e4c64b9e91082860477c78fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.738185 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.895239 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_6655d0a31a0f40f495acbad72c9ccfc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:56.747498 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:56.748492 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2d13d16d9946c6b09f9197c165033c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:56.896765 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6655d0a31a0f40f495acbad72c9ccfc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:56.870420 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 762cb728cc574a36a68fbe9033544b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:56.870754 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:56.872151 26781 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ac58577c345ee817e45b340601185 (DEFAULT_TABLE table=default.Table_4ab8d432c8da4b06acd99f3329549a73 [id=6f52e21fc32e4be58ef89782db2ebd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.873791 26772 tablet_service.cc:1511] Processing CreateTablet for tablet 9491e639008c4678814d2f72beb04c3c (DEFAULT_TABLE table=default.Table_43a3511ec731472cb9111882b4c3a9a0 [id=8ba59aca002240cd8e1141423f0e6e68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.898057 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet fe680423497941578a5dfff2507e3334
I20260928 20:02:56.874289 26783 tablet_service.cc:1511] Processing CreateTablet for tablet f7017fddff974abda74574e39fd4e37c (DEFAULT_TABLE table=default.Table_778978540feb44479e171d677565eff8 [id=47c4c20178a8433dac9f644c8de48ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.874879 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 727fac90955d49caac8f1fa1567336b5 (DEFAULT_TABLE table=default.Table_a4c5888ebf824ce6934efcc6b4257595 [id=462e52b478724a6eb3ce35b6206673e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.875545 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 292fce41d80d47db93f95e2d4ee784ec (DEFAULT_TABLE table=default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.876761 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3566ccc08d42d3a01d567430d1bc4b (DEFAULT_TABLE table=default.Table_a6f405608c6542a6818f887b3abc1129 [id=ef08155a9e7b478a94ef141960781541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:56.878017 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 48d1af02ecb8456c8354ede7872b1ffb (DEFAULT_TABLE table=default.Table_4613895cb87549efa0173a0bc2de3828 [id=d3f0079cf16841ecb1f72fb8f91e79f9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:56.901794 26227 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7017fddff974abda74574e39fd4e37c consensus state has no leader
I20260928 20:02:56.902437 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ac58577c345ee817e45b340601185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.902953 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3566ccc08d42d3a01d567430d1bc4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.903435 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292fce41d80d47db93f95e2d4ee784ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.906347 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7017fddff974abda74574e39fd4e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.908205 26482 tablet_service.cc:1558] Processing DeleteTablet for tablet fe680423497941578a5dfff2507e3334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:56.908954 28265 raft_consensus.cc:2749] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:56.909341 26772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491e639008c4678814d2f72beb04c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.909929 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d1af02ecb8456c8354ede7872b1ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.914357 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727fac90955d49caac8f1fa1567336b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:56.942729 26912 raft_consensus.cc:385] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:56.943233 26912 raft_consensus.cc:740] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:56.944015 26912 consensus_queue.cc:260] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.945037 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 7242f71b93914dbeadb60617b3f2be3b
I20260928 20:02:56.946460 26912 ts_tablet_manager.cc:1480] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.267s user 0.005s sys 0.000s
I20260928 20:02:56.818655 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 364) took 3444 ms. Trace:
I20260928 20:02:56.950508 28059 rpcz_store.cc:276] 0928 20:02:53.373920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.376156 (+ 2236us) service_pool.cc:224] Handling call
0928 20:02:56.059413 (+2683257us) ts_tablet_manager.cc:1197] Deleting tablet 0e0a362efb68408d8dce96dce0130035
0928 20:02:56.059463 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.211446 (+151983us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:56.639543 (+428097us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:56.818602 (+179059us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2682487}
I20260928 20:02:56.951886 28059 tablet_replica.cc:333] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:02:56.952234 26229 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:51917 (request call id 83) took 1657 ms (client timeout 1000 ms). Trace:
I20260928 20:02:56.952677 28059 raft_consensus.cc:2243] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:56.959563 26916 ts_tablet_manager.cc:1480] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.421s user 0.006s sys 0.000s
I20260928 20:02:56.785092 27857 ts_tablet_manager.cc:1962] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:56.956352 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f9542fb9d4054fec841718053fedb559"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:56.962831 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9542fb9d4054fec841718053fedb559 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:56.968176 26229 rpcz_store.cc:269] 0928 20:02:55.294504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.320708 (+ 26204us) service_pool.cc:224] Handling call
0928 20:02:55.418742 (+ 98034us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54000307d4. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d1975d0 00007ff79d2367ca 00007ff79efabe3c 00007ff79f0aa0ce 00007ff79cc4afb4 00007ff79cc4af42 00007ff79cc4ae71 00007ff79cc4adec 00007ff79cc4a0a2 00007ff79aefc15c 00007ff79aefb596
0928 20:02:56.952173 (+1533431us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":62,"spinlock_wait_cycles":65777408}
I20260928 20:02:56.866860 28260 raft_consensus.cc:515] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:56.977833 28260 leader_election.cc:290] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:56.979358 26482 tablet_service.cc:1511] Processing CreateTablet for tablet d5b804dcff3d494cad06ba072a082c1b (DEFAULT_TABLE table=default.Table_123669ff3966450d8a3dac4d2c6bd255 [id=bfcf8547a3264fc5868a8cd2635fa723]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:56.984861 26508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.008s sys 0.007s
W20260928 20:02:56.985140 26508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s user 0.008s sys 0.007s
I20260928 20:02:56.996573 26481 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:57.003839 26481 tablet_service.cc:1511] Processing CreateTablet for tablet 11216db10dc54e9fa8a7466643f8e413 (DEFAULT_TABLE table=default.Table_f6b035000ac14436b7323f69c8f92710 [id=0fefcb948cb44c7e8ea026076b0bfccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.005286 26478 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:57.007405 26478 tablet_service.cc:1511] Processing CreateTablet for tablet 7d694b56de2a4954a367c2efa80aa276 (DEFAULT_TABLE table=default.Table_b620de746d7346efac926837182aa589 [id=18bdc683ddf64bf2a02bb5902f73933a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.009991 26479 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:57.011044 26477 tablet_service.cc:1558] Processing DeleteTablet for tablet 7242f71b93914dbeadb60617b3f2be3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:57.009199 26480 tablet_service.cc:1511] Processing CreateTablet for tablet c2385dd76e6d44319d3cdd4303feaa6b (DEFAULT_TABLE table=default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb [id=cead80ee7d2a408c9112b53b13e41fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.032063 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2a20c1c6464f228baae236015349c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.032738 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1535def17b14663b42b76f3bc27001a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.035265 26916 tablet_bootstrap.cc:492] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:02:56.959824 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 102063us
I20260928 20:02:57.069087 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2bd98a3ca12b417aa6115a75f74e752c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.070809 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bd98a3ca12b417aa6115a75f74e752c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:56.890286 28245 consensus_meta.cc:287] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.513s user 0.000s sys 0.008s
I20260928 20:02:57.073421 28245 raft_consensus.cc:515] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:57.002312 28267 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.344s user 0.000s sys 0.001s
I20260928 20:02:57.042846 26782 tablet_service.cc:1511] Processing CreateTablet for tablet fe680423497941578a5dfff2507e3334 (DEFAULT_TABLE table=default.Table_faf31ace80214cb19c20c46710a4efb4 [id=fedfe53ba2ec45d4bc2d1cb282b51463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.046855 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:57.049152 26774 tablet_service.cc:1511] Processing CreateTablet for tablet a3717aae560f428b9cb7cf732dc71497 (DEFAULT_TABLE table=default.Table_b4f6fb24e5d14de3afcb16e1fded33fd [id=2c8fc0970bcb4a83bfd995dcb6ecdf1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.050036 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 0de800a9344d4507b7903d08fcf8e988 with delete_type TABLET_DATA_DELETED (replaced by tablet e1f21c71dc0e41aba85bb01c9fddc12d) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:57.051257 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd4297f4aa400aa3be253bc3168390 (DEFAULT_TABLE table=default.Table_87c2af829d1743e89bc173be981dcbc7 [id=7edfca25231e43ef87f78fcc7816d969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.052572 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 04a3511e5f1b42e4b48342a50f013fd0 (DEFAULT_TABLE table=default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.054018 26771 tablet_service.cc:1511] Processing CreateTablet for tablet d1b2dd9c6b864bb68925bf0687fb67d7 (DEFAULT_TABLE table=default.Table_db4ea683c5a44f919cbc94271cd36567 [id=fc063b01e61e4f5987f5a014fc218959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.055616 26770 tablet_service.cc:1511] Processing CreateTablet for tablet dc5b576c03794c9287959b5f94f42420 (DEFAULT_TABLE table=default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 [id=1eebb242f3974ae697935ddbe3403669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.057673 26769 tablet_service.cc:1511] Processing CreateTablet for tablet af1a7a5ed5914712b8fb3ceb487e03ff (DEFAULT_TABLE table=default.Table_d36ac45737c44b2da07aee540f3e9a13 [id=be5fa7ea994c4cd5a37001168b4ef9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.099179 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1a7a5ed5914712b8fb3ceb487e03ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.100243 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe680423497941578a5dfff2507e3334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.102649 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3717aae560f428b9cb7cf732dc71497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.106788 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd4297f4aa400aa3be253bc3168390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.108065 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e3f31a7190fb467592f9ddce456e89b4" } modify_external_catalogs: true
I20260928 20:02:57.108611 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e3f31a7190fb467592f9ddce456e89b4" } modify_external_catalogs: true
I20260928 20:02:57.110670 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a3511e5f1b42e4b48342a50f013fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.114483 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0ec120567bd34b25a3d9557552e911ea" } new_table_name: "default.Table_65cffcfc7e34435cba2424c5d150d38c" modify_external_catalogs: true
I20260928 20:02:57.116402 26771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b2dd9c6b864bb68925bf0687fb67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.113903 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d6cb9e0f31344046bf6b277b4387032b" } new_table_name: "default.Table_df62c4db24cb4f629a994871d1533834" modify_external_catalogs: true
I20260928 20:02:57.121662 26770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5b576c03794c9287959b5f94f42420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.137351 26233 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet e34111d40ce244cb82c0b39ab6147370
W20260928 20:02:57.140940 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f7017fddff974abda74574e39fd4e37c consensus state has no leader
W20260928 20:02:57.147560 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa49943f465f47778ac985cb5f4e6c0f consensus state has no leader
I20260928 20:02:57.150837 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c613dc346aaa4561a9d6a48a884880ac" } modify_external_catalogs: true
I20260928 20:02:57.151350 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:57.151722 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c613dc346aaa4561a9d6a48a884880ac" } modify_external_catalogs: true
I20260928 20:02:57.158690 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c17f6d0dcd96486ca59966415e8978de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.163635 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c17f6d0dcd96486ca59966415e8978de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.166375 26916 tablet_bootstrap.cc:654] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:57.168851 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_286ac19bf2c94fccacea798394d419c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:56.972663 26913 tablet_bootstrap.cc:492] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:57.170459 26913 ts_tablet_manager.cc:1449] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.352s user 0.009s sys 0.003s
W20260928 20:02:57.170418 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_286ac19bf2c94fccacea798394d419c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.170619 28059 pending_rounds.cc:70] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:57.170853 28059 pending_rounds.cc:77] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403155660599296 op_type: NO_OP noop_request { }
I20260928 20:02:57.171198 28059 raft_consensus.cc:2889] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:57.171507 28059 raft_consensus.cc:2272] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:57.172824 26913 raft_consensus.cc:359] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:57.173487 26913 raft_consensus.cc:385] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:57.173758 26913 raft_consensus.cc:740] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:02:56.983279 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 87584.8us
I20260928 20:02:57.173933 28059 ts_tablet_manager.cc:1962] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:56.986094 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 98466.4us
I20260928 20:02:57.177454 26625 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.004911 28284 tablet.cc:1751] T 8147a650aa614b2fb0af08077e60ddc8 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:57.181366 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 762cb728cc574a36a68fbe9033544b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.182047 26482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b804dcff3d494cad06ba072a082c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.183531 26625 tablet_service.cc:1558] Processing DeleteTablet for tablet 1284d1f7fa774033b90133447627df4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:38 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.189512 28263 raft_consensus.cc:493] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:57.189941 28263 raft_consensus.cc:515] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:57.191169 26233 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet eeea1c0042ae4b6ebeab7d5a1eaf6c22
I20260928 20:02:57.191799 28263 leader_election.cc:290] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:57.196079 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 9491e639008c4678814d2f72beb04c3c (DEFAULT_TABLE table=default.Table_43a3511ec731472cb9111882b4c3a9a0 [id=8ba59aca002240cd8e1141423f0e6e68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.197028 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491e639008c4678814d2f72beb04c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.198837 26628 tablet_service.cc:1511] Processing CreateTablet for tablet 727fac90955d49caac8f1fa1567336b5 (DEFAULT_TABLE table=default.Table_a4c5888ebf824ce6934efcc6b4257595 [id=462e52b478724a6eb3ce35b6206673e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.200296 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727fac90955d49caac8f1fa1567336b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.202997 26626 tablet_service.cc:1511] Processing CreateTablet for tablet f7017fddff974abda74574e39fd4e37c (DEFAULT_TABLE table=default.Table_778978540feb44479e171d677565eff8 [id=47c4c20178a8433dac9f644c8de48ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.203181 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:02:57.203673 26655 raft_consensus.cc:3060] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:57.203979 26626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7017fddff974abda74574e39fd4e37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.206890 26632 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ac58577c345ee817e45b340601185 (DEFAULT_TABLE table=default.Table_4ab8d432c8da4b06acd99f3329549a73 [id=6f52e21fc32e4be58ef89782db2ebd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.207784 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ac58577c345ee817e45b340601185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.210282 26625 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.217338 28030 ts_tablet_manager.cc:1975] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:57.217710 28030 log.cc:1199] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4b91a573103c4c2d995abde8db91b821
I20260928 20:02:57.083228 28245 leader_election.cc:290] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:57.226714 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3566ccc08d42d3a01d567430d1bc4b (DEFAULT_TABLE table=default.Table_a6f405608c6542a6818f887b3abc1129 [id=ef08155a9e7b478a94ef141960781541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.226961 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_baeaa1e844ee48898eccf65d0c3441e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:57.227849 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3566ccc08d42d3a01d567430d1bc4b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:57.228515 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baeaa1e844ee48898eccf65d0c3441e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.229583 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:57.231943 27792 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:57.231875 26625 tablet_service.cc:1511] Processing CreateTablet for tablet 292fce41d80d47db93f95e2d4ee784ec (DEFAULT_TABLE table=default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.233045 26625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292fce41d80d47db93f95e2d4ee784ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.234078 28100 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:02:57.250483 26913 consensus_queue.cc:260] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:57.252291 26913 ts_tablet_manager.cc:1480] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.082s user 0.005s sys 0.000s
I20260928 20:02:57.253394 26913 tablet_bootstrap.cc:492] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:57.255362 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 48d1af02ecb8456c8354ede7872b1ffb (DEFAULT_TABLE table=default.Table_4613895cb87549efa0173a0bc2de3828 [id=d3f0079cf16841ecb1f72fb8f91e79f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.256345 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d1af02ecb8456c8354ede7872b1ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.263701 26638 tablet_service.cc:1511] Processing CreateTablet for tablet fe680423497941578a5dfff2507e3334 (DEFAULT_TABLE table=default.Table_faf31ace80214cb19c20c46710a4efb4 [id=fedfe53ba2ec45d4bc2d1cb282b51463]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.264777 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe680423497941578a5dfff2507e3334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.269742 28030 ts_tablet_manager.cc:1996] T 4b91a573103c4c2d995abde8db91b821 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:57.271555 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet e868e5a3ebd2494ca20e1e08a146850e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.276876 26773 tablet_service.cc:1558] Processing DeleteTablet for tablet e868e5a3ebd2494ca20e1e08a146850e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:57.298482 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c628c1a16db34a3fbc9c818e95ad5f7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.299968 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c628c1a16db34a3fbc9c818e95ad5f7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.311879 26912 tablet_bootstrap.cc:492] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:57.294727 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:57.315714 26769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1a7a5ed5914712b8fb3ceb487e03ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.337397 26773 tablet_service.cc:1511] Processing CreateTablet for tablet d1535def17b14663b42b76f3bc27001a (DEFAULT_TABLE table=default.Table_8fd74e2df9b84a1e998370b85625e609 [id=334efebe93f24b3d98e6a649ec121da4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.344906 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d1bf1dcc17344ef382feacc0e3e6739f" } modify_external_catalogs: true
I20260928 20:02:57.345438 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d1bf1dcc17344ef382feacc0e3e6739f" } modify_external_catalogs: true
I20260928 20:02:57.352223 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_8987a47618464005976aa4f3131ab8fa" } new_table_name: "default.Table_b4b057f5b20d4768a71c623605e9ad5b" modify_external_catalogs: true
I20260928 20:02:57.354419 26768 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2a20c1c6464f228baae236015349c5 (DEFAULT_TABLE table=default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.355832 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:57.356547 26791 raft_consensus.cc:2468] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:57.333599 26792 raft_consensus.cc:3060] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:57.362483 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_df62c4db24cb4f629a994871d1533834" } new_table_name: "default.Table_13971cf4060b47aea813d1ea311e8347" modify_external_catalogs: true
I20260928 20:02:57.359119 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cbde5f5dc4ff6a046b16b1e2b9786" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:57.370682 26793 raft_consensus.cc:2468] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:02:57.371743 26636 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.371743 26633 tablet_service.cc:1511] Processing CreateTablet for tablet a3717aae560f428b9cb7cf732dc71497 (DEFAULT_TABLE table=default.Table_b4f6fb24e5d14de3afcb16e1fded33fd [id=2c8fc0970bcb4a83bfd995dcb6ecdf1d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:57.374670 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dba8a3870878487991e518ee46b36cca has no consensus state
I20260928 20:02:57.386669 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1535def17b14663b42b76f3bc27001a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.391438 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 04a3511e5f1b42e4b48342a50f013fd0 (DEFAULT_TABLE table=default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.391820 26629 tablet_service.cc:1558] Processing DeleteTablet for tablet 0de800a9344d4507b7903d08fcf8e988 with delete_type TABLET_DATA_DELETED (replaced by tablet e1f21c71dc0e41aba85bb01c9fddc12d) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.392552 26630 tablet_service.cc:1511] Processing CreateTablet for tablet d1b2dd9c6b864bb68925bf0687fb67d7 (DEFAULT_TABLE table=default.Table_db4ea683c5a44f919cbc94271cd36567 [id=fc063b01e61e4f5987f5a014fc218959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.393026 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd4297f4aa400aa3be253bc3168390 (DEFAULT_TABLE table=default.Table_87c2af829d1743e89bc173be981dcbc7 [id=7edfca25231e43ef87f78fcc7816d969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.394666 26768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2a20c1c6464f228baae236015349c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.400729 26624 tablet_service.cc:1511] Processing CreateTablet for tablet af1a7a5ed5914712b8fb3ceb487e03ff (DEFAULT_TABLE table=default.Table_d36ac45737c44b2da07aee540f3e9a13 [id=be5fa7ea994c4cd5a37001168b4ef9f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.393639 26634 tablet_service.cc:1511] Processing CreateTablet for tablet dc5b576c03794c9287959b5f94f42420 (DEFAULT_TABLE table=default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 [id=1eebb242f3974ae697935ddbe3403669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.404649 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3717aae560f428b9cb7cf732dc71497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.405407 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a3511e5f1b42e4b48342a50f013fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.406092 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b2dd9c6b864bb68925bf0687fb67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.406955 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd4297f4aa400aa3be253bc3168390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.415709 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_eaf2b74a92f54fbead13035a6b095ebc" } modify_external_catalogs: true
I20260928 20:02:57.416185 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_eaf2b74a92f54fbead13035a6b095ebc" } modify_external_catalogs: true
I20260928 20:02:57.431507 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 46c39c6915964116ac14ea2781c7a52b
I20260928 20:02:57.441546 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_fcf649830b9146c692f14a80b201e631"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.446035 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcf649830b9146c692f14a80b201e631 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.444111 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c68f60885a0940f583aa139abd8a834a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.447348 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c68f60885a0940f583aa139abd8a834a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.450857 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 91b11022fc774d18b92e0c694f834375
I20260928 20:02:57.455391 27900 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" instance_seqno: 1790625740952241) as {username='slave'} at 127.25.129.194:48177; Asking this server to re-register.
I20260928 20:02:57.465073 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_cdb14377bf684d90ba23733f91f3a0d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:57.466543 26704 heartbeater.cc:461] Registering TS with master...
W20260928 20:02:57.466781 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdb14377bf684d90ba23733f91f3a0d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260928 20:02:57.469107 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46355.4us
I20260928 20:02:57.480440 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 358) took 4841 ms. Trace:
I20260928 20:02:57.480803 28030 rpcz_store.cc:276] 0928 20:02:52.638607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.638738 (+ 131us) service_pool.cc:224] Handling call
0928 20:02:56.301991 (+3663253us) ts_tablet_manager.cc:1197] Deleting tablet 4b91a573103c4c2d995abde8db91b821
0928 20:02:56.302036 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:56.633957 (+331921us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.217223 (+583266us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.480364 (+263141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276744,"tablet-delete.queue_time_us":3662720}
I20260928 20:02:57.482021 28030 tablet_replica.cc:333] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:57.483774 28030 raft_consensus.cc:2243] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:57.491078 28030 raft_consensus.cc:2272] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:57.522837 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_80b7e921026a449aac1078cb8ef22d63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.524422 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80b7e921026a449aac1078cb8ef22d63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.214030 26655 raft_consensus.cc:2468] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:02:57.532051 26622 tablet_service.cc:1511] Processing CreateTablet for tablet d5b804dcff3d494cad06ba072a082c1b (DEFAULT_TABLE table=default.Table_123669ff3966450d8a3dac4d2c6bd255 [id=bfcf8547a3264fc5868a8cd2635fa723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.545338 28059 ts_tablet_manager.cc:1975] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:57.545710 28059 log.cc:1199] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/a86e8a782b3e46d09a45bbb7025546af
I20260928 20:02:57.546430 28059 ts_tablet_manager.cc:1996] T a86e8a782b3e46d09a45bbb7025546af P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:02:57.554119 26622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b804dcff3d494cad06ba072a082c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.578573 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_188a95a61c5a440dad4f7e0f583a07d2" } new_table_name: "default.Table_3467c5fa4d484abd960f94bf69f2c91a" modify_external_catalogs: true
W20260928 20:02:57.592758 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3c3cffa96f043629e4bbfcf282d86bd consensus state has no leader
I20260928 20:02:57.595358 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f6b035000ac14436b7323f69c8f92710" } new_table_name: "default.Table_2b1e7ffc2027409baf928d1f991d97b3" modify_external_catalogs: true
W20260928 20:02:57.612195 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11216db10dc54e9fa8a7466643f8e413 consensus state has no leader
I20260928 20:02:57.636842 26230 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_07fc7a223812466d8d63a0097bbbd86b" } modify_external_catalogs: true
I20260928 20:02:57.637332 26230 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_07fc7a223812466d8d63a0097bbbd86b" } modify_external_catalogs: true
I20260928 20:02:57.650938 26631 tablet_service.cc:1511] Processing CreateTablet for tablet c2385dd76e6d44319d3cdd4303feaa6b (DEFAULT_TABLE table=default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb [id=cead80ee7d2a408c9112b53b13e41fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.655959 26229 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f87f9401517747eb9784b49f2ffce310" } modify_external_catalogs: true
I20260928 20:02:57.663996 26230 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 2d9ca77e114c4d06bde1bcd862c8eccf
I20260928 20:02:57.665833 26229 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f87f9401517747eb9784b49f2ffce310" } modify_external_catalogs: true
I20260928 20:02:57.470783 26772 tablet_service.cc:1558] Processing DeleteTablet for tablet fe680423497941578a5dfff2507e3334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:57.677790 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5b576c03794c9287959b5f94f42420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.679221 28297 tablet.cc:1751] T 7e86d2d680c545e0b0511dec35ba6c9a P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:57.685797 26229 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 3657e36a6d2844c28852db1a4f2ed191
W20260928 20:02:57.685654 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 793372us
I20260928 20:02:57.696090 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_bbca2cbf8d8a484eb1be9079bdc39d16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.699894 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.711681 26230 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2a6a2e75f86f4344ba5d2e495190619b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.713183 26230 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a6a2e75f86f4344ba5d2e495190619b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.713109 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_faf293f941b845a992e4a5bc2f0d8e97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.714529 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faf293f941b845a992e4a5bc2f0d8e97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.717742 26623 tablet_service.cc:1558] Processing DeleteTablet for tablet fe680423497941578a5dfff2507e3334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.723722 26912 tablet_bootstrap.cc:654] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:57.723423 26629 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2a20c1c6464f228baae236015349c5 (DEFAULT_TABLE table=default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.725718 26624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1a7a5ed5914712b8fb3ceb487e03ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.735009 28302 raft_consensus.cc:2749] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:57.724442 26627 tablet_service.cc:1511] Processing CreateTablet for tablet d1535def17b14663b42b76f3bc27001a (DEFAULT_TABLE table=default.Table_8fd74e2df9b84a1e998370b85625e609 [id=334efebe93f24b3d98e6a649ec121da4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.737692 28302 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:57.747725 28302 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:57.750635 28284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s user 0.021s sys 0.023s
W20260928 20:02:57.751098 28284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s user 0.021s sys 0.023s
W20260928 20:02:57.751461 28284 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.571s user 0.021s sys 0.023s
I20260928 20:02:57.751561 28302 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:57.752259 28302 raft_consensus.cc:493] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:57.754634 26776 tablet_service.cc:1511] Processing CreateTablet for tablet d5b804dcff3d494cad06ba072a082c1b (DEFAULT_TABLE table=default.Table_123669ff3966450d8a3dac4d2c6bd255 [id=bfcf8547a3264fc5868a8cd2635fa723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.755602 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b804dcff3d494cad06ba072a082c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.755911 26229 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_b535172c333e41bba212d17bbb3a0a13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.757438 26229 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b535172c333e41bba212d17bbb3a0a13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.750749 26913 tablet_bootstrap.cc:654] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:57.474021 28293 tablet.cc:1751] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:57.768743 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 7d694b56de2a4954a367c2efa80aa276 (DEFAULT_TABLE table=default.Table_b620de746d7346efac926837182aa589 [id=18bdc683ddf64bf2a02bb5902f73933a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.772516 28302 raft_consensus.cc:515] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:57.771500 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 11216db10dc54e9fa8a7466643f8e413 (DEFAULT_TABLE table=default.Table_f6b035000ac14436b7323f69c8f92710 [id=0fefcb948cb44c7e8ea026076b0bfccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.704596 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 365) took 4327 ms. Trace:
I20260928 20:02:57.774911 28059 rpcz_store.cc:276] 0928 20:02:53.377452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.380919 (+ 3467us) service_pool.cc:224] Handling call
0928 20:02:56.951725 (+3570806us) ts_tablet_manager.cc:1197] Deleting tablet a86e8a782b3e46d09a45bbb7025546af
0928 20:02:56.951769 (+ 44us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:57.493335 (+541566us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.543676 (+ 50341us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.704494 (+160818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3570255}
W20260928 20:02:57.776262 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 303264us
I20260928 20:02:57.796454 27897 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" instance_seqno: 1790625738903937) as {username='slave'} at 127.25.129.193:50897; Asking this server to re-register.
I20260928 20:02:57.800232 26484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 425) took 1029 ms. Trace:
I20260928 20:02:57.800832 28302 leader_election.cc:290] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:57.800688 26484 rpcz_store.cc:276] 0928 20:02:56.770676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.771105 (+ 429us) service_pool.cc:224] Handling call
0928 20:02:56.772574 (+ 1469us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:56.772650 (+ 76us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:56.841259 (+ 68609us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.013504 (+172245us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:57.799989 (+786485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:57.801529 26229 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_d9dd76f902a14b1eb291e720ba17dd9a" } new_table_name: "default.Table_ba5e44badca344a2b91e22382cdb8ac1" modify_external_catalogs: true
I20260928 20:02:57.780297 26481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11216db10dc54e9fa8a7466643f8e413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.806519 26480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2385dd76e6d44319d3cdd4303feaa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.807397 26478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d694b56de2a4954a367c2efa80aa276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.816852 26230 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_a8441fd485464204a3f365c57858acfa" } new_table_name: "default.Table_4401852945304b65a0de8b1871be8684" modify_external_catalogs: true
I20260928 20:02:57.823276 26485 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 410) took 1531 ms. Trace:
I20260928 20:02:57.823652 26485 rpcz_store.cc:276] 0928 20:02:56.291435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.291880 (+ 445us) service_pool.cc:224] Handling call
0928 20:02:56.422606 (+130726us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:56.422683 (+ 77us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:56.980316 (+557633us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.017543 (+ 37227us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:57.823092 (+805549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:57.825557 26486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 414) took 1412 ms. Trace:
I20260928 20:02:57.825901 26486 rpcz_store.cc:276] 0928 20:02:56.413550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.413700 (+ 150us) service_pool.cc:224] Handling call
0928 20:02:56.438513 (+ 24813us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:56.438599 (+ 86us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:56.752596 (+313997us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.216228 (+463632us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:57.825380 (+609152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:02:57.831656 26489 consensus_meta.cc:287] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.563s user 0.004s sys 0.004s
I20260928 20:02:57.852126 26561 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:57.836766 26772 tablet_service.cc:1511] Processing CreateTablet for tablet c2385dd76e6d44319d3cdd4303feaa6b (DEFAULT_TABLE table=default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb [id=cead80ee7d2a408c9112b53b13e41fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.858400 26772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2385dd76e6d44319d3cdd4303feaa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.858951 26792 raft_consensus.cc:2468] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:02:57.861825 28267 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41770 (request call id 409) took 2391 ms. Trace:
I20260928 20:02:57.868934 26782 tablet_service.cc:1558] Processing DeleteTablet for tablet 7242f71b93914dbeadb60617b3f2be3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:57.870049 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 11216db10dc54e9fa8a7466643f8e413 (DEFAULT_TABLE table=default.Table_f6b035000ac14436b7323f69c8f92710 [id=0fefcb948cb44c7e8ea026076b0bfccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.870648 26233 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6161480f563f4672a8ae27fe327141a4" } modify_external_catalogs: true
I20260928 20:02:57.870682 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 7d694b56de2a4954a367c2efa80aa276 (DEFAULT_TABLE table=default.Table_b620de746d7346efac926837182aa589 [id=18bdc683ddf64bf2a02bb5902f73933a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.872198 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d694b56de2a4954a367c2efa80aa276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.872027 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 9b943773d8804b0db0fbed9978461690 (DEFAULT_TABLE table=default.Table_0823e9b9b5284c5bb8c2752223dc68a4 [id=195a25265b964b7382826f865bcc3022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.872763 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11216db10dc54e9fa8a7466643f8e413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.874365 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b943773d8804b0db0fbed9978461690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.875674 26777 tablet_service.cc:1511] Processing CreateTablet for tablet b1dc729477b8405d85c2c4a9c20a3efd (DEFAULT_TABLE table=default.Table_b82018a06c354d9291408f9811be2c33 [id=bcc46b95f2b14748ae012cc7dcf42b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.876701 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dc729477b8405d85c2c4a9c20a3efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.886673 28030 ts_tablet_manager.cc:1962] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:57.897135 26234 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c3320acca4da439bb957f8a82adbd8a2" } modify_external_catalogs: true
W20260928 20:02:57.901700 26916 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.677s user 0.002s sys 0.005s
W20260928 20:02:57.902053 26916 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.678s user 0.002s sys 0.005s
I20260928 20:02:57.904664 28185 raft_consensus.cc:493] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:57.905114 28185 raft_consensus.cc:515] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:57.907491 28185 leader_election.cc:290] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:57.912946 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc1eea43de1459aa49e7072cf8b89ca (DEFAULT_TABLE table=default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.913985 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc1eea43de1459aa49e7072cf8b89ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.737430 26623 tablet_service.cc:1558] Processing DeleteTablet for tablet 7242f71b93914dbeadb60617b3f2be3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:57.916177 26629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2a20c1c6464f228baae236015349c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.918804 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c39c6915964116ac14ea2781c7a52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:57.920181 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 46c39c6915964116ac14ea2781c7a52b (DEFAULT_TABLE table=default.Table_d1bf1dcc17344ef382feacc0e3e6739f [id=c6b90c59d848420b8fab44e3bfe5f4d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.921139 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c39c6915964116ac14ea2781c7a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.934255 26227 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_e81ad7e3711e4f25a6051f1ce257d20a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.935882 26227 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e81ad7e3711e4f25a6051f1ce257d20a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.941841 28265 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:57.942400 28265 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:57.944499 28265 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:57.949110 26916 tablet_bootstrap.cc:492] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:57.949672 26916 ts_tablet_manager.cc:1449] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.915s user 0.012s sys 0.005s
I20260928 20:02:57.955992 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_f22655fc8af44cc09c6b5a28890481cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:57.957700 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f22655fc8af44cc09c6b5a28890481cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.967182 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d694b56de2a4954a367c2efa80aa276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.968408 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11216db10dc54e9fa8a7466643f8e413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.971014 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2385dd76e6d44319d3cdd4303feaa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.972365 26231 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_1a915ed0be934873a38f26d9661704fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:57.961678 26916 raft_consensus.cc:359] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:57.973975 26231 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a915ed0be934873a38f26d9661704fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:57.966317 28059 tablet_replica.cc:333] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:57.976063 26916 raft_consensus.cc:385] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:57.991410 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:57.992141 26792 raft_consensus.cc:2393] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:02:57.993852 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb99b1b34b844b4b6bdbd52c646f087 (DEFAULT_TABLE table=default.Table_6705a1b4132644408979a6ed69958eba [id=b265254a22fd4381a4c8135dda1abcd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:57.873700 28267 rpcz_store.cc:276] 0928 20:02:55.470216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.470333 (+ 117us) service_pool.cc:224] Handling call
0928 20:02:57.861752 (+2391419us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:55.854778 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:55.855101 (+ 323us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:55.855130 (+ 29us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:55.855192 (+ 62us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:55.855308 (+ 116us) alter_schema_op.cc:128] START. Timestamp: 1790625775835824
0928 20:02:55.855327 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:02:55.855846 (+ 519us) log.cc:844] Serialized 173 byte log entry
0928 20:02:56.516967 (+661121us) op_driver.cc:464] REPLICATION: finished
0928 20:02:56.656575 (+139608us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:02:56.862309 (+205734us) log.cc:844] Serialized 5 byte log entry
0928 20:02:57.860879 (+998570us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.861519 (+ 640us) log.cc:844] Serialized 14 byte log entry
0928 20:02:57.861612 (+ 93us) alter_schema_op.cc:73] Released schema lock
0928 20:02:57.861639 (+ 27us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":139412,"prepare.queue_time_us":262911,"prepare.run_cpu_time_us":1930,"prepare.run_wall_time_us":68662,"raft.queue_time_us":91,"raft.run_cpu_time_us":653,"raft.run_wall_time_us":652,"replication_time_us":661528,"thread_start_us":621115,"threads_started":4,"wal-append.queue_time_us":85844,"wal-append.run_cpu_time_us":1788,"wal-append.run_wall_time_us":1001815}]]}
I20260928 20:02:57.994854 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb99b1b34b844b4b6bdbd52c646f087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:57.987237 26916 raft_consensus.cc:740] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:58.003549 26627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1535def17b14663b42b76f3bc27001a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.003755 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_00bbdd0087ac436396fddc9c73673ae2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.005419 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00bbdd0087ac436396fddc9c73673ae2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.010514 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 46c39c6915964116ac14ea2781c7a52b (DEFAULT_TABLE table=default.Table_d1bf1dcc17344ef382feacc0e3e6739f [id=c6b90c59d848420b8fab44e3bfe5f4d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.011566 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c39c6915964116ac14ea2781c7a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.027738 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c39c6915964116ac14ea2781c7a52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:58.029104 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 9b943773d8804b0db0fbed9978461690 (DEFAULT_TABLE table=default.Table_0823e9b9b5284c5bb8c2752223dc68a4 [id=195a25265b964b7382826f865bcc3022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.030164 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b943773d8804b0db0fbed9978461690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.034296 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b11022fc774d18b92e0c694f834375 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:58.035977 26621 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb99b1b34b844b4b6bdbd52c646f087 (DEFAULT_TABLE table=default.Table_6705a1b4132644408979a6ed69958eba [id=b265254a22fd4381a4c8135dda1abcd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.040143 26621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb99b1b34b844b4b6bdbd52c646f087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.040243 28308 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:02:58.040716 28308 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:02:58.042275 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc1eea43de1459aa49e7072cf8b89ca (DEFAULT_TABLE table=default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.043337 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc1eea43de1459aa49e7072cf8b89ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.044761 26623 tablet_service.cc:1511] Processing CreateTablet for tablet b1dc729477b8405d85c2c4a9c20a3efd (DEFAULT_TABLE table=default.Table_b82018a06c354d9291408f9811be2c33 [id=bcc46b95f2b14748ae012cc7dcf42b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.045831 26623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dc729477b8405d85c2c4a9c20a3efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.049726 26233 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6161480f563f4672a8ae27fe327141a4" } modify_external_catalogs: true
I20260928 20:02:58.052793 26234 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c3320acca4da439bb957f8a82adbd8a2" } modify_external_catalogs: true
I20260928 20:02:58.053323 28273 catalog_manager.cc:1308] Loaded cluster ID: b136c9e8aca3413fbbd2c68f6588888b
I20260928 20:02:58.053582 28273 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: loading cluster ID for follower catalog manager: success
I20260928 20:02:58.055426 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 61bd0122845044fd993d166824f3b9cc (DEFAULT_TABLE table=default.Table_83090de75bd14a7898987c9d0c93b871 [id=1f5468b83cf74cd49cde65514c10c24d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.056618 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bd0122845044fd993d166824f3b9cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:58.068256 26230 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2a658eaaedb4432a4dc2e1f5df6cc58 consensus state has no leader
I20260928 20:02:58.072562 28308 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:02:58.072840 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:58.073617 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:58.079118 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:58.081336 27900 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" instance_seqno: 1790625742970404) as {username='slave'} at 127.25.129.195:43199; Asking this server to re-register.
W20260928 20:02:58.086277 26448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:02:58.090077 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 46c39c6915964116ac14ea2781c7a52b (DEFAULT_TABLE table=default.Table_d1bf1dcc17344ef382feacc0e3e6739f [id=c6b90c59d848420b8fab44e3bfe5f4d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.040247 26916 consensus_queue.cc:260] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.091310 28304 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:58.091956 28304 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.106711 26620 tablet_service.cc:1511] Processing CreateTablet for tablet 23e030d67e3a476abf25301e888fecc0 (DEFAULT_TABLE table=default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.108552 26620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e030d67e3a476abf25301e888fecc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.114265 26234 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 7775ad91c86840c49a902b059a0ff74d
I20260928 20:02:58.117712 28303 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:58.119097 28303 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.138281 27857 ts_tablet_manager.cc:1975] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:02:58.138732 27857 log.cc:1199] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/ba87a379ae6a4feabfbc9fd6ba2d488e
I20260928 20:02:58.139918 27857 ts_tablet_manager.cc:1996] T ba87a379ae6a4feabfbc9fd6ba2d488e P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:58.141157 26916 ts_tablet_manager.cc:1480] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.191s user 0.006s sys 0.006s
W20260928 20:02:58.143059 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 455873us
W20260928 20:02:58.143733 26450 leader_election.cc:343] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:58.144131 26450 leader_election.cc:304] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:58.144968 28302 raft_consensus.cc:2749] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:58.145364 26450 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:02:58.146132 28302 raft_consensus.cc:2804] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 20:02:58.146219 26593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.007s sys 0.011s
W20260928 20:02:58.146492 26593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s user 0.007s sys 0.011s
I20260928 20:02:58.146437 28302 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:58.146746 28302 raft_consensus.cc:3060] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:58.150606 26233 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 6a31001f85b44bfcb35a29675f177b9e
I20260928 20:02:58.153069 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 72ad5978f7624bcdb63ca9e71d29b2e4 (DEFAULT_TABLE table=default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 [id=62a432d0a82e48efb93877e3c46cb37b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.165158 28059 raft_consensus.cc:2243] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:58.165755 28059 pending_rounds.cc:70] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:58.165974 28059 pending_rounds.cc:77] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403164310712320 op_type: NO_OP noop_request { }
I20260928 20:02:58.166316 28059 raft_consensus.cc:2889] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:58.166627 28059 raft_consensus.cc:2272] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:58.173105 28030 ts_tablet_manager.cc:1975] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:58.173466 28030 log.cc:1199] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/db5f5f16f2d7457799e1b96a293695f4
I20260928 20:02:58.174280 28030 ts_tablet_manager.cc:1996] T db5f5f16f2d7457799e1b96a293695f4 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:02:58.174875 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d2a658eaaedb4432a4dc2e1f5df6cc58 consensus state has no leader
I20260928 20:02:58.095060 28308 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:02:58.181941 26489 tablet_service.cc:1511] Processing CreateTablet for tablet b1dc729477b8405d85c2c4a9c20a3efd (DEFAULT_TABLE table=default.Table_b82018a06c354d9291408f9811be2c33 [id=bcc46b95f2b14748ae012cc7dcf42b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.185674 28302 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.198907 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ad5978f7624bcdb63ca9e71d29b2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.190763 26486 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c39c6915964116ac14ea2781c7a52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:58.195473 26485 tablet_service.cc:1511] Processing CreateTablet for tablet 9b943773d8804b0db0fbed9978461690 (DEFAULT_TABLE table=default.Table_0823e9b9b5284c5bb8c2752223dc68a4 [id=195a25265b964b7382826f865bcc3022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.196262 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c39c6915964116ac14ea2781c7a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.198786 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 376) took 5196 ms. Trace:
I20260928 20:02:58.199133 28303 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:58.222656 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b11022fc774d18b92e0c694f834375 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:58.226981 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d5ed5998a6194061839143c4adf4d3d4 (table default.Table_13971cf4060b47aea813d1ea311e8347 [id=911769c45f044f3b8772d685b79d2e30]). Expected version 3 got 1
I20260928 20:02:58.227628 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet fa49943f465f47778ac985cb5f4e6c0f (table default.Table_65cffcfc7e34435cba2424c5d150d38c [id=1d18dd75f3d34be3a2e195cf8bed408b]). Expected version 1 got 0
W20260928 20:02:58.228358 26770 consensus_meta.cc:287] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.736s user 0.006s sys 0.000s
I20260928 20:02:58.229274 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_ba5e44badca344a2b91e22382cdb8ac1 [id=ec32368ba1694873892ec3f1a5140105]). Expected version 2 got 1
I20260928 20:02:58.230581 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 2 got 0
I20260928 20:02:58.232424 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
W20260928 20:02:58.234588 26771 consensus_meta.cc:287] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.865s user 0.005s sys 0.004s
I20260928 20:02:58.233110 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:02:58.242262 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_932f16b87c7e4e89a0cd7f710df1532d [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 1 got 0
I20260928 20:02:58.242764 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:58.244602 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 7e86d2d680c545e0b0511dec35ba6c9a (table default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af]). Expected version 1 got 0
I20260928 20:02:58.245047 28273 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: acquiring CA information for follower catalog manager: success
I20260928 20:02:58.245750 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:02:58.246235 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:02:58.246974 26228 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:02:58.248785 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 2d02292105e6430c9231f26b62befe34 (DEFAULT_TABLE table=default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.250082 26778 tablet_service.cc:1511] Processing CreateTablet for tablet 72ad5978f7624bcdb63ca9e71d29b2e4 (DEFAULT_TABLE table=default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 [id=62a432d0a82e48efb93877e3c46cb37b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.250852 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_c381dba3a9c141fe9a2aa9dfec973fbd" } new_table_name: "default.Table_99563ab39a854e5d9d4d2968f07bfe84" modify_external_catalogs: true
I20260928 20:02:58.266696 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 23e030d67e3a476abf25301e888fecc0 (DEFAULT_TABLE table=default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.268780 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce6188a8420478ab3565fbc9fb7e5e9 (DEFAULT_TABLE table=default.Table_3bbea633f65b40279f5e069f2cf18cd3 [id=93f93c4333824319bec279868d0f3cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.269785 26784 tablet_service.cc:1511] Processing CreateTablet for tablet dba8a3870878487991e518ee46b36cca (DEFAULT_TABLE table=default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.271427 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_f8219cfe619d4917a68dc3e0eee210a2" } new_table_name: "default.Table_36317d3e67f24e728b2f876d0acb6283" modify_external_catalogs: true
W20260928 20:02:58.273641 26594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s user 0.011s sys 0.006s
W20260928 20:02:58.274049 26594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s user 0.012s sys 0.006s
I20260928 20:02:58.275522 26765 tablet_service.cc:1511] Processing CreateTablet for tablet 210183ea66e349d0b8ef63c0964ca0c8 (DEFAULT_TABLE table=default.Table_f8219cfe619d4917a68dc3e0eee210a2 [id=7163beea98f0410a90915a1b66902dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.276597 27900 ts_manager.cc:194] Registered new tserver with Master: 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:58.280587 26767 tablet_service.cc:1511] Processing CreateTablet for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (DEFAULT_TABLE table=default.Table_a8441fd485464204a3f365c57858acfa [id=0266a3b47dac49d1b20b241e9cf91d1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.267916 26766 tablet_service.cc:1511] Processing CreateTablet for tablet 79967f9c7bf44678b9681449992776c5 (DEFAULT_TABLE table=default.Table_3df208002e624823846e63d97d7d9038 [id=fbd517599006491b92bd6e5869c4212d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.281260 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_66f34d73b85d4af58844cc7ea97a7866"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.282668 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66f34d73b85d4af58844cc7ea97a7866 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.283345 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 7053ca61ed6e4f6dbf1f5adb54728792 (DEFAULT_TABLE table=default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f [id=c43f875938fb4105b927b7aee9612a7c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.289673 26236 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 210183ea66e349d0b8ef63c0964ca0c8 consensus state has no leader
I20260928 20:02:58.290668 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 61bd0122845044fd993d166824f3b9cc (DEFAULT_TABLE table=default.Table_83090de75bd14a7898987c9d0c93b871 [id=1f5468b83cf74cd49cde65514c10c24d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.291568 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 359) took 5652 ms. Trace:
I20260928 20:02:58.291919 28030 rpcz_store.cc:276] 0928 20:02:52.639565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.639653 (+ 88us) service_pool.cc:224] Handling call
0928 20:02:57.481866 (+4842213us) ts_tablet_manager.cc:1197] Deleting tablet db5f5f16f2d7457799e1b96a293695f4
0928 20:02:57.481920 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:57.970764 (+488844us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.172991 (+202227us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.291516 (+118525us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4841725}
I20260928 20:02:58.293267 28030 tablet_replica.cc:333] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:02:58.294757 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 6a31001f85b44bfcb35a29675f177b9e (DEFAULT_TABLE table=default.Table_6161480f563f4672a8ae27fe327141a4 [id=0c3ea0c89425460887cce9fd3d245eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.319089 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ddbef16a957543e9a5d66e47979c16be" } modify_external_catalogs: true
I20260928 20:02:58.319619 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_ddbef16a957543e9a5d66e47979c16be" } modify_external_catalogs: true
I20260928 20:02:58.320513 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a343f55509fc4555836efe7503996740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.322263 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a343f55509fc4555836efe7503996740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.295531 26770 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 431) took 1240 ms. Trace:
I20260928 20:02:58.325397 26770 rpcz_store.cc:276] 0928 20:02:57.054696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.054882 (+ 186us) service_pool.cc:224] Handling call
0928 20:02:57.121140 (+ 66258us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.121240 (+ 100us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.491796 (+370556us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.228846 (+737050us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.295466 (+ 66620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.327168 26770 tablet_service.cc:1511] Processing CreateTablet for tablet 06f7b05e756f4a4db5031ff1e14c6ff6 (DEFAULT_TABLE table=default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.301941 26781 tablet_service.cc:1511] Processing CreateTablet for tablet ec76c64607c9425fb5c837cb856c852c (DEFAULT_TABLE table=default.Table_b6e9471784104b748304857c18d1c3c8 [id=37c8252e29f9443bb978a9ee2b863bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.331523 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 2d02292105e6430c9231f26b62befe34 (DEFAULT_TABLE table=default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.352806 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 23d262c7a15b434d8caea0a818323dd1
I20260928 20:02:58.349782 26626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 406) took 1154 ms. Trace:
I20260928 20:02:58.359608 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fcf649830b9146c692f14a80b201e631" } modify_external_catalogs: true
I20260928 20:02:58.360103 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_fcf649830b9146c692f14a80b201e631" } modify_external_catalogs: true
W20260928 20:02:58.362501 28293 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.595s user 0.012s sys 0.007s
I20260928 20:02:58.368835 28047 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:58.369256 28047 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.372887 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_39e9fc84df3844129902f8bb568244e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:58.291682 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bd0122845044fd993d166824f3b9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.313500 26769 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 432) took 1256 ms. Trace:
W20260928 20:02:58.374305 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39e9fc84df3844129902f8bb568244e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.374185 26769 rpcz_store.cc:276] 0928 20:02:57.056770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.056954 (+ 184us) service_pool.cc:224] Handling call
0928 20:02:57.131835 (+ 74881us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.131927 (+ 92us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.848226 (+716299us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.289752 (+441526us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.313439 (+ 23687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.374512 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_18c37f8dfcdb47169eb7230ea02b7b2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.375310 26594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 20:02:58.375816 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18c37f8dfcdb47169eb7230ea02b7b2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.375684 26769 tablet_service.cc:1511] Processing CreateTablet for tablet 158ddf1201784a93ada93e629befa030 (DEFAULT_TABLE table=default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.376334 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d02292105e6430c9231f26b62befe34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.376667 26769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ddf1201784a93ada93e629befa030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.315128 26768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 433) took 1256 ms. Trace:
I20260928 20:02:58.323315 28030 raft_consensus.cc:2243] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:58.296049 26771 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 430) took 1242 ms. Trace:
I20260928 20:02:58.378242 26771 rpcz_store.cc:276] 0928 20:02:57.053240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.053411 (+ 171us) service_pool.cc:224] Handling call
0928 20:02:57.115906 (+ 62495us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.116008 (+ 102us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.369486 (+253478us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.235084 (+865598us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.295999 (+ 60915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.380376 26771 tablet_service.cc:1511] Processing CreateTablet for tablet b13a571f3bd34209b0e6fd9441055eb1 (DEFAULT_TABLE table=default.Table_12847c70617446c79bef47447bba6e7f [id=24710d0e366c44a0b041c457b40e9385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.381076 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce6188a8420478ab3565fbc9fb7e5e9 (DEFAULT_TABLE table=default.Table_3bbea633f65b40279f5e069f2cf18cd3 [id=93f93c4333824319bec279868d0f3cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.381357 26771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13a571f3bd34209b0e6fd9441055eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.382153 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce6188a8420478ab3565fbc9fb7e5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.377874 26768 rpcz_store.cc:276] 0928 20:02:57.058636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.280572 (+221936us) service_pool.cc:224] Handling call
0928 20:02:57.387192 (+106620us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.394263 (+ 7071us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.900565 (+506302us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.314685 (+414120us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.315072 (+ 387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.391954 26768 tablet_service.cc:1511] Processing CreateTablet for tablet d4ac199f639c454cbc920012040f52c9 (DEFAULT_TABLE table=default.Table_c2e7429ecbd942bd908a88d634de17c6 [id=4a90001d3d204a01929c3a0d03e0bcc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.392980 26768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ac199f639c454cbc920012040f52c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.394371 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce6188a8420478ab3565fbc9fb7e5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.395545 26767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a658eaaedb4432a4dc2e1f5df6cc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.395676 26632 tablet_service.cc:1511] Processing CreateTablet for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (DEFAULT_TABLE table=default.Table_a8441fd485464204a3f365c57858acfa [id=0266a3b47dac49d1b20b241e9cf91d1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.396553 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba8a3870878487991e518ee46b36cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.396656 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a658eaaedb4432a4dc2e1f5df6cc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.399482 26765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210183ea66e349d0b8ef63c0964ca0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.400354 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e030d67e3a476abf25301e888fecc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.401810 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet de40520ccd9b4a52a45c4085afd45b2d
I20260928 20:02:58.401932 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec76c64607c9425fb5c837cb856c852c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.403275 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d02292105e6430c9231f26b62befe34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.404497 26766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79967f9c7bf44678b9681449992776c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.405447 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ad5978f7624bcdb63ca9e71d29b2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.406817 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7053ca61ed6e4f6dbf1f5adb54728792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.407925 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a31001f85b44bfcb35a29675f177b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.409360 26770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f7b05e756f4a4db5031ff1e14c6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.418859 28047 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:58.419694 28030 raft_consensus.cc:2272] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:58.421548 28030 ts_tablet_manager.cc:1962] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:58.428005 26772 tablet_service.cc:1511] Processing CreateTablet for tablet 693cc46819bf4480b5cef0f9b92e66b2 (DEFAULT_TABLE table=default.Table_41f900344d434a3aa235b7a49f202b4f [id=8242c87c5c8148d58cb3ba7b8a1cdcbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.429147 26772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693cc46819bf4480b5cef0f9b92e66b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:58.431191 26628 consensus_meta.cc:287] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.686s user 0.010s sys 0.000s
I20260928 20:02:58.432103 26628 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 405) took 1236 ms. Trace:
I20260928 20:02:58.432420 26628 rpcz_store.cc:276] 0928 20:02:57.195204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.198189 (+ 2985us) service_pool.cc:224] Handling call
0928 20:02:57.199905 (+ 1716us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.199981 (+ 76us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.744811 (+544830us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.431640 (+686829us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.432048 (+ 408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.444780 28059 ts_tablet_manager.cc:1962] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:02:58.446827 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 49402.8us
I20260928 20:02:58.448175 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 79967f9c7bf44678b9681449992776c5 (DEFAULT_TABLE table=default.Table_3df208002e624823846e63d97d7d9038 [id=fbd517599006491b92bd6e5869c4212d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.211342 27857 rpcz_store.cc:276] 0928 20:02:53.003297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.003400 (+ 103us) service_pool.cc:224] Handling call
0928 20:02:56.291327 (+3287927us) ts_tablet_manager.cc:1197] Deleting tablet ba87a379ae6a4feabfbc9fd6ba2d488e
0928 20:02:56.291386 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:57.255486 (+964100us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.091507 (+836021us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.198695 (+107188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202180,"tablet-delete.queue_time_us":3287342}
W20260928 20:02:58.219193 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 73900.7us
I20260928 20:02:58.451002 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79967f9c7bf44678b9681449992776c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.471623 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_e3405e57e5f24f9897ccba60b873c071" } new_table_name: "default.Table_3aac74ee9db6415aac8085230f6f9f02" modify_external_catalogs: true
I20260928 20:02:58.477574 26633 tablet_service.cc:1511] Processing CreateTablet for tablet dba8a3870878487991e518ee46b36cca (DEFAULT_TABLE table=default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.478714 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba8a3870878487991e518ee46b36cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.492756 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_0f0ada7547004715aeb96e77c7a7f3ee" } new_table_name: "default.Table_de1be52b5b5a4ec6870d2d66b8e5fae2" modify_external_catalogs: true
I20260928 20:02:58.496483 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 210183ea66e349d0b8ef63c0964ca0c8 (DEFAULT_TABLE table=default.Table_f8219cfe619d4917a68dc3e0eee210a2 [id=7163beea98f0410a90915a1b66902dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.502944 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210183ea66e349d0b8ef63c0964ca0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.505806 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_fedfb8c741fe405c9e165b3d9fe8488d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.507323 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fedfb8c741fe405c9e165b3d9fe8488d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.510833 26488 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b11022fc774d18b92e0c694f834375 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:58.512197 26484 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc1eea43de1459aa49e7072cf8b89ca (DEFAULT_TABLE table=default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.536590 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9db52eb6b080457583b0a59291995843 consensus state has no leader
I20260928 20:02:58.557382 26486 tablet_service.cc:1511] Processing CreateTablet for tablet 61bd0122845044fd993d166824f3b9cc (DEFAULT_TABLE table=default.Table_83090de75bd14a7898987c9d0c93b871 [id=1f5468b83cf74cd49cde65514c10c24d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.558506 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6ad2a1c67f69404f894b3deadc055fba" } modify_external_catalogs: true
I20260928 20:02:58.559010 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_6ad2a1c67f69404f894b3deadc055fba" } modify_external_catalogs: true
I20260928 20:02:58.561002 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_c909970e41b44433885b634d80002868"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.562397 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c909970e41b44433885b634d80002868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.562976 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb99b1b34b844b4b6bdbd52c646f087 (DEFAULT_TABLE table=default.Table_6705a1b4132644408979a6ed69958eba [id=b265254a22fd4381a4c8135dda1abcd7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.564525 26450 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:58.565253 26450 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:58.565809 26450 leader_election.cc:343] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:02:58.566334 26450 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:58.571568 28304 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:58.572168 26481 consensus_meta.cc:287] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.751s user 0.010s sys 0.000s
I20260928 20:02:58.525315 28303 raft_consensus.cc:493] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:58.579320 28303 raft_consensus.cc:515] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.580155 26482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 430) took 1619 ms. Trace:
I20260928 20:02:58.580535 26482 rpcz_store.cc:276] 0928 20:02:56.960546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.961784 (+ 1238us) service_pool.cc:224] Handling call
0928 20:02:57.089431 (+127647us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.089576 (+ 145us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.796508 (+706932us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.997324 (+200816us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.579977 (+582653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.581574 28303 leader_election.cc:290] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:58.583405 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 72ad5978f7624bcdb63ca9e71d29b2e4 (DEFAULT_TABLE table=default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 [id=62a432d0a82e48efb93877e3c46cb37b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.585095 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 2d02292105e6430c9231f26b62befe34 (DEFAULT_TABLE table=default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.585451 26482 tablet_service.cc:1511] Processing CreateTablet for tablet 23e030d67e3a476abf25301e888fecc0 (DEFAULT_TABLE table=default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.586195 26492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 426) took 1384 ms. Trace:
I20260928 20:02:58.586592 26492 rpcz_store.cc:276] 0928 20:02:56.813761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.842720 (+ 28959us) service_pool.cc:224] Handling call
0928 20:02:57.032085 (+189365us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.032162 (+ 77us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.839173 (+807011us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:57.857187 (+ 18014us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.198403 (+341216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.591249 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1dc729477b8405d85c2c4a9c20a3efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.591534 26916 tablet_bootstrap.cc:492] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:58.594743 26492 tablet_service.cc:1511] Processing CreateTablet for tablet dba8a3870878487991e518ee46b36cca (DEFAULT_TABLE table=default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.597570 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:02:58.598619 26478 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 437) took 1602 ms. Trace:
I20260928 20:02:58.598989 26478 rpcz_store.cc:276] 0928 20:02:56.995904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.006578 (+ 10674us) service_pool.cc:224] Handling call
0928 20:02:57.780743 (+774165us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.781049 (+ 306us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.092471 (+311422us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.195755 (+103284us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.598544 (+402789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.606961 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b943773d8804b0db0fbed9978461690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.606988 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_29313cec5adc47e1af7bd7a25a0ce4ef" } modify_external_catalogs: true
I20260928 20:02:58.607493 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_29313cec5adc47e1af7bd7a25a0ce4ef" } modify_external_catalogs: true
I20260928 20:02:58.613441 26916 tablet_bootstrap.cc:654] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:58.617743 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 377) took 5198 ms. Trace:
I20260928 20:02:58.618074 27857 rpcz_store.cc:276] 0928 20:02:53.419462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.419597 (+ 135us) service_pool.cc:224] Handling call
0928 20:02:58.511602 (+5092005us) ts_tablet_manager.cc:1197] Deleting tablet b97ad3f841f54aa38bbb312c50db384e
0928 20:02:58.607384 (+ 95782us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:58.617687 (+ 10303us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5066622}
I20260928 20:02:58.618044 26484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc1eea43de1459aa49e7072cf8b89ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.619140 27857 tablet_replica.cc:333] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:58.619982 27857 raft_consensus.cc:2243] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:58.620425 27857 raft_consensus.cc:2272] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:58.622408 27857 ts_tablet_manager.cc:1962] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:58.622437 26486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61bd0122845044fd993d166824f3b9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.622552 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_2b9a194ac4714f1092a26ae9acfbe4a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.623996 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.624936 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_ae0aaeea99ba48d2b04d9d08370b3285"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:58.626523 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb99b1b34b844b4b6bdbd52c646f087. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:58.626394 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae0aaeea99ba48d2b04d9d08370b3285 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.651247 26478 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce6188a8420478ab3565fbc9fb7e5e9 (DEFAULT_TABLE table=default.Table_3bbea633f65b40279f5e069f2cf18cd3 [id=93f93c4333824319bec279868d0f3cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.652014 26493 tablet_service.cc:1511] Processing CreateTablet for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (DEFAULT_TABLE table=default.Table_a8441fd485464204a3f365c57858acfa [id=0266a3b47dac49d1b20b241e9cf91d1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.652460 26478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce6188a8420478ab3565fbc9fb7e5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.653149 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a658eaaedb4432a4dc2e1f5df6cc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.676832 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:02:58.678299 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ad5978f7624bcdb63ca9e71d29b2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.678198 26481 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 436) took 1682 ms. Trace:
I20260928 20:02:58.679167 26481 rpcz_store.cc:276] 0928 20:02:56.995636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.997088 (+ 1452us) service_pool.cc:224] Handling call
0928 20:02:57.167431 (+170343us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.779208 (+611777us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.821091 (+ 41883us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.572593 (+751502us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.678134 (+105541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.682246 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d02292105e6430c9231f26b62befe34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.683261 26482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e030d67e3a476abf25301e888fecc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.702900 28302 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:58.706880 26480 consensus_meta.cc:287] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.567s user 0.001s sys 0.006s
I20260928 20:02:58.708472 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba8a3870878487991e518ee46b36cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.712568 27857 ts_tablet_manager.cc:1975] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:02:58.712947 27857 log.cc:1199] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/f478cce587a548e1aab620721c3bb1c1
I20260928 20:02:58.713558 27857 ts_tablet_manager.cc:1996] T f478cce587a548e1aab620721c3bb1c1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:58.714924 26480 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 432) took 1720 ms. Trace:
I20260928 20:02:58.715476 26480 rpcz_store.cc:276] 0928 20:02:56.994498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.008075 (+ 13577us) service_pool.cc:224] Handling call
0928 20:02:57.781468 (+773393us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.781716 (+ 248us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.138927 (+357211us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.714389 (+575462us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.714867 (+ 478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.716521 26235 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_de1be52b5b5a4ec6870d2d66b8e5fae2" } new_table_name: "default.Table_a0353fc8b2fd4450b0a95898683a518d" modify_external_catalogs: true
I20260928 20:02:58.505856 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 7053ca61ed6e4f6dbf1f5adb54728792 (DEFAULT_TABLE table=default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f [id=c43f875938fb4105b927b7aee9612a7c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.514161 26592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s user 0.006s sys 0.011s
W20260928 20:02:58.721578 26592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s user 0.007s sys 0.011s
W20260928 20:02:58.722826 26592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:02:58.724262 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:58.724416 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 379) took 4247 ms. Trace:
I20260928 20:02:58.726228 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 6a31001f85b44bfcb35a29675f177b9e (DEFAULT_TABLE table=default.Table_6161480f563f4672a8ae27fe327141a4 [id=0c3ea0c89425460887cce9fd3d245eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.726881 26487 tablet_service.cc:1511] Processing CreateTablet for tablet ec76c64607c9425fb5c837cb856c852c (DEFAULT_TABLE table=default.Table_b6e9471784104b748304857c18d1c3c8 [id=37c8252e29f9443bb978a9ee2b863bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.727277 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a31001f85b44bfcb35a29675f177b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.727896 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec76c64607c9425fb5c837cb856c852c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.732170 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:58.733589 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:58.735301 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 06f7b05e756f4a4db5031ff1e14c6ff6 (DEFAULT_TABLE table=default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.736248 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f7b05e756f4a4db5031ff1e14c6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.529971 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 6a31001f85b44bfcb35a29675f177b9e (DEFAULT_TABLE table=default.Table_6161480f563f4672a8ae27fe327141a4 [id=0c3ea0c89425460887cce9fd3d245eec]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.538467 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 90958.4us
I20260928 20:02:58.742799 26478 tablet_service.cc:1511] Processing CreateTablet for tablet 210183ea66e349d0b8ef63c0964ca0c8 (DEFAULT_TABLE table=default.Table_f8219cfe619d4917a68dc3e0eee210a2 [id=7163beea98f0410a90915a1b66902dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.743562 26594 leader_election.cc:304] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:58.744264 28298 raft_consensus.cc:2804] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:58.744583 28298 raft_consensus.cc:493] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:58.744877 28298 raft_consensus.cc:3060] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:58.745707 26478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210183ea66e349d0b8ef63c0964ca0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.745519 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_932f16b87c7e4e89a0cd7f710df1532d" } new_table_name: "default.Table_ae224fd5a9304c66a73de6f9b07d6fef" modify_external_catalogs: true
I20260928 20:02:58.746889 26594 leader_election.cc:304] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:58.353323 26626 rpcz_store.cc:276] 0928 20:02:57.195452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.202381 (+ 6929us) service_pool.cc:224] Handling call
0928 20:02:57.203588 (+ 1207us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.203668 (+ 80us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.008517 (+804849us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.349293 (+340776us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.349715 (+ 422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.749473 26626 tablet_service.cc:1511] Processing CreateTablet for tablet 92397ac1a63a46e591e699e76627d5db (DEFAULT_TABLE table=default.Table_c68f60885a0940f583aa139abd8a834a [id=1fd0e6f7ff6b4552b40c8d2afce48966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.534250 28306 raft_consensus.cc:493] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:58.750556 28306 raft_consensus.cc:515] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.750962 26481 tablet_service.cc:1511] Processing CreateTablet for tablet 7053ca61ed6e4f6dbf1f5adb54728792 (DEFAULT_TABLE table=default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f [id=c43f875938fb4105b927b7aee9612a7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.595342 26628 tablet_service.cc:1511] Processing CreateTablet for tablet ec76c64607c9425fb5c837cb856c852c (DEFAULT_TABLE table=default.Table_b6e9471784104b748304857c18d1c3c8 [id=37c8252e29f9443bb978a9ee2b863bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.752012 26481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7053ca61ed6e4f6dbf1f5adb54728792. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:58.605159 26625 consensus_meta.cc:287] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.692s user 0.008s sys 0.003s
W20260928 20:02:58.753271 26235 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9db52eb6b080457583b0a59291995843 consensus state has no leader
I20260928 20:02:58.724761 27857 rpcz_store.cc:276] 0928 20:02:54.476538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.476642 (+ 104us) service_pool.cc:224] Handling call
0928 20:02:58.618955 (+4142313us) ts_tablet_manager.cc:1197] Deleting tablet f478cce587a548e1aab620721c3bb1c1
0928 20:02:58.619008 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:58.649458 (+ 30450us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.712448 (+ 62990us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.724345 (+ 11897us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4088473}
I20260928 20:02:58.754712 27857 tablet_replica.cc:333] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:58.755561 27857 raft_consensus.cc:2243] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:58.753548 26625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 407) took 1527 ms. Trace:
I20260928 20:02:58.756255 27857 raft_consensus.cc:2272] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:58.654407 28284 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 390) took 3501 ms. Trace:
I20260928 20:02:58.758217 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_1d04da9e1ce749aaafdc63f86a11535e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:58.758908 28284 rpcz_store.cc:276] 0928 20:02:55.152929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.153043 (+ 114us) service_pool.cc:224] Handling call
0928 20:02:58.654337 (+3501294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:55.195592 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:55.195912 (+ 320us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:55.195940 (+ 28us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:55.195980 (+ 40us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:55.196085 (+ 105us) alter_schema_op.cc:128] START. Timestamp: 1790625775195985
0928 20:02:55.196109 (+ 24us) op_driver.cc:348] REPLICATION: starting
0928 20:02:55.196614 (+ 505us) log.cc:844] Serialized 173 byte log entry
0928 20:02:56.888308 (+1691694us) op_driver.cc:464] REPLICATION: finished
0928 20:02:57.004688 (+116380us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:02:57.180639 (+175951us) log.cc:844] Serialized 5 byte log entry
0928 20:02:58.600168 (+1419529us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.600911 (+ 743us) log.cc:844] Serialized 14 byte log entry
0928 20:02:58.654161 (+ 53250us) alter_schema_op.cc:73] Released schema lock
0928 20:02:58.654198 (+ 37us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":116190,"prepare.queue_time_us":41686,"prepare.run_cpu_time_us":2146,"prepare.run_wall_time_us":48505,"raft.queue_time_us":78,"raft.run_cpu_time_us":777,"raft.run_wall_time_us":776,"replication_time_us":1692091,"thread_start_us":798397,"threads_started":4,"wal-append.queue_time_us":560616,"wal-append.run_cpu_time_us":1950,"wal-append.run_wall_time_us":1008121}]]}
W20260928 20:02:58.763230 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 647a383938f947108890ae2042e3edc3 consensus state has no leader
I20260928 20:02:58.766255 28302 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:58.767205 28302 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.769495 28302 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:58.770051 28302 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:58.779808 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d04da9e1ce749aaafdc63f86a11535e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.688256 26629 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 420) took 1286 ms. Trace:
I20260928 20:02:58.784266 26629 rpcz_store.cc:276] 0928 20:02:57.401526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.412238 (+ 10712us) service_pool.cc:224] Handling call
0928 20:02:57.762661 (+350423us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.915827 (+153166us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.223452 (+307625us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.640461 (+417009us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.688202 (+ 47741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.786434 26629 tablet_service.cc:1511] Processing CreateTablet for tablet 158ddf1201784a93ada93e629befa030 (DEFAULT_TABLE table=default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.788640 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_53c689bd6dc0475da06ec57192aaa587"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.789994 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53c689bd6dc0475da06ec57192aaa587 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.690023 26627 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 421) took 1288 ms. Trace:
I20260928 20:02:58.793368 26627 rpcz_store.cc:276] 0928 20:02:57.401840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.412279 (+ 10439us) service_pool.cc:224] Handling call
0928 20:02:57.917334 (+505055us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.965374 (+ 48040us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.428739 (+463365us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.689600 (+260861us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.689969 (+ 369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.798404 28273 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:02:58.804399 26236 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_65cffcfc7e34435cba2424c5d150d38c" } modify_external_catalogs: true
I20260928 20:02:58.804950 26236 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_65cffcfc7e34435cba2424c5d150d38c" } modify_external_catalogs: true
I20260928 20:02:58.695303 26624 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 419) took 1303 ms. Trace:
I20260928 20:02:58.805567 26624 rpcz_store.cc:276] 0928 20:02:57.391622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.393630 (+ 2008us) service_pool.cc:224] Handling call
0928 20:02:57.413010 (+ 19380us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.420615 (+ 7605us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.610529 (+1189914us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.694882 (+ 84353us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.695247 (+ 365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.807250 26624 tablet_service.cc:1511] Processing CreateTablet for tablet d4ac199f639c454cbc920012040f52c9 (DEFAULT_TABLE table=default.Table_c2e7429ecbd942bd908a88d634de17c6 [id=4a90001d3d204a01929c3a0d03e0bcc6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.529948 26912 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.804s user 0.011s sys 0.005s
W20260928 20:02:58.819221 26912 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.093s user 0.012s sys 0.005s
I20260928 20:02:58.821015 26912 tablet_bootstrap.cc:492] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:58.821519 26912 ts_tablet_manager.cc:1449] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 1.523s user 0.023s sys 0.005s
W20260928 20:02:58.530275 26738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s user 0.006s sys 0.016s
W20260928 20:02:58.824277 26738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.151s user 0.006s sys 0.016s
I20260928 20:02:58.531893 26780 tablet_service.cc:1511] Processing CreateTablet for tablet eac9b3e02fb541cab6d0d3c46743ff9e (DEFAULT_TABLE table=default.Table_6655d0a31a0f40f495acbad72c9ccfc9 [id=69cb6b4dc2ac4e47b92be86a394c9929]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.546258 26737 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 62671.4us
I20260928 20:02:58.783103 26739 leader_election.cc:304] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:02:58.834792 28047 raft_consensus.cc:2804] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:58.835253 28047 raft_consensus.cc:697] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:02:58.835989 28047 consensus_queue.cc:237] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:02:58.839525 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 56500us
I20260928 20:02:58.839879 26236 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:02:58.847761 27857 ts_tablet_manager.cc:1962] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:58.847872 28265 raft_consensus.cc:493] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:02:58.848345 28265 raft_consensus.cc:515] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:58.848981 28304 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:02:58.849377 28304 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.850216 28265 leader_election.cc:290] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:58.850643 28265 raft_consensus.cc:493] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:02:58.851054 28265 raft_consensus.cc:515] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.851469 28304 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:58.852789 28265 leader_election.cc:290] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:58.858366 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac9b3e02fb541cab6d0d3c46743ff9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.871428 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 158ddf1201784a93ada93e629befa030 (DEFAULT_TABLE table=default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.871652 26482 tablet_service.cc:1511] Processing CreateTablet for tablet b13a571f3bd34209b0e6fd9441055eb1 (DEFAULT_TABLE table=default.Table_12847c70617446c79bef47447bba6e7f [id=24710d0e366c44a0b041c457b40e9385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.872622 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ddf1201784a93ada93e629befa030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.873196 26482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13a571f3bd34209b0e6fd9441055eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.715363 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 06f7b05e756f4a4db5031ff1e14c6ff6 (DEFAULT_TABLE table=default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.539376 26913 tablet_bootstrap.cc:492] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:02:58.875442 26913 ts_tablet_manager.cc:1449] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 1.622s user 0.024s sys 0.002s
I20260928 20:02:58.756982 26625 rpcz_store.cc:276] 0928 20:02:57.225621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.231162 (+ 5541us) service_pool.cc:224] Handling call
0928 20:02:57.232578 (+ 1416us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.232667 (+ 89us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:57.912415 (+679748us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.752961 (+840546us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.753415 (+ 454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.778499 28079 raft_consensus.cc:2804] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:02:58.877507 28079 raft_consensus.cc:493] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:02:58.877897 28079 raft_consensus.cc:3060] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:58.879869 26625 tablet_service.cc:1511] Processing CreateTablet for tablet 693cc46819bf4480b5cef0f9b92e66b2 (DEFAULT_TABLE table=default.Table_41f900344d434a3aa235b7a49f202b4f [id=8242c87c5c8148d58cb3ba7b8a1cdcbc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.881461 26450 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:58.881644 26235 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_06b8763e3d1242f796a3861e889b693a" } modify_external_catalogs: true
I20260928 20:02:58.882200 26235 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_06b8763e3d1242f796a3861e889b693a" } modify_external_catalogs: true
I20260928 20:02:58.687666 26622 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 423) took 1285 ms. Trace:
I20260928 20:02:58.883827 26622 rpcz_store.cc:276] 0928 20:02:57.402524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.458348 (+ 55824us) service_pool.cc:224] Handling call
0928 20:02:57.544126 (+ 85778us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.544270 (+ 144us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.517613 (+973343us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.629578 (+111965us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:58.687602 (+ 58024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:58.885860 26622 tablet_service.cc:1511] Processing CreateTablet for tablet eac9b3e02fb541cab6d0d3c46743ff9e (DEFAULT_TABLE table=default.Table_6655d0a31a0f40f495acbad72c9ccfc9 [id=69cb6b4dc2ac4e47b92be86a394c9929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.886483 26450 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:58.882534 26480 tablet_service.cc:1511] Processing CreateTablet for tablet 79967f9c7bf44678b9681449992776c5 (DEFAULT_TABLE table=default.Table_3df208002e624823846e63d97d7d9038 [id=fbd517599006491b92bd6e5869c4212d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.891237 26496 tablet_service.cc:1511] Processing CreateTablet for tablet d4ac199f639c454cbc920012040f52c9 (DEFAULT_TABLE table=default.Table_c2e7429ecbd942bd908a88d634de17c6 [id=4a90001d3d204a01929c3a0d03e0bcc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.892570 27857 ts_tablet_manager.cc:1975] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:58.892894 27857 log.cc:1199] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/01533b61bad74ddb9056aeacef13a126
I20260928 20:02:58.893573 27857 ts_tablet_manager.cc:1996] T 01533b61bad74ddb9056aeacef13a126 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:02:58.894657 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ac199f639c454cbc920012040f52c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.771380 28302 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.897766 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_7cf3f31c382c41328b3bc3b015ec4320"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:58.900007 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cf3f31c382c41328b3bc3b015ec4320 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.910224 28303 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:58.912582 26912 raft_consensus.cc:359] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.913381 26912 raft_consensus.cc:385] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:58.913686 26912 raft_consensus.cc:740] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:58.914389 26912 consensus_queue.cc:260] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:58.916322 26912 ts_tablet_manager.cc:1480] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.094s user 0.002s sys 0.002s
I20260928 20:02:58.915777 26477 tablet_service.cc:1511] Processing CreateTablet for tablet eac9b3e02fb541cab6d0d3c46743ff9e (DEFAULT_TABLE table=default.Table_6655d0a31a0f40f495acbad72c9ccfc9 [id=69cb6b4dc2ac4e47b92be86a394c9929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.918385 26228 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_92cd775d03ce43259e1527778a376855"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:58.781031 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a31001f85b44bfcb35a29675f177b9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:58.919864 26228 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92cd775d03ce43259e1527778a376855 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:58.921293 26626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92397ac1a63a46e591e699e76627d5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.922786 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7053ca61ed6e4f6dbf1f5adb54728792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.925159 26477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac9b3e02fb541cab6d0d3c46743ff9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.926663 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 693cc46819bf4480b5cef0f9b92e66b2 (DEFAULT_TABLE table=default.Table_41f900344d434a3aa235b7a49f202b4f [id=8242c87c5c8148d58cb3ba7b8a1cdcbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.924095 26625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693cc46819bf4480b5cef0f9b92e66b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.934012 26629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158ddf1201784a93ada93e629befa030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.935251 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec76c64607c9425fb5c837cb856c852c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.936672 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f7b05e756f4a4db5031ff1e14c6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.936532 26627 tablet_service.cc:1511] Processing CreateTablet for tablet b13a571f3bd34209b0e6fd9441055eb1 (DEFAULT_TABLE table=default.Table_12847c70617446c79bef47447bba6e7f [id=24710d0e366c44a0b041c457b40e9385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.937911 26627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b13a571f3bd34209b0e6fd9441055eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:58.941892 26622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac9b3e02fb541cab6d0d3c46743ff9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:58.942854 26450 leader_election.cc:343] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:58.943354 26450 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:58.957098 26228 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_7bc4de2a66f140ed9204fdc4d2336ce3" } new_table_name: "default.Table_741f8f3a7aec43c3af7decc959ca0938" modify_external_catalogs: true
I20260928 20:02:58.966293 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 0e0a362efb68408d8dce96dce0130035 (table default.Table_c91c71ef331f4a48a1e0e41a3cbe33e6 [id=62b393e94fb74eb6a1103662c6a672c7]) successfully deleted
I20260928 20:02:58.969879 26236 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_3aac74ee9db6415aac8085230f6f9f02" } new_table_name: "default.Table_448e0060fd3d49018e59b4875da55674" modify_external_catalogs: true
I20260928 20:02:58.971266 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:58.976866 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:58.978473 26228 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1d6dcd913394d4ca2e4b9f5be5ea069 consensus state has no leader
W20260928 20:02:58.980726 26636 consensus_meta.cc:287] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.529s user 0.008s sys 0.001s
I20260928 20:02:58.982331 26636 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1a8c85b6bc4849b447b6fd048afb2f (DEFAULT_TABLE table=default.Table_c17f6d0dcd96486ca59966415e8978de [id=8b3fd73182f14c10b4a847d1ae537630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.991410 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693cc46819bf4480b5cef0f9b92e66b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.005841 26480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79967f9c7bf44678b9681449992776c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.020417 26479 tablet_service.cc:1511] Processing CreateTablet for tablet e1f21c71dc0e41aba85bb01c9fddc12d (DEFAULT_TABLE table=default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.028928 26479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f21c71dc0e41aba85bb01c9fddc12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.033013 28323 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:02:59.033306 26236 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_850721f396e049e48b48b6a6636ff076"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:59.033668 28323 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:02:59.035390 26236 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_850721f396e049e48b48b6a6636ff076 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:59.036917 28323 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:02:59.036886 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:02:59.038899 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:02:59.046132 26228 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_51d3ebaa7ade42cb81c42d1ff48266b9" } modify_external_catalogs: true
I20260928 20:02:59.046645 26228 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40138:
table { table_name: "default.Table_51d3ebaa7ade42cb81c42d1ff48266b9" } modify_external_catalogs: true
I20260928 20:02:59.049427 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:59.050863 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:59.057988 26235 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet 62114712f2c040e6b1ae831911d68896
W20260928 20:02:59.080032 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 137210us
I20260928 20:02:59.082604 28303 raft_consensus.cc:2749] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:59.083768 26916 tablet_bootstrap.cc:492] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:02:59.084173 26916 ts_tablet_manager.cc:1449] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.493s user 0.043s sys 0.046s
I20260928 20:02:58.982924 26624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ac199f639c454cbc920012040f52c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.085904 28284 tablet.cc:1751] T 7e86d2d680c545e0b0511dec35ba6c9a P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:58.995385 26913 raft_consensus.cc:359] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.092396 26913 raft_consensus.cc:385] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:59.092722 26913 raft_consensus.cc:740] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:02:59.093384 26913 consensus_queue.cc:260] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.095198 26913 ts_tablet_manager.cc:1480] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.219s user 0.005s sys 0.004s
I20260928 20:02:59.096035 26916 raft_consensus.cc:359] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.096670 26916 raft_consensus.cc:385] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:59.096939 26916 raft_consensus.cc:740] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:02:59.097510 26916 consensus_queue.cc:260] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.084293 28302 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:59.099625 26916 ts_tablet_manager.cc:1480] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260928 20:02:59.103309 26916 tablet_bootstrap.cc:492] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:02:59.119678 26228 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: Sending DeleteTablet for 3 replicas of tablet ed48087b59c744f9a928c8d529b69211
I20260928 20:02:59.042528 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:02:59.132117 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet a86e8a782b3e46d09a45bbb7025546af (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]) successfully deleted
I20260928 20:02:59.079494 27900 ts_manager.cc:194] Registered new tserver with Master: 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:59.136097 26233 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3a1fe1bee5784c8d936a31fa0096fba5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:02:59.137830 26233 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a1fe1bee5784c8d936a31fa0096fba5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:59.139117 26912 tablet_bootstrap.cc:492] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:02:58.982399 28309 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:02:59.139636 28309 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.003065 26594 leader_election.cc:304] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:02:59.140679 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 137675us
I20260928 20:02:59.142211 28309 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:59.142053 26235 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40138:
name: "default.Table_3697e383390b4709b95e01cb55f17c34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:02:59.004588 26621 tablet_service.cc:1511] Processing CreateTablet for tablet e1f21c71dc0e41aba85bb01c9fddc12d (DEFAULT_TABLE table=default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:58.960768 26623 tablet_service.cc:1511] Processing CreateTablet for tablet 6447b96436b34949a35f93b93732a820 (DEFAULT_TABLE table=default.Table_d90e6a6913a54889810926926798a1b4 [id=3a5c78e561ee43729940d404c103ab3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.029932 28059 ts_tablet_manager.cc:1975] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:59.078878 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:59.080736 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:02:59.081687 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:59.143596 26235 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3697e383390b4709b95e01cb55f17c34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:02:59.144587 28059 log.cc:1199] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/ee4c267b42754dbca8eb5ebec2d66a23
I20260928 20:02:59.145465 28059 ts_tablet_manager.cc:1996] T ee4c267b42754dbca8eb5ebec2d66a23 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:02:59.146435 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 103982us
I20260928 20:02:58.997149 28306 leader_election.cc:290] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:59.018076 26777 consensus_meta.cc:287] T b1dc729477b8405d85c2c4a9c20a3efd P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.656s user 0.006s sys 0.000s
I20260928 20:02:59.019698 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.150676 26792 raft_consensus.cc:2468] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:02:59.021674 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.022876 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.023474 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.024061 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.024655 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.025687 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.026295 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.027691 26849 heartbeater.cc:461] Registering TS with master...
I20260928 20:02:59.153982 26777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 444) took 1284 ms. Trace:
I20260928 20:02:59.154349 26777 rpcz_store.cc:276] 0928 20:02:57.869784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.875145 (+ 5361us) service_pool.cc:224] Handling call
0928 20:02:57.876241 (+ 1096us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.876338 (+ 97us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.361421 (+485083us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.153555 (+792134us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.153933 (+ 378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.159160 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 6447b96436b34949a35f93b93732a820 (DEFAULT_TABLE table=default.Table_d90e6a6913a54889810926926798a1b4 [id=3a5c78e561ee43729940d404c103ab3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.167160 26119 master-stress-test.cc:579] Killing test thread 1/10
I20260928 20:02:59.166326 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6447b96436b34949a35f93b93732a820. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:59.171092 26739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:02:59.156416 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:59.174883 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 7e86d2d680c545e0b0511dec35ba6c9a (table default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af]). Expected version 1 got 0
I20260928 20:02:59.140012 28323 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:02:59.179186 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 6447b96436b34949a35f93b93732a820 (DEFAULT_TABLE table=default.Table_d90e6a6913a54889810926926798a1b4 [id=3a5c78e561ee43729940d404c103ab3f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:59.180943 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e1d6dcd913394d4ca2e4b9f5be5ea069 consensus state has no leader
I20260928 20:02:59.187916 26490 tablet_service.cc:1511] Processing CreateTablet for tablet 7c865d2d368847dd9de688bdd65e88b9 (DEFAULT_TABLE table=default.Table_75a90a6806eb4588bfc09ac96125f4df [id=6029f28219a24f429bf99d14baa35339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.188128 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 7c865d2d368847dd9de688bdd65e88b9 (DEFAULT_TABLE table=default.Table_75a90a6806eb4588bfc09ac96125f4df [id=6029f28219a24f429bf99d14baa35339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.189199 26228 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 2 got 1
I20260928 20:02:59.190618 28303 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:59.191186 28303 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:59.193456 28303 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:02:59.210311 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 110658us
W20260928 20:02:59.213397 26450 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:59.213878 26450 leader_election.cc:304] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:59.214962 26450 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:02:59.215387 26450 leader_election.cc:304] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:02:59.221010 26495 consensus_meta.cc:287] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.525s user 0.007s sys 0.000s
I20260928 20:02:59.223106 26119 master-stress-test.cc:581] Killed test thread 1/10
I20260928 20:02:59.223469 26119 master-stress-test.cc:579] Killing test thread 2/10
I20260928 20:02:59.223755 26119 master-stress-test.cc:581] Killed test thread 2/10
I20260928 20:02:59.223961 26119 master-stress-test.cc:579] Killing test thread 3/10
I20260928 20:02:59.224197 26119 master-stress-test.cc:581] Killed test thread 3/10
I20260928 20:02:59.224390 26119 master-stress-test.cc:579] Killing test thread 4/10
I20260928 20:02:59.224606 26119 master-stress-test.cc:581] Killed test thread 4/10
I20260928 20:02:59.224813 26119 master-stress-test.cc:579] Killing test thread 5/10
I20260928 20:02:59.225044 26119 master-stress-test.cc:581] Killed test thread 5/10
I20260928 20:02:59.225255 26119 master-stress-test.cc:579] Killing test thread 6/10
I20260928 20:02:59.225479 26119 master-stress-test.cc:581] Killed test thread 6/10
I20260928 20:02:59.225661 26119 master-stress-test.cc:579] Killing test thread 7/10
I20260928 20:02:59.226135 26119 master-stress-test.cc:581] Killed test thread 7/10
I20260928 20:02:59.226337 26119 master-stress-test.cc:579] Killing test thread 8/10
I20260928 20:02:59.226631 26119 master-stress-test.cc:581] Killed test thread 8/10
I20260928 20:02:59.226845 26119 master-stress-test.cc:579] Killing test thread 9/10
I20260928 20:02:59.218408 28321 raft_consensus.cc:2749] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:59.230135 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 387) took 4544 ms. Trace:
I20260928 20:02:59.230312 28303 raft_consensus.cc:2749] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:02:59.230494 27857 rpcz_store.cc:276] 0928 20:02:54.685950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.686067 (+ 117us) service_pool.cc:224] Handling call
0928 20:02:58.754546 (+4068479us) ts_tablet_manager.cc:1197] Deleting tablet 01533b61bad74ddb9056aeacef13a126
0928 20:02:58.754597 (+ 51us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:58.867604 (+113007us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:58.892464 (+ 24860us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.230058 (+337594us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3867002}
I20260928 20:02:59.231593 27857 tablet_replica.cc:333] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:02:59.232389 27857 raft_consensus.cc:2243] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:02:59.232831 27857 raft_consensus.cc:2272] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:59.241019 26228 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_73bad59d2f45422d9e7f0409bdc4a2f4 [id=cbeeebe708654140b78d52a0bed4c6d0] alter complete (version 1)
I20260928 20:02:59.257349 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:02:59.262051 28303 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:02:59.262717 28303 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:59.274457 28321 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:59.275095 28321 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:59.300115 28302 raft_consensus.cc:493] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:59.300781 28302 raft_consensus.cc:515] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:59.304004 28265 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:59.304541 28265 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:59.307498 28265 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:59.308354 28302 leader_election.cc:290] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:59.347138 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c865d2d368847dd9de688bdd65e88b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.349711 26235 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 7e86d2d680c545e0b0511dec35ba6c9a (table default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af]). Expected version 1 got 0
I20260928 20:02:59.357551 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d9ca77e114c4d06bde1bcd862c8eccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:59.363163 26483 tablet_service.cc:1511] Processing CreateTablet for tablet c3600b2fbb574106b5b13ab837754eb3 (DEFAULT_TABLE table=default.Table_2bd98a3ca12b417aa6115a75f74e752c [id=1967b4ffcea84c8ab364a0e946e5d86b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.367686 26781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 461) took 1082 ms. Trace:
I20260928 20:02:59.368039 26781 rpcz_store.cc:276] 0928 20:02:58.284896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.301422 (+ 16526us) service_pool.cc:224] Handling call
0928 20:02:58.328459 (+ 27037us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.328528 (+ 69us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.818541 (+490013us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.174038 (+355497us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.367628 (+193590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.368973 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d9ca77e114c4d06bde1bcd862c8eccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.369501 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.369776 28319 raft_consensus.cc:493] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:02:59.370267 28319 raft_consensus.cc:515] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:02:59.370723 26658 raft_consensus.cc:3060] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:02:59.371037 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 229375us
I20260928 20:02:59.372066 26634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 440) took 1250 ms. Trace:
I20260928 20:02:59.372365 26634 rpcz_store.cc:276] 0928 20:02:58.124148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.330896 (+206748us) service_pool.cc:224] Handling call
0928 20:02:58.332271 (+ 1375us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.332344 (+ 73us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.936204 (+603860us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.068166 (+131962us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.372013 (+303847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.373683 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 7c865d2d368847dd9de688bdd65e88b9 (DEFAULT_TABLE table=default.Table_75a90a6806eb4588bfc09ac96125f4df [id=6029f28219a24f429bf99d14baa35339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.379503 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6447b96436b34949a35f93b93732a820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.380496 26774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 451) took 1134 ms. Trace:
I20260928 20:02:59.380817 26774 rpcz_store.cc:276] 0928 20:02:58.246575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.248116 (+ 1541us) service_pool.cc:224] Handling call
0928 20:02:58.297455 (+ 49339us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.297539 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.823258 (+525719us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.380056 (+556798us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.380442 (+ 386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.382213 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 22e032f645304dbc88a895fae4bbd777 (DEFAULT_TABLE table=default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.386839 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.053454 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 8d556a7736504aa2aa2fe8f868ecf489 (DEFAULT_TABLE table=default.Table_80b7e921026a449aac1078cb8ef22d63 [id=520a43e0bc5d418a9e1e2227a8e65249]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:58.917968 26782 consensus_meta.cc:287] T 46c39c6915964116ac14ea2781c7a52b P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.564s user 0.005s sys 0.000s
I20260928 20:02:59.390938 26782 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 443) took 1521 ms. Trace:
I20260928 20:02:59.391271 26782 rpcz_store.cc:276] 0928 20:02:57.869530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.871558 (+ 2028us) service_pool.cc:224] Handling call
0928 20:02:57.920760 (+ 49202us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:57.920834 (+ 74us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.260465 (+339631us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.390496 (+1130031us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.390885 (+ 389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.392776 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 95dfce3de1374f7a8c02c6898f6a741c (DEFAULT_TABLE table=default.Table_f9542fb9d4054fec841718053fedb559 [id=4d41cf8ff46f412b8c28cfd2279268e8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:59.228436 26738 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 198542us
I20260928 20:02:59.331079 28309 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:59.397403 28309 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.416258 28309 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:59.417359 28319 leader_election.cc:290] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:59.419047 26493 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:59.423273 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:02:59.423594 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 4b91a573103c4c2d995abde8db91b821 (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]) successfully deleted
I20260928 20:02:59.423823 26791 raft_consensus.cc:3060] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:02:59.426077 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet db5f5f16f2d7457799e1b96a293695f4 (table default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a [id=fd3816a55b234cad88a421587951bb94]) successfully deleted
I20260928 20:02:59.430130 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed48087b59c744f9a928c8d529b69211" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:02:59.431907 26771 consensus_meta.cc:287] T b13a571f3bd34209b0e6fd9441055eb1 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.767s user 0.008s sys 0.004s
I20260928 20:02:59.432085 27900 ts_manager.cc:194] Registered new tserver with Master: b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:02:59.432953 26771 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 464) took 1147 ms. Trace:
I20260928 20:02:59.433264 26771 rpcz_store.cc:276] 0928 20:02:58.285748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.379302 (+ 93554us) service_pool.cc:224] Handling call
0928 20:02:58.380943 (+ 1641us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.381019 (+ 76us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.664880 (+283861us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.432449 (+767569us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.432885 (+ 436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.434321 26771 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.437894 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c865d2d368847dd9de688bdd65e88b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.367511 28240 raft_consensus.cc:2804] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:02:59.443064 28240 raft_consensus.cc:697] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:02:59.443859 28240 consensus_queue.cc:237] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.445185 26621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f21c71dc0e41aba85bb01c9fddc12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.451414 26623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6447b96436b34949a35f93b93732a820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.451988 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1a8c85b6bc4849b447b6fd048afb2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.453205 26913 tablet_bootstrap.cc:492] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:02:59.459374 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 366) took 6076 ms. Trace:
I20260928 20:02:59.459746 28059 rpcz_store.cc:276] 0928 20:02:53.383311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.383740 (+ 429us) service_pool.cc:224] Handling call
0928 20:02:57.798622 (+4414882us) ts_tablet_manager.cc:1197] Deleting tablet ee4c267b42754dbca8eb5ebec2d66a23
0928 20:02:57.966129 (+167507us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:58.489079 (+522950us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.029814 (+540735us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.459317 (+429503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186727,"tablet-delete.queue_time_us":4413721}
I20260928 20:02:59.460913 28059 tablet_replica.cc:333] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:02:59.462241 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c865d2d368847dd9de688bdd65e88b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:59.463900 28079 consensus_meta.cc:287] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.586s user 0.012s sys 0.000s
I20260928 20:02:59.468578 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:02:59.465541 26620 consensus_meta.cc:287] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.821s user 0.002s sys 0.008s
I20260928 20:02:59.471215 28059 raft_consensus.cc:2243] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:02:59.474800 26620 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 438) took 1408 ms. Trace:
I20260928 20:02:59.486007 26620 rpcz_store.cc:276] 0928 20:02:58.066263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.096618 (+ 30355us) service_pool.cc:224] Handling call
0928 20:02:58.107446 (+ 10828us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.107533 (+ 87us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.644642 (+537109us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.474344 (+829702us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.474740 (+ 396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.488518 26620 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d9ca77e114c4d06bde1bcd862c8eccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:59.489609 26771 tablet_service.cc:1511] Processing CreateTablet for tablet 92397ac1a63a46e591e699e76627d5db (DEFAULT_TABLE table=default.Table_c68f60885a0940f583aa139abd8a834a [id=1fd0e6f7ff6b4552b40c8d2afce48966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.458544 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 6048c2fc40cf48229c4822e6b68f9376 (DEFAULT_TABLE table=default.Table_cdb14377bf684d90ba23733f91f3a0d6 [id=f70247fb59cd4a758fd2760ce97c6c91]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:59.461539 26770 consensus_meta.cc:287] T 06f7b05e756f4a4db5031ff1e14c6ff6 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.680s user 0.002s sys 0.009s
W20260928 20:02:59.465314 26775 consensus_meta.cc:287] T 61bd0122845044fd993d166824f3b9cc P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.653s user 0.009s sys 0.000s
I20260928 20:02:59.465709 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e032f645304dbc88a895fae4bbd777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.476189 26766 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 457) took 1213 ms. Trace:
I20260928 20:02:59.500942 26766 rpcz_store.cc:276] 0928 20:02:58.262916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.264102 (+ 1186us) service_pool.cc:224] Handling call
0928 20:02:58.297723 (+ 33621us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.299243 (+ 1520us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.164968 (+865725us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.458092 (+293124us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.475668 (+ 17576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
I20260928 20:02:59.502969 26766 tablet_service.cc:1511] Processing CreateTablet for tablet c3600b2fbb574106b5b13ab837754eb3 (DEFAULT_TABLE table=default.Table_2bd98a3ca12b417aa6115a75f74e752c [id=1967b4ffcea84c8ab364a0e946e5d86b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:59.503424 26496 consensus_meta.cc:287] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.587s user 0.007s sys 0.001s
I20260928 20:02:59.480624 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.482875 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.133376 26778 tablet_service.cc:1511] Processing CreateTablet for tablet e1f21c71dc0e41aba85bb01c9fddc12d (DEFAULT_TABLE table=default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.485059 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.487715 26912 tablet_bootstrap.cc:654] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:59.483891 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.500962 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d556a7736504aa2aa2fe8f868ecf489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.506279 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95dfce3de1374f7a8c02c6898f6a741c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.506651 28319 raft_consensus.cc:493] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:02:59.507128 28319 raft_consensus.cc:515] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.509014 28319 leader_election.cc:290] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:59.503656 28298 consensus_meta.cc:287] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.758s user 0.013s sys 0.000s
I20260928 20:02:59.513377 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 8d556a7736504aa2aa2fe8f868ecf489 (DEFAULT_TABLE table=default.Table_80b7e921026a449aac1078cb8ef22d63 [id=520a43e0bc5d418a9e1e2227a8e65249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.515213 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 6048c2fc40cf48229c4822e6b68f9376 (DEFAULT_TABLE table=default.Table_cdb14377bf684d90ba23733f91f3a0d6 [id=f70247fb59cd4a758fd2760ce97c6c91]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:59.439103 26773 consensus_meta.cc:287] T 2d02292105e6430c9231f26b62befe34 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.975s user 0.014s sys 0.001s
W20260928 20:02:59.483906 26740 connection.cc:256] RPC call timeout handler was delayed by -2.038482545000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1s for a response
W20260928 20:02:59.518944 26740 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5
I20260928 20:02:59.518509 28319 raft_consensus.cc:493] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:02:59.520164 28319 raft_consensus.cc:515] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:02:59.521301 26783 consensus_meta.cc:287] T 7053ca61ed6e4f6dbf1f5adb54728792 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.849s user 0.011s sys 0.000s
I20260928 20:02:59.522359 28319 leader_election.cc:290] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:59.522589 26487 consensus_meta.cc:287] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.637s user 0.008s sys 0.002s
I20260928 20:02:59.526917 26492 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:59.527004 27857 ts_tablet_manager.cc:1962] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:59.529042 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d556a7736504aa2aa2fe8f868ecf489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.536353 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6048c2fc40cf48229c4822e6b68f9376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.537709 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3600b2fbb574106b5b13ab837754eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.506237 28306 raft_consensus.cc:493] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:02:59.477383 26791 raft_consensus.cc:2468] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:02:59.538196 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6048c2fc40cf48229c4822e6b68f9376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.560616 26771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92397ac1a63a46e591e699e76627d5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.538749 26768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 465) took 1252 ms. Trace:
I20260928 20:02:59.560877 26768 rpcz_store.cc:276] 0928 20:02:58.285995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.391339 (+105344us) service_pool.cc:224] Handling call
0928 20:02:58.392558 (+ 1219us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.392641 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.109257 (+716616us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.490717 (+381460us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.538696 (+ 47979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.561923 26768 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a31001f85b44bfcb35a29675f177b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.563100 26768 tablet_service.cc:1511] Processing CreateTablet for tablet de40520ccd9b4a52a45c4085afd45b2d (DEFAULT_TABLE table=default.Table_fcf649830b9146c692f14a80b201e631 [id=0ea190c5d5ec4c65b96626b95a638c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.564996 26766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3600b2fbb574106b5b13ab837754eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.538717 26772 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 466) took 1252 ms. Trace:
I20260928 20:02:59.539395 26770 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 462) took 1254 ms. Trace:
I20260928 20:02:59.539985 26775 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 450) took 1372 ms. Trace:
I20260928 20:02:59.570746 26770 rpcz_store.cc:276] 0928 20:02:58.285197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.326539 (+ 41342us) service_pool.cc:224] Handling call
0928 20:02:58.327818 (+ 1279us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.327889 (+ 71us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.780933 (+453044us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.499754 (+718821us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.539347 (+ 39593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.572773 26770 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1a8c85b6bc4849b447b6fd048afb2f (DEFAULT_TABLE table=default.Table_c17f6d0dcd96486ca59966415e8978de [id=8b3fd73182f14c10b4a847d1ae537630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.570745 26772 rpcz_store.cc:276] 0928 20:02:58.286299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.427360 (+141061us) service_pool.cc:224] Handling call
0928 20:02:58.428738 (+ 1378us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.428814 (+ 76us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.193007 (+764193us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.486913 (+293906us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.538662 (+ 51749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.570871 26775 rpcz_store.cc:276] 0928 20:02:58.167963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.174900 (+ 6937us) service_pool.cc:224] Handling call
0928 20:02:58.291291 (+116391us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.291356 (+ 65us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.812274 (+520918us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.500270 (+687996us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.539922 (+ 39652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.574841 26775 tablet_service.cc:1511] Processing CreateTablet for tablet eec056d6f6b0461da1f0a4525b711c8c (DEFAULT_TABLE table=default.Table_286ac19bf2c94fccacea798394d419c8 [id=b5312b25c2f3437cba1d46c88efad660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.540621 26767 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 456) took 1278 ms. Trace:
I20260928 20:02:59.576287 26767 rpcz_store.cc:276] 0928 20:02:58.262615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.276205 (+ 13590us) service_pool.cc:224] Handling call
0928 20:02:58.297221 (+ 21016us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.297322 (+ 101us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.341208 (+1043886us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.477554 (+136346us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.540566 (+ 63012us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:02:59.576879 26765 consensus_meta.cc:287] T 210183ea66e349d0b8ef63c0964ca0c8 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.515s user 0.009s sys 0.004s
I20260928 20:02:59.541802 26783 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 459) took 1265 ms. Trace:
I20260928 20:02:59.539355 26780 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 467) took 1252 ms. Trace:
I20260928 20:02:59.578228 26783 rpcz_store.cc:276] 0928 20:02:58.276571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.282722 (+ 6151us) service_pool.cc:224] Handling call
0928 20:02:58.289972 (+ 7250us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.290049 (+ 77us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.672063 (+382014us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.521688 (+849625us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.541704 (+ 20016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.543519 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.595077 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 22e032f645304dbc88a895fae4bbd777 (DEFAULT_TABLE table=default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.596095 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e032f645304dbc88a895fae4bbd777. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:59.523557 26632 consensus_meta.cc:287] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.554s user 0.007s sys 0.000s
I20260928 20:02:59.538707 28059 pending_rounds.cc:70] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:02:59.598968 28059 pending_rounds.cc:77] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403159805186048 op_type: NO_OP noop_request { }
I20260928 20:02:59.599334 28059 raft_consensus.cc:2889] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:02:59.599658 28059 raft_consensus.cc:2272] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:02:59.611032 26631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 444) took 1167 ms. Trace:
I20260928 20:02:59.543785 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:02:59.637458 26777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 469) took 1298 ms. Trace:
I20260928 20:02:59.643047 26777 rpcz_store.cc:276] 0928 20:02:58.338971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.158610 (+819639us) service_pool.cc:224] Handling call
0928 20:02:59.165880 (+ 7270us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.165964 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.560186 (+394222us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.616596 (+ 56410us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.637403 (+ 20807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.646533 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet de40520ccd9b4a52a45c4085afd45b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.661391 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 92397ac1a63a46e591e699e76627d5db (DEFAULT_TABLE table=default.Table_c68f60885a0940f583aa139abd8a834a [id=1fd0e6f7ff6b4552b40c8d2afce48966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.662541 26781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 474) took 1319 ms. Trace:
I20260928 20:02:59.663477 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92397ac1a63a46e591e699e76627d5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.553524 26773 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 453) took 1306 ms. Trace:
I20260928 20:02:59.662858 26781 rpcz_store.cc:276] 0928 20:02:58.542246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.369851 (+827605us) service_pool.cc:224] Handling call
0928 20:02:59.537780 (+167929us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.537863 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.569620 (+ 31757us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.622669 (+ 53049us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.662479 (+ 39810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105088}
I20260928 20:02:59.665221 26773 rpcz_store.cc:276] 0928 20:02:58.247176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.248178 (+ 1002us) service_pool.cc:224] Handling call
0928 20:02:58.299410 (+ 51232us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.299482 (+ 72us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.464110 (+164628us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.517189 (+1053079us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.553453 (+ 36264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.666321 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 0b42615f62284e359cdc1f4c9cc715c5 (DEFAULT_TABLE table=default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.667248 26773 tablet_service.cc:1511] Processing CreateTablet for tablet 029a15ae85ff48d897493156fdd41d3b (DEFAULT_TABLE table=default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.556651 26784 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 454) took 1294 ms. Trace:
I20260928 20:02:59.570360 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f21c71dc0e41aba85bb01c9fddc12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.578140 26776 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 473) took 1237 ms. Trace:
I20260928 20:02:59.579826 26774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 477) took 1036 ms. Trace:
I20260928 20:02:59.673427 26774 rpcz_store.cc:276] 0928 20:02:58.543265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.381609 (+838344us) service_pool.cc:224] Handling call
0928 20:02:59.382762 (+ 1153us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.382831 (+ 69us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.524307 (+141476us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.569590 (+ 45283us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.579754 (+ 10164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.636703 26767 tablet_service.cc:1558] Processing DeleteTablet for tablet 23d262c7a15b434d8caea0a818323dd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.673354 26776 rpcz_store.cc:276] 0928 20:02:58.341963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.052920 (+710957us) service_pool.cc:224] Handling call
0928 20:02:59.390427 (+337507us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.390497 (+ 70us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.516063 (+125566us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.566702 (+ 50639us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.577984 (+ 11282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.674890 26774 tablet_service.cc:1511] Processing CreateTablet for tablet aaae231bea404219875c82340c09df2b (DEFAULT_TABLE table=default.Table_b535172c333e41bba212d17bbb3a0a13 [id=5c5d5de98b4047919b9ded842e422341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.675940 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5ef01e0dbd49398b27911a713626cd (DEFAULT_TABLE table=default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.604534 28030 ts_tablet_manager.cc:1975] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:02:59.578264 26780 rpcz_store.cc:276] 0928 20:02:58.286561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.531335 (+244774us) service_pool.cc:224] Handling call
0928 20:02:58.827699 (+296364us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.827782 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.117500 (+289718us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.490776 (+373276us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.539306 (+ 48530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.674276 26784 rpcz_store.cc:276] 0928 20:02:58.261907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.263124 (+ 1217us) service_pool.cc:224] Handling call
0928 20:02:58.296582 (+ 33458us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.296666 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.975251 (+678585us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.441932 (+466681us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.556591 (+114659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.676826 28030 log.cc:1199] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/775b9a076bf048bea39423d3554babf7
I20260928 20:02:59.548004 26633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 441) took 1284 ms. Trace:
I20260928 20:02:59.677561 28030 ts_tablet_manager.cc:1996] T 775b9a076bf048bea39423d3554babf7 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:02:59.677507 26780 tablet_service.cc:1511] Processing CreateTablet for tablet b31777af7102483fbcaab35a47d27852 (DEFAULT_TABLE table=default.Table_2a6a2e75f86f4344ba5d2e495190619b [id=e5a58b48db114aa29aca24eec47130d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.677572 26633 rpcz_store.cc:276] 0928 20:02:58.262750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.379532 (+116782us) service_pool.cc:224] Handling call
0928 20:02:58.478319 (+ 98787us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.478399 (+ 80us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.237102 (+758703us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.493771 (+256669us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.547158 (+ 53387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.679229 26772 tablet_service.cc:1511] Processing CreateTablet for tablet 807f3ef3db0f4319801baf86a331b98d (DEFAULT_TABLE table=default.Table_c628c1a16db34a3fbc9c818e95ad5f7a [id=65d9b7804d5e4d008d31a84cccc3458f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.679518 26912 tablet_bootstrap.cc:492] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:02:59.679992 26912 ts_tablet_manager.cc:1449] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.541s user 0.012s sys 0.004s
I20260928 20:02:59.680395 26783 tablet_service.cc:1511] Processing CreateTablet for tablet f376f270145e44b3acb4b8b2437cba33 (DEFAULT_TABLE table=default.Table_e81ad7e3711e4f25a6051f1ce257d20a [id=3da22346865f4613910dedb2fad45dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.687137 26637 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 446) took 1183 ms. Trace:
I20260928 20:02:59.687577 26637 rpcz_store.cc:276] 0928 20:02:58.503982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.505256 (+ 1274us) service_pool.cc:224] Handling call
0928 20:02:58.791034 (+285778us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.791107 (+ 73us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.486771 (+695664us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.686598 (+199827us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.687074 (+ 476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.689181 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 6048c2fc40cf48229c4822e6b68f9376 (DEFAULT_TABLE table=default.Table_cdb14377bf684d90ba23733f91f3a0d6 [id=f70247fb59cd4a758fd2760ce97c6c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.690232 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6048c2fc40cf48229c4822e6b68f9376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.703421 28306 raft_consensus.cc:515] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:02:59.728387 26639 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 445) took 1246 ms. Trace:
I20260928 20:02:59.728770 26639 rpcz_store.cc:276] 0928 20:02:58.482069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.495923 (+ 13854us) service_pool.cc:224] Handling call
0928 20:02:58.501998 (+ 6075us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.502064 (+ 66us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.559728 (+1057664us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.688792 (+129064us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.728333 (+ 39541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471808}
I20260928 20:02:59.729238 26634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 457) took 1038 ms. Trace:
I20260928 20:02:59.729687 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:59.730226 26636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 470) took 1036 ms. Trace:
I20260928 20:02:59.728489 26632 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 443) took 1356 ms. Trace:
I20260928 20:02:59.730610 26636 rpcz_store.cc:276] 0928 20:02:58.694014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.981767 (+287753us) service_pool.cc:224] Handling call
0928 20:02:59.451098 (+469331us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.451193 (+ 95us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.543086 (+ 91893us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.618893 (+ 75807us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.729964 (+111071us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34949}
I20260928 20:02:59.730753 26632 rpcz_store.cc:276] 0928 20:02:58.371721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.389552 (+ 17831us) service_pool.cc:224] Handling call
0928 20:02:58.396284 (+ 6732us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.396362 (+ 78us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.968846 (+572484us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.693204 (+724358us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.728444 (+ 35240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34845}
I20260928 20:02:59.731637 26632 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a31001f85b44bfcb35a29675f177b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:59.732074 26636 tablet_service.cc:1511] Processing CreateTablet for tablet c3600b2fbb574106b5b13ab837754eb3 (DEFAULT_TABLE table=default.Table_2bd98a3ca12b417aa6115a75f74e752c [id=1967b4ffcea84c8ab364a0e946e5d86b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.734922 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 95dfce3de1374f7a8c02c6898f6a741c (DEFAULT_TABLE table=default.Table_f9542fb9d4054fec841718053fedb559 [id=4d41cf8ff46f412b8c28cfd2279268e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.740065 28059 ts_tablet_manager.cc:1962] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:02:59.466012 28079 raft_consensus.cc:515] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.748116 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 22e032f645304dbc88a895fae4bbd777 (DEFAULT_TABLE table=default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.599112 28298 raft_consensus.cc:515] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.710457 26627 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:59.765141 28298 leader_election.cc:290] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:02:59.733392 28327 raft_consensus.cc:493] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:02:59.765856 28327 raft_consensus.cc:515] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.781453 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 8d556a7736504aa2aa2fe8f868ecf489 (DEFAULT_TABLE table=default.Table_80b7e921026a449aac1078cb8ef22d63 [id=520a43e0bc5d418a9e1e2227a8e65249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.611379 26631 rpcz_store.cc:276] 0928 20:02:58.444104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.447597 (+ 3493us) service_pool.cc:224] Handling call
0928 20:02:58.448746 (+ 1149us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.448831 (+ 85us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.524698 (+1075867us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.563016 (+ 38318us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.610975 (+ 47959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.788122 26631 tablet_service.cc:1511] Processing CreateTablet for tablet de40520ccd9b4a52a45c4085afd45b2d (DEFAULT_TABLE table=default.Table_fcf649830b9146c692f14a80b201e631 [id=0ea190c5d5ec4c65b96626b95a638c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.793386 26595 leader_election.cc:304] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:02:59.579614 26638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 442) took 1239 ms. Trace:
I20260928 20:02:59.798182 26638 rpcz_store.cc:276] 0928 20:02:58.340093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.380435 (+ 40342us) service_pool.cc:224] Handling call
0928 20:02:58.381753 (+ 1318us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.381837 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.494802 (+1112965us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.525264 (+ 30462us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.579559 (+ 54295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.799674 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3600b2fbb574106b5b13ab837754eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.800431 26638 tablet_service.cc:1511] Processing CreateTablet for tablet eec056d6f6b0461da1f0a4525b711c8c (DEFAULT_TABLE table=default.Table_286ac19bf2c94fccacea798394d419c8 [id=b5312b25c2f3437cba1d46c88efad660]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:02:59.827162 26451 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 78640.9us
I20260928 20:02:59.840814 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 9bce47a5ab1a44989abe1761cab0c714 (DEFAULT_TABLE table=default.Table_1a915ed0be934873a38f26d9661704fe [id=3ea7cdba6c2c4775aa2404a40482f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.801301 26770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1a8c85b6bc4849b447b6fd048afb2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.856952 26767 tablet_service.cc:1511] Processing CreateTablet for tablet 44f337138bc84030a3edf1ec1248d456 (DEFAULT_TABLE table=default.Table_faf293f941b845a992e4a5bc2f0d8e97 [id=00b3eb91544b41a1ab2a3b09f4f003ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.864028 28321 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:59.862460 28303 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:02:59.875725 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.879379 26485 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 441) took 1688 ms. Trace:
I20260928 20:02:59.882018 26485 rpcz_store.cc:276] 0928 20:02:58.191410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.191519 (+ 109us) service_pool.cc:224] Handling call
0928 20:02:58.606389 (+414870us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.606531 (+ 142us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.634082 (+ 27551us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.438657 (+804575us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.879040 (+440383us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866f33e 00007f65515e83b9 00007f65507f8ce1 00007f65508bf57b 00007f65508bb16f 00007f65508bb92d 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82
0928 20:02:59.879310 (+ 270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189636992}
I20260928 20:02:59.887691 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a31001f85b44bfcb35a29675f177b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:02:59.891098 26912 raft_consensus.cc:359] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.891947 26912 raft_consensus.cc:385] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:02:59.892225 26912 raft_consensus.cc:740] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:02:59.897785 26912 consensus_queue.cc:260] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:02:59.905015 26485 tablet_service.cc:1511] Processing CreateTablet for tablet 95dfce3de1374f7a8c02c6898f6a741c (DEFAULT_TABLE table=default.Table_f9542fb9d4054fec841718053fedb559 [id=4d41cf8ff46f412b8c28cfd2279268e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.906180 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95dfce3de1374f7a8c02c6898f6a741c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:02:59.907287 26769 consensus_meta.cc:287] T 158ddf1201784a93ada93e629befa030 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.831s user 0.001s sys 0.010s
W20260928 20:02:59.914806 26482 consensus_meta.cc:287] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 1.035s user 0.012s sys 0.010s
I20260928 20:02:59.915755 26482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 459) took 1044 ms. Trace:
I20260928 20:02:59.916132 26482 rpcz_store.cc:276] 0928 20:02:58.870993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.871093 (+ 100us) service_pool.cc:224] Handling call
0928 20:02:58.872810 (+ 1717us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.872880 (+ 70us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.879929 (+ 7049us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.915334 (+1035405us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.915705 (+ 371us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:02:59.919171 26478 consensus_meta.cc:287] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 1.058s user 0.007s sys 0.012s
I20260928 20:02:59.920150 26478 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 453) took 1197 ms. Trace:
I20260928 20:02:59.920517 26478 rpcz_store.cc:276] 0928 20:02:58.724406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.742185 (+ 17779us) service_pool.cc:224] Handling call
0928 20:02:58.745310 (+ 3125us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.745388 (+ 78us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.861104 (+115716us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.919685 (+1058581us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.920094 (+ 409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.922168 26478 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1a8c85b6bc4849b447b6fd048afb2f (DEFAULT_TABLE table=default.Table_c17f6d0dcd96486ca59966415e8978de [id=8b3fd73182f14c10b4a847d1ae537630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.916879 26768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de40520ccd9b4a52a45c4085afd45b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.935133 26912 ts_tablet_manager.cc:1480] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.255s user 0.007s sys 0.000s
I20260928 20:02:59.978690 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:02:59.980554 26630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 447) took 1453 ms. Trace:
I20260928 20:02:59.980983 26630 rpcz_store.cc:276] 0928 20:02:58.528289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.529391 (+ 1102us) service_pool.cc:224] Handling call
0928 20:02:58.738695 (+209304us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.738770 (+ 75us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.535040 (+796270us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.980059 (+445019us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.980497 (+ 438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.982476 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 9bce47a5ab1a44989abe1761cab0c714 (DEFAULT_TABLE table=default.Table_1a915ed0be934873a38f26d9661704fe [id=3ea7cdba6c2c4775aa2404a40482f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:02:59.729529 26634 rpcz_store.cc:276] 0928 20:02:58.690943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.373094 (+682151us) service_pool.cc:224] Handling call
0928 20:02:59.461808 (+ 88714us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.461894 (+ 86us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.554558 (+ 92664us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.728828 (+174270us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.729179 (+ 351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408}
I20260928 20:02:59.985946 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 23d262c7a15b434d8caea0a818323dd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:02:59.994664 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b42615f62284e359cdc1f4c9cc715c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.994664 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bce47a5ab1a44989abe1761cab0c714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:02:59.995373 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec056d6f6b0461da1f0a4525b711c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.002694 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet ba87a379ae6a4feabfbc9fd6ba2d488e (table default.Table_841f8694539d49ad85dd21d2f74da8f7 [id=785cc43f9b7d4d02aa025ab9ec645ce1]) successfully deleted
W20260928 20:03:00.004362 26223 catalog_manager.cc:5043] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet b97ad3f841f54aa38bbb312c50db384e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97ad3f841f54aa38bbb312c50db384e already in progress: creating tablet
I20260928 20:03:00.005038 28047 raft_consensus.cc:493] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.007948 28047 raft_consensus.cc:515] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.009915 28047 leader_election.cc:290] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:00.011016 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet fa49943f465f47778ac985cb5f4e6c0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:03:00.012115 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 8536f4a4a0904806b71d4e7bf20c6bce (DEFAULT_TABLE table=default.Table_a343f55509fc4555836efe7503996740 [id=569aa44462c74840b9cd56304974e74e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.026981 26478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1a8c85b6bc4849b447b6fd048afb2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.028142 26635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 449) took 1442 ms. Trace:
I20260928 20:02:59.928200 26916 tablet_bootstrap.cc:654] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:02:59.936550 28344 tablet.cc:1751] T 8147a650aa614b2fb0af08077e60ddc8 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:02:59.955513 26487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 456) took 1229 ms. Trace:
W20260928 20:03:00.030853 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 237550us
I20260928 20:03:00.030730 26487 rpcz_store.cc:276] 0928 20:02:58.725619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.725773 (+ 154us) service_pool.cc:224] Handling call
0928 20:02:58.727452 (+ 1679us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.727530 (+ 78us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.885846 (+158316us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.593696 (+707850us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:59.955454 (+361758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.032519 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 807f3ef3db0f4319801baf86a331b98d (DEFAULT_TABLE table=default.Table_c628c1a16db34a3fbc9c818e95ad5f7a [id=65d9b7804d5e4d008d31a84cccc3458f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.033560 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807f3ef3db0f4319801baf86a331b98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.028644 26635 rpcz_store.cc:276] 0928 20:02:58.585314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.714728 (+129414us) service_pool.cc:224] Handling call
0928 20:02:58.893840 (+179112us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.893924 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.510409 (+616485us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.993283 (+482874us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.028079 (+ 34796us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.042634 26782 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 480) took 1498 ms. Trace:
I20260928 20:03:00.043032 26782 rpcz_store.cc:276] 0928 20:02:58.543942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.392118 (+848176us) service_pool.cc:224] Handling call
0928 20:02:59.393421 (+ 1303us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.393515 (+ 94us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.632679 (+239164us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.705490 (+ 72811us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.042247 (+336757us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf98311d2 00007f0d027aa379 00007f0d019bac18 00007f0d01a813d3 00007f0d01a7d16f 00007f0d01a7d92d 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82
0928 20:03:00.042569 (+ 322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560374528}
I20260928 20:03:00.043982 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5ef01e0dbd49398b27911a713626cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.045070 26782 tablet_service.cc:1511] Processing CreateTablet for tablet faefa3535ee54987b76cc6782b988c90 (DEFAULT_TABLE table=default.Table_c909970e41b44433885b634d80002868 [id=2e3160a2ecb54b22a2a543498ec403b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.045711 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 360) took 7405 ms. Trace:
I20260928 20:03:00.046001 28030 rpcz_store.cc:276] 0928 20:02:52.640396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.640480 (+ 84us) service_pool.cc:224] Handling call
0928 20:02:58.293111 (+5652631us) ts_tablet_manager.cc:1197] Deleting tablet 775b9a076bf048bea39423d3554babf7
0928 20:02:58.293164 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:58.997241 (+704077us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.604410 (+607169us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.044215 (+439805us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf98311d2 00007f0d027aa379 00007f0d019bac18 00007f0d01a821b2 00007f0d01ab4080 00007f0d01a9a4ad 00007f0d01a9a459 00007f0d01a9a3e9 00007f0d01a9a3b1
0928 20:03:00.045656 (+ 1441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4778,"spinlock_wait_cycles":838184192,"tablet-delete.queue_time_us":5652178}
I20260928 20:03:00.047351 28030 tablet_replica.cc:333] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:00.048348 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefa3535ee54987b76cc6782b988c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.048974 26767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f337138bc84030a3edf1ec1248d456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.050514 28030 raft_consensus.cc:2243] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:00.050634 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bce47a5ab1a44989abe1761cab0c714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.051301 26772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807f3ef3db0f4319801baf86a331b98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.054538 28030 raft_consensus.cc:2272] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:00.055672 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaae231bea404219875c82340c09df2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.061692 28030 ts_tablet_manager.cc:1962] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:00.065423 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31777af7102483fbcaab35a47d27852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.066582 26769 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 463) took 1781 ms. Trace:
I20260928 20:03:00.066931 26769 rpcz_store.cc:276] 0928 20:02:58.285497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.375052 (+ 89555us) service_pool.cc:224] Handling call
0928 20:02:58.376247 (+ 1195us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.376344 (+ 97us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.075655 (+699311us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.907777 (+832122us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.066270 (+158493us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf98311d2 00007f0d027aa379 00007f0d019bac18 00007f0d01a813d3 00007f0d01a7d16f 00007f0d01a7d92d 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82
0928 20:03:00.066526 (+ 256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319499008}
I20260928 20:03:00.068543 26769 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf943cffdd440caa2978769faed7f2c (DEFAULT_TABLE table=default.Table_39e9fc84df3844129902f8bb568244e2 [id=43ecf4974c7f4dc7a1ebcb5091d78076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.074180 26912 tablet_bootstrap.cc:492] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:00.078938 26765 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 458) took 1815 ms. Trace:
I20260928 20:03:00.079357 26765 rpcz_store.cc:276] 0928 20:02:58.263941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.271382 (+ 7441us) service_pool.cc:224] Handling call
0928 20:02:58.296864 (+ 25482us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.296964 (+ 100us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.061292 (+764328us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.853037 (+791745us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.078650 (+225613us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf98311d2 00007f0d027aa379 00007f0d019bac18 00007f0d01a813d3 00007f0d01a7d16f 00007f0d01a7d92d 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82
0928 20:03:00.078884 (+ 234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366774144}
I20260928 20:03:00.081089 26765 tablet_service.cc:1511] Processing CreateTablet for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a (DEFAULT_TABLE table=default.Table_18c37f8dfcdb47169eb7230ea02b7b2a [id=03435de0a7f1414ca9387b9a6695e4a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.069964 26769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf943cffdd440caa2978769faed7f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.086652 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f376f270145e44b3acb4b8b2437cba33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.098945 26771 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 476) took 1555 ms. Trace:
W20260928 20:03:00.099610 26481 consensus_meta.cc:287] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.512s user 0.007s sys 0.005s
I20260928 20:03:00.099375 26771 rpcz_store.cc:276] 0928 20:02:58.543022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.488931 (+945909us) service_pool.cc:224] Handling call
0928 20:02:59.541386 (+ 52455us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.541487 (+ 101us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.909590 (+368103us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.938406 (+ 28816us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.098559 (+160153us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf98311d2 00007f0d027aa379 00007f0d019bac18 00007f0d01a813d3 00007f0d01a7d16f 00007f0d01a7d92d 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82
0928 20:03:00.098838 (+ 279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237847424}
I20260928 20:03:00.100708 26771 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:03:00.102077 26771 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6d3f0467684127af0fcaa3ddac3fdd (DEFAULT_TABLE table=default.Table_66f34d73b85d4af58844cc7ea97a7866 [id=7915573b0b384fb693d6bdafe1bb095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.110985 28327 leader_election.cc:290] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:00.111471 28327 raft_consensus.cc:493] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.111840 28327 raft_consensus.cc:515] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.113685 28327 leader_election.cc:290] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:02:59.934091 26477 consensus_meta.cc:287] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.699s user 0.007s sys 0.000s
I20260928 20:02:59.896128 26475 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:36252 (request call id 59) took 3162 ms. Trace:
I20260928 20:03:00.118251 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec056d6f6b0461da1f0a4525b711c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.118306 26475 rpcz_store.cc:276] 0928 20:02:56.733197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.734440 (+ 1243us) service_pool.cc:224] Handling call
0928 20:02:57.021348 (+286908us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b54000c6cd4. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654f773b01 00007f654f804788 00007f6550878cfd 00007f654efc5104 00007f654efc5092 00007f654efc4fc1 00007f654efc4f3c 00007f654efc41f2 00007f654d4d915c 00007f654d4d8596 00007f654d4d7f3f
0928 20:02:59.895878 (+2874530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8703232}
I20260928 20:03:00.117861 26477 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 462) took 1203 ms. Trace:
I20260928 20:03:00.122219 26477 rpcz_store.cc:276] 0928 20:02:58.914763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.914952 (+ 189us) service_pool.cc:224] Handling call
0928 20:02:58.923144 (+ 8192us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866ea52 00007f65515bf1c9 00007f65507f8d70 00007f65508df521 00007f65508bb523 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82 00007f654edf0ab1
0928 20:02:58.924141 (+ 997us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.924233 (+ 92us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.234763 (+310530us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.117324 (+882561us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.117805 (+ 481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7809280}
I20260928 20:03:00.124004 26477 tablet_service.cc:1511] Processing CreateTablet for tablet eec056d6f6b0461da1f0a4525b711c8c (DEFAULT_TABLE table=default.Table_286ac19bf2c94fccacea798394d419c8 [id=b5312b25c2f3437cba1d46c88efad660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.125039 26477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec056d6f6b0461da1f0a4525b711c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.135540 26620 tablet_service.cc:1511] Processing CreateTablet for tablet 029a15ae85ff48d897493156fdd41d3b (DEFAULT_TABLE table=default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.012892 26491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 461) took 1098 ms. Trace:
I20260928 20:02:59.963261 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:00.162389 26511 raft_consensus.cc:2468] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:00.163513 26491 rpcz_store.cc:276] 0928 20:02:58.914449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.925941 (+ 11492us) service_pool.cc:224] Handling call
0928 20:02:58.990952 (+ 65011us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.991027 (+ 75us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.315737 (+324710us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:59.779051 (+463314us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.012820 (+233769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.170331 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 23d262c7a15b434d8caea0a818323dd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:03:00.188239 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet f478cce587a548e1aab620721c3bb1c1 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]) successfully deleted
W20260928 20:03:00.200364 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e1d6dcd913394d4ca2e4b9f5be5ea069 consensus state has no leader
I20260928 20:03:00.220429 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet de40520ccd9b4a52a45c4085afd45b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:03:00.102365 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:00.102965 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029a15ae85ff48d897493156fdd41d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.115883 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:00.128738 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 2034cd490bd14992aa2572f31d2ff63b (DEFAULT_TABLE table=default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.227226 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2034cd490bd14992aa2572f31d2ff63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.228868 26765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.230717 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8536f4a4a0904806b71d4e7bf20c6bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.239995 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 01533b61bad74ddb9056aeacef13a126 (table default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]) successfully deleted
I20260928 20:03:00.183280 26779 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 470) took 1844 ms. Trace:
I20260928 20:03:00.190157 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:00.210218 28047 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:00.224649 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:00.255415 28047 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:03:00.146368 26489 consensus_meta.cc:287] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 1.136s user 0.009s sys 0.008s
I20260928 20:03:00.257035 26489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 439) took 2119 ms. Trace:
I20260928 20:03:00.257361 28047 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.257362 26489 rpcz_store.cc:276] 0928 20:02:58.137994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.181266 (+ 43272us) service_pool.cc:224] Handling call
0928 20:02:58.590619 (+409353us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.590748 (+ 129us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.905882 (+315134us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.256518 (+1350636us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.256952 (+ 434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.257855 26799 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
W20260928 20:03:00.110991 26479 consensus_meta.cc:287] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.892s user 0.010s sys 0.004s
I20260928 20:03:00.125938 26481 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 454) took 1401 ms. Trace:
I20260928 20:03:00.259079 26481 rpcz_store.cc:276] 0928 20:02:58.724920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.750331 (+ 25411us) service_pool.cc:224] Handling call
0928 20:02:58.751581 (+ 1250us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.751661 (+ 80us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.587065 (+835404us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.125514 (+538449us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.125887 (+ 373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:02:59.997138 26482 tablet_service.cc:1511] Processing CreateTablet for tablet de40520ccd9b4a52a45c4085afd45b2d (DEFAULT_TABLE table=default.Table_fcf649830b9146c692f14a80b201e631 [id=0ea190c5d5ec4c65b96626b95a638c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.260301 26779 rpcz_store.cc:276] 0928 20:02:58.339229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.187620 (+848391us) service_pool.cc:224] Handling call
0928 20:02:59.346674 (+159054us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.346771 (+ 97us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.608568 (+261797us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.012314 (+403746us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.182962 (+170648us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf98311d2 00007f0d027aa379 00007f0d019bac18 00007f0d01a813d3 00007f0d01a7d16f 00007f0d01a7d92d 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82
0928 20:03:00.183215 (+ 253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342099328}
I20260928 20:03:00.262245 26779 tablet_service.cc:1558] Processing DeleteTablet for tablet ed48087b59c744f9a928c8d529b69211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:59 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:03:00.263530 26489 tablet_service.cc:1511] Processing CreateTablet for tablet f376f270145e44b3acb4b8b2437cba33 (DEFAULT_TABLE table=default.Table_e81ad7e3711e4f25a6051f1ce257d20a [id=3da22346865f4613910dedb2fad45dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.264586 26481 tablet_service.cc:1511] Processing CreateTablet for tablet 029a15ae85ff48d897493156fdd41d3b (DEFAULT_TABLE table=default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.264856 26779 tablet_service.cc:1511] Processing CreateTablet for tablet cc643a95793d4797afb8889fcb54ef41 (DEFAULT_TABLE table=default.Table_92cd775d03ce43259e1527778a376855 [id=3bc1c712116e4b1bae264afc0f8030ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.265859 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc643a95793d4797afb8889fcb54ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.233560 26916 tablet_bootstrap.cc:492] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:03:00.275682 26486 consensus_meta.cc:287] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 1.403s user 0.017s sys 0.005s
I20260928 20:03:00.275703 26916 ts_tablet_manager.cc:1449] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 1.173s user 0.009s sys 0.007s
I20260928 20:03:00.266557 26479 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 463) took 1257 ms. Trace:
I20260928 20:03:00.278604 28303 raft_consensus.cc:493] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.278321 26479 rpcz_store.cc:276] 0928 20:02:59.009469 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.009637 (+ 168us) service_pool.cc:224] Handling call
0928 20:02:59.021094 (+ 11457us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.021172 (+ 78us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.101822 (+ 80650us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.258819 (+1156997us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.266483 (+ 7664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.279101 28303 raft_consensus.cc:515] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:00.280081 26479 tablet_service.cc:1511] Processing CreateTablet for tablet aaae231bea404219875c82340c09df2b (DEFAULT_TABLE table=default.Table_b535172c333e41bba212d17bbb3a0a13 [id=5c5d5de98b4047919b9ded842e422341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.280865 28303 leader_election.cc:290] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.281687 28303 raft_consensus.cc:493] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.282440 26771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6d3f0467684127af0fcaa3ddac3fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.282049 28303 raft_consensus.cc:515] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.283829 28303 leader_election.cc:290] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.284787 28303 raft_consensus.cc:493] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.285256 28303 raft_consensus.cc:515] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:00.222339 26484 consensus_meta.cc:287] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 1.351s user 0.017s sys 0.004s
I20260928 20:03:00.265734 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 0b42615f62284e359cdc1f4c9cc715c5 (DEFAULT_TABLE table=default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.287350 26484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 442) took 2087 ms. Trace:
I20260928 20:03:00.287513 28321 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.287914 28321 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.287894 26484 rpcz_store.cc:276] 0928 20:02:58.199738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.437084 (+237346us) service_pool.cc:224] Handling call
0928 20:02:58.617560 (+180476us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.617671 (+ 111us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.871423 (+253752us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.286920 (+1415497us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.287295 (+ 375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.289484 26484 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5ef01e0dbd49398b27911a713626cd (DEFAULT_TABLE table=default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.289762 28321 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.290673 28321 raft_consensus.cc:493] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.291071 28321 raft_consensus.cc:515] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.292812 28321 leader_election.cc:290] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.295086 28321 raft_consensus.cc:493] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.297647 26494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 464) took 1270 ms. Trace:
I20260928 20:03:00.295532 28321 raft_consensus.cc:515] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:00.301134 28321 leader_election.cc:290] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.304229 28321 raft_consensus.cc:493] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.305099 28321 raft_consensus.cc:515] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.303120 28303 leader_election.cc:290] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.312963 28303 raft_consensus.cc:493] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.313536 28303 raft_consensus.cc:515] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:00.325239 28321 leader_election.cc:290] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.332207 28047 raft_consensus.cc:493] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:00.332768 28047 raft_consensus.cc:515] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:00.334822 28047 leader_election.cc:290] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.161588 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95dfce3de1374f7a8c02c6898f6a741c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.164079 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet de40520ccd9b4a52a45c4085afd45b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:03:00.166168 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 0b42615f62284e359cdc1f4c9cc715c5 (DEFAULT_TABLE table=default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.170516 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.151528 28298 raft_consensus.cc:2749] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:00.336671 28321 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.347595 28353 raft_consensus.cc:493] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.188377 28079 leader_election.cc:290] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:00.189059 26627 tablet_service.cc:1511] Processing CreateTablet for tablet 807f3ef3db0f4319801baf86a331b98d (DEFAULT_TABLE table=default.Table_c628c1a16db34a3fbc9c818e95ad5f7a [id=65d9b7804d5e4d008d31a84cccc3458f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.190968 26913 tablet_bootstrap.cc:654] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:00.191392 28306 leader_election.cc:290] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:00.343231 26916 raft_consensus.cc:359] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.364554 28357 raft_consensus.cc:493] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.365037 28357 raft_consensus.cc:515] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:00.357023 26916 raft_consensus.cc:385] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:00.344790 28321 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.366916 28357 leader_election.cc:290] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.367532 28357 raft_consensus.cc:493] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.368212 28357 raft_consensus.cc:515] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.356149 28354 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:02:59.965342 26488 consensus_meta.cc:287] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 1.315s user 0.005s sys 0.014s
I20260928 20:03:00.342713 28303 leader_election.cc:290] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.377017 28303 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.372190 28357 leader_election.cc:290] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.378316 28303 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.380620 28047 raft_consensus.cc:493] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:00.381109 28047 raft_consensus.cc:515] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:00.380098 28357 raft_consensus.cc:493] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.375378 28354 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.383862 28047 leader_election.cc:290] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.365396 28353 raft_consensus.cc:515] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.387370 26486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 445) took 1833 ms. Trace:
I20260928 20:03:00.387797 26486 rpcz_store.cc:276] 0928 20:02:58.554064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.555607 (+ 1543us) service_pool.cc:224] Handling call
0928 20:02:58.618195 (+ 62588us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.618300 (+ 105us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.775547 (+157247us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.276144 (+1500597us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.387303 (+111159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.390872 28354 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.391352 28354 raft_consensus.cc:493] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.391815 28354 raft_consensus.cc:515] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:00.393483 28354 leader_election.cc:290] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.394759 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94aed8337bb4b20b7977e91640c6710" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:00.414426 26516 raft_consensus.cc:3060] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:00.396404 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:00.396466 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:00.399753 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:00.418735 26739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:00.419392 28344 tablet.cc:1751] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:00.422549 26510 raft_consensus.cc:2468] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:00.424718 26516 raft_consensus.cc:2468] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:00.400570 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f376f270145e44b3acb4b8b2437cba33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.383226 28357 raft_consensus.cc:515] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.383531 28303 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.408834 28321 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.369606 26916 raft_consensus.cc:740] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:00.431191 26916 consensus_queue.cc:260] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:00.272539 26492 consensus_meta.cc:287] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.556s user 0.008s sys 0.000s
I20260928 20:03:00.463449 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:00.348423 26490 consensus_meta.cc:287] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.626s user 0.006s sys 0.001s
I20260928 20:03:00.430521 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:00.470939 26492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 472) took 1271 ms. Trace:
I20260928 20:03:00.479655 26514 raft_consensus.cc:2468] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:00.480157 26916 ts_tablet_manager.cc:1480] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.203s user 0.003s sys 0.005s
I20260928 20:03:00.481014 26916 tablet_bootstrap.cc:492] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:00.477545 26492 rpcz_store.cc:276] 0928 20:02:59.199460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.588382 (+388922us) service_pool.cc:224] Handling call
0928 20:02:59.595681 (+ 7299us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.595765 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.716570 (+120805us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.441676 (+725106us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.470863 (+ 29187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.389814 26486 tablet_service.cc:1511] Processing CreateTablet for tablet b31777af7102483fbcaab35a47d27852 (DEFAULT_TABLE table=default.Table_2a6a2e75f86f4344ba5d2e495190619b [id=e5a58b48db114aa29aca24eec47130d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:03:00.482012 26450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:00.483736 26450 leader_election.cc:304] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:00.484982 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 9bce47a5ab1a44989abe1761cab0c714 (DEFAULT_TABLE table=default.Table_1a915ed0be934873a38f26d9661704fe [id=3ea7cdba6c2c4775aa2404a40482f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.486127 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:00.495503 26450 leader_election.cc:343] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:00.497051 26450 leader_election.cc:343] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:00.498140 26450 leader_election.cc:343] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:00.504998 26450 leader_election.cc:343] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:00.507929 26450 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:00.486003 26481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029a15ae85ff48d897493156fdd41d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.469419 26488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 444) took 1942 ms. Trace:
I20260928 20:03:00.513885 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:00.514506 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 775b9a076bf048bea39423d3554babf7 (table default.Table_ed4d8f2b4bb64cea9e36c503d7461bd3 [id=aa74ea94d2d2492d9976dddc11d87344]) successfully deleted
W20260928 20:03:00.519421 26450 leader_election.cc:343] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:00.525957 28353 leader_election.cc:290] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:03:00.530444 26493 consensus_meta.cc:287] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.572s user 0.006s sys 0.000s
I20260928 20:03:00.513633 28321 raft_consensus.cc:2804] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:00.536785 28362 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:00.537461 28362 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:00.540589 28362 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:00.540532 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:00.542567 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 431 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:03:00.342849 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e032f645304dbc88a895fae4bbd777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.553573 26634 tablet_service.cc:1511] Processing CreateTablet for tablet f376f270145e44b3acb4b8b2437cba33 (DEFAULT_TABLE table=default.Table_e81ad7e3711e4f25a6051f1ce257d20a [id=3da22346865f4613910dedb2fad45dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.577013 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.579483 28334 raft_consensus.cc:493] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:00.579967 28334 raft_consensus.cc:515] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.587800 28334 leader_election.cc:290] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:00.584689 26620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029a15ae85ff48d897493156fdd41d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.594815 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:00.586755 26622 consensus_meta.cc:287] T eac9b3e02fb541cab6d0d3c46743ff9e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 1.095s user 0.005s sys 0.005s
I20260928 20:03:00.605268 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.605979 26657 raft_consensus.cc:2468] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:00.613880 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d556a7736504aa2aa2fe8f868ecf489. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:00.608855 26628 consensus_meta.cc:287] T ec76c64607c9425fb5c837cb856c852c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.861s user 0.006s sys 0.005s
W20260928 20:03:00.644883 26625 consensus_meta.cc:287] T 693cc46819bf4480b5cef0f9b92e66b2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.917s user 0.002s sys 0.007s
I20260928 20:03:00.654368 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.666689 26627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807f3ef3db0f4319801baf86a331b98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.635004 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502edf35a86646178cfc121519c85c53" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.678216 26628 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 448) took 2128 ms. Trace:
I20260928 20:03:00.678642 26628 rpcz_store.cc:276] 0928 20:02:58.549708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.582254 (+ 32546us) service_pool.cc:224] Handling call
0928 20:02:58.752170 (+169916us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.752254 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.727610 (+975356us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.666374 (+938764us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.678148 (+ 11774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.680426 26628 tablet_service.cc:1511] Processing CreateTablet for tablet aaae231bea404219875c82340c09df2b (DEFAULT_TABLE table=default.Table_b535172c333e41bba212d17bbb3a0a13 [id=5c5d5de98b4047919b9ded842e422341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.681805 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.682941 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de40520ccd9b4a52a45c4085afd45b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.683548 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f376f270145e44b3acb4b8b2437cba33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.686549 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaae231bea404219875c82340c09df2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.686975 26622 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 454) took 2004 ms. Trace:
I20260928 20:03:00.687338 26622 rpcz_store.cc:276] 0928 20:02:58.682285 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.885158 (+202873us) service_pool.cc:224] Handling call
0928 20:02:58.918871 (+ 33713us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.918967 (+ 96us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.491483 (+572516us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.615972 (+1124489us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.686923 (+ 70951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.688901 26622 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5ef01e0dbd49398b27911a713626cd (DEFAULT_TABLE table=default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:03:00.678278 28240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.190s user 0.007s sys 0.014s
I20260928 20:03:00.690011 26622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5ef01e0dbd49398b27911a713626cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.394160 28059 ts_tablet_manager.cc:1975] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:00.703395 28059 log.cc:1199] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/1edf314241784091a603907a43429b28
I20260928 20:03:00.708359 28059 ts_tablet_manager.cc:1996] T 1edf314241784091a603907a43429b28 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:03:00.712390 26626 consensus_meta.cc:287] T 92397ac1a63a46e591e699e76627d5db P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.551s user 0.006s sys 0.001s
W20260928 20:03:00.699353 28240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.211s user 0.007s sys 0.014s
I20260928 20:03:00.714035 26626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 464) took 2021 ms. Trace:
I20260928 20:03:00.744743 26626 rpcz_store.cc:276] 0928 20:02:58.692593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.748382 (+ 55789us) service_pool.cc:224] Handling call
0928 20:02:58.750096 (+ 1714us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.750208 (+ 112us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.993077 (+1242869us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.713223 (+720146us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.713953 (+ 730us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:00.749446 26624 consensus_meta.cc:287] T d4ac199f639c454cbc920012040f52c9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.574s user 0.006s sys 0.000s
W20260928 20:03:00.751953 26621 consensus_meta.cc:287] T e1f21c71dc0e41aba85bb01c9fddc12d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.567s user 0.007s sys 0.000s
I20260928 20:03:00.753286 26621 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 455) took 2070 ms. Trace:
I20260928 20:03:00.753641 26621 rpcz_store.cc:276] 0928 20:02:58.682557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.953511 (+270954us) service_pool.cc:224] Handling call
0928 20:02:59.444701 (+491190us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.444825 (+ 124us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.184777 (+739952us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.752746 (+567969us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.753209 (+ 463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.763437 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b42615f62284e359cdc1f4c9cc715c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:00.766681 26658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.077s user 0.013s sys 0.004s
W20260928 20:03:00.767079 26658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s user 0.014s sys 0.005s
W20260928 20:03:00.767808 26594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.228s user 0.013s sys 0.007s
W20260928 20:03:00.768105 26594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.228s user 0.013s sys 0.007s
I20260928 20:03:00.768639 26633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 461) took 2076 ms. Trace:
I20260928 20:03:00.767685 26637 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 462) took 2075 ms. Trace:
I20260928 20:03:00.786557 28047 raft_consensus.cc:493] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:00.787048 28047 raft_consensus.cc:515] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:00.789042 28047 leader_election.cc:290] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:03:00.792333 26767 consensus_meta.cc:287] T 44f337138bc84030a3edf1ec1248d456 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.701s user 0.001s sys 0.005s
W20260928 20:03:00.792526 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 304911us
W20260928 20:03:00.784713 26770 consensus_meta.cc:287] T 7b1a8c85b6bc4849b447b6fd048afb2f P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.851s user 0.009s sys 0.000s
W20260928 20:03:00.795015 26772 consensus_meta.cc:287] T 807f3ef3db0f4319801baf86a331b98d P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.711s user 0.009s sys 0.000s
I20260928 20:03:00.535372 27857 ts_tablet_manager.cc:1975] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260928 20:03:00.794842 26766 consensus_meta.cc:287] T c3600b2fbb574106b5b13ab837754eb3 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.937s user 0.009s sys 0.000s
I20260928 20:03:00.805938 27857 log.cc:1199] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/0a2d13d16d9946c6b09f9197c165033c
I20260928 20:03:00.806620 27857 ts_tablet_manager.cc:1996] T 0a2d13d16d9946c6b09f9197c165033c P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
W20260928 20:03:00.808537 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 276963us
I20260928 20:03:00.521644 28303 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:00.819417 26783 consensus_meta.cc:287] T f376f270145e44b3acb4b8b2437cba33 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.725s user 0.008s sys 0.000s
W20260928 20:03:00.836815 26775 consensus_meta.cc:287] T eec056d6f6b0461da1f0a4525b711c8c P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.600s user 0.006s sys 0.001s
W20260928 20:03:00.809535 26450 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:00.845619 28303 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:00.847779 28303 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:00.849733 26448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:00.805249 28321 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:00.854403 28321 raft_consensus.cc:3060] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:00.512782 26488 rpcz_store.cc:276] 0928 20:02:58.526591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.527940 (+ 1349us) service_pool.cc:224] Handling call
0928 20:02:58.618488 (+ 90548us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.618588 (+ 100us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:58.649715 (+ 31127us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.377154 (+1727439us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.459417 (+ 82263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.863018 26488 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:03:00.864300 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 44f337138bc84030a3edf1ec1248d456 (DEFAULT_TABLE table=default.Table_faf293f941b845a992e4a5bc2f0d8e97 [id=00b3eb91544b41a1ab2a3b09f4f003ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.865448 28357 leader_election.cc:290] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:00.840720 26484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5ef01e0dbd49398b27911a713626cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.867254 26479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaae231bea404219875c82340c09df2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.870409 26482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de40520ccd9b4a52a45c4085afd45b2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:00.870913 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 77135.1us
W20260928 20:03:00.871555 26740 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5
W20260928 20:03:00.873240 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 192638us
W20260928 20:03:00.877012 26450 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:00.877632 26450 leader_election.cc:343] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:00.885339 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 365168us
W20260928 20:03:00.885547 26740 consensus_peers.cc:597] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:00.889313 28030 ts_tablet_manager.cc:1975] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:00.889791 28030 log.cc:1199] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/80d7ab92a37c4f9b865fa9fe49d46916
W20260928 20:03:00.893972 26740 consensus_peers.cc:597] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:00.894382 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b42615f62284e359cdc1f4c9cc715c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.907429 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bce47a5ab1a44989abe1761cab0c714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.908176 26490 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 465) took 1880 ms. Trace:
I20260928 20:03:00.908547 26490 rpcz_store.cc:276] 0928 20:02:59.027551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.187398 (+159847us) service_pool.cc:224] Handling call
0928 20:02:59.188659 (+ 1261us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.188731 (+ 72us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.705341 (+516610us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.480891 (+775550us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.908109 (+427218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:00.813387 26483 consensus_meta.cc:287] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.535s user 0.003s sys 0.003s
I20260928 20:03:00.916582 26493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 469) took 1717 ms. Trace:
I20260928 20:03:00.298010 26494 rpcz_store.cc:276] 0928 20:02:59.027063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.178622 (+151559us) service_pool.cc:224] Handling call
0928 20:02:59.179875 (+ 1253us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.179950 (+ 75us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.159222 (+979272us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.297142 (+137920us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.297581 (+ 439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.918859 28047 consensus_queue.cc:1048] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:00.803074 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 367) took 7417 ms. Trace:
W20260928 20:03:00.922200 26739 leader_election.cc:343] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:00.922307 28059 rpcz_store.cc:276] 0928 20:02:53.385166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.385586 (+ 420us) service_pool.cc:224] Handling call
0928 20:02:59.460770 (+6075184us) ts_tablet_manager.cc:1197] Deleting tablet 1edf314241784091a603907a43429b28
0928 20:02:59.460810 (+ 40us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:02:59.848960 (+388150us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.260717 (+411757us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.803004 (+542287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97707,"tablet-delete.queue_time_us":6074529}
W20260928 20:03:00.903005 26740 leader_election.cc:343] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ee464b814dbf4e4b89b2d1c019befac6
W20260928 20:03:00.927736 26740 leader_election.cc:343] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 01533b61bad74ddb9056aeacef13a126
W20260928 20:03:00.920961 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 151115us
W20260928 20:03:00.928418 26739 leader_election.cc:343] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: ba87a379ae6a4feabfbc9fd6ba2d488e
W20260928 20:03:00.930182 26740 leader_election.cc:343] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ba87a379ae6a4feabfbc9fd6ba2d488e
I20260928 20:03:00.931838 26740 leader_election.cc:304] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:00.759173 26592 connection.cc:256] RPC call timeout handler was delayed by -1.05679968000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1s for a response
I20260928 20:03:00.769809 26637 rpcz_store.cc:276] 0928 20:02:58.692100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.688478 (+996378us) service_pool.cc:224] Handling call
0928 20:02:59.689806 (+ 1328us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.689875 (+ 69us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.733964 (+1044089us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.767146 (+ 33182us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.767627 (+ 481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.769026 26633 rpcz_store.cc:276] 0928 20:02:58.691854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.679278 (+987424us) service_pool.cc:224] Handling call
0928 20:03:00.607210 (+927932us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58cda52 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:00.607328 (+ 118us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.607410 (+ 82us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.719260 (+111850us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.768164 (+ 48904us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.768583 (+ 419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085741824}
I20260928 20:03:00.934698 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:03:00.934993 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:03:00.937242 26739 consensus_peers.cc:597] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:00.938635 28047 raft_consensus.cc:2749] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:00.944442 26739 leader_election.cc:304] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:00.947431 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.942710 26740 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:00.951972 28047 raft_consensus.cc:2804] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:00.952526 28047 raft_consensus.cc:493] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:00.952962 28047 raft_consensus.cc:3060] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:00.917124 26493 rpcz_store.cc:276] 0928 20:02:59.198650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.438015 (+239365us) service_pool.cc:224] Handling call
0928 20:02:59.515973 (+ 77958us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.516057 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.958660 (+442603us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.531045 (+572385us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.916462 (+385417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:00.957019 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet fa49943f465f47778ac985cb5f4e6c0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:03:00.957314 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.958204 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 8536f4a4a0904806b71d4e7bf20c6bce (DEFAULT_TABLE table=default.Table_a343f55509fc4555836efe7503996740 [id=569aa44462c74840b9cd56304974e74e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:03:00.958519 26595 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f
I20260928 20:03:00.958544 26740 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:00.959458 26595 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4cd2204d99e14a07af962295b152d60f
I20260928 20:03:00.960062 28369 raft_consensus.cc:2749] T 534674440ee649e4afbc87b3cce5c43e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:00.960175 28373 consensus_queue.cc:1048] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:00.769968 28284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s user 0.014s sys 0.001s
I20260928 20:02:56.840000 27924 rpcz_store.cc:276] 0928 20:02:51.622412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.622521 (+ 109us) service_pool.cc:224] Handling call
0928 20:02:52.784320 (+1161799us) raft_consensus.cc:1471] Updating replica for 421 ops
0928 20:02:53.561372 (+777052us) raft_consensus.cc:1534] Early marking committed up to index 10
0928 20:02:53.607794 (+ 46422us) raft_consensus.cc:1539] Triggering prepare for 421 ops
0928 20:02:53.608360 (+ 566us) write_op.cc:270] Start()
0928 20:02:53.608499 (+ 139us) write_op.cc:276] Timestamp: P: 1790625743345291 usec, L: 0
0928 20:02:53.774527 (+166028us) write_op.cc:270] Start()
0928 20:02:53.774635 (+ 108us) write_op.cc:276] Timestamp: P: 1790625743349725 usec, L: 0
0928 20:02:53.775273 (+ 638us) write_op.cc:270] Start()
0928 20:02:53.775389 (+ 116us) write_op.cc:276] Timestamp: P: 1790625743357561 usec, L: 0
0928 20:02:53.775962 (+ 573us) write_op.cc:270] Start()
0928 20:02:53.776049 (+ 87us) write_op.cc:276] Timestamp: P: 1790625743381297 usec, L: 0
0928 20:02:53.776592 (+ 543us) write_op.cc:270] Start()
0928 20:02:53.776670 (+ 78us) write_op.cc:276] Timestamp: P: 1790625743438759 usec, L: 0
0928 20:02:53.777202 (+ 532us) write_op.cc:270] Start()
0928 20:02:53.778882 (+ 1680us) write_op.cc:276] Timestamp: P: 1790625743510423 usec, L: 0
0928 20:02:53.779372 (+ 490us) write_op.cc:270] Start()
0928 20:02:53.779527 (+ 155us) write_op.cc:276] Timestamp: P: 1790625743523185 usec, L: 0
0928 20:02:53.779986 (+ 459us) write_op.cc:270] Start()
0928 20:02:53.780064 (+ 78us) write_op.cc:276] Timestamp: P: 1790625743537159 usec, L: 0
0928 20:02:53.780508 (+ 444us) write_op.cc:270] Start()
0928 20:02:53.780583 (+ 75us) write_op.cc:276] Timestamp: P: 1790625743550601 usec, L: 0
0928 20:02:53.781056 (+ 473us) write_op.cc:270] Start()
0928 20:02:53.781131 (+ 75us) write_op.cc:276] Timestamp: P: 1790625743566036 usec, L: 0
0928 20:02:53.781576 (+ 445us) write_op.cc:270] Start()
0928 20:02:53.781658 (+ 82us) write_op.cc:276] Timestamp: P: 1790625743644139 usec, L: 0
0928 20:02:53.796932 (+ 15274us) write_op.cc:270] Start()
0928 20:02:53.797076 (+ 144us) write_op.cc:276] Timestamp: P: 1790625743676954 usec, L: 0
0928 20:02:53.797821 (+ 745us) write_op.cc:270] Start()
0928 20:02:53.797919 (+ 98us) write_op.cc:276] Timestamp: P: 1790625743688032 usec, L: 0
0928 20:02:53.798465 (+ 546us) write_op.cc:270] Start()
0928 20:02:53.798541 (+ 76us) write_op.cc:276] Timestamp: P: 1790625743705901 usec, L: 0
0928 20:02:53.798994 (+ 453us) write_op.cc:270] Start()
0928 20:02:53.799093 (+ 99us) write_op.cc:276] Timestamp: P: 1790625743708266 usec, L: 0
0928 20:02:53.799539 (+ 446us) write_op.cc:270] Start()
0928 20:02:53.799615 (+ 76us) write_op.cc:276] Timestamp: P: 1790625743750168 usec, L: 0
0928 20:02:53.800121 (+ 506us) write_op.cc:270] Start()
0928 20:02:53.800197 (+ 76us) write_op.cc:276] Timestamp: P: 1790625743851013 usec, L: 0
0928 20:02:53.800644 (+ 447us) write_op.cc:270] Start()
0928 20:02:53.800726 (+ 82us) write_op.cc:276] Timestamp: P: 1790625743881919 usec, L: 0
0928 20:02:53.801186 (+ 460us) write_op.cc:270] Start()
0928 20:02:53.801268 (+ 82us) write_op.cc:276] Timestamp: P: 1790625743889370 usec, L: 0
0928 20:02:53.801718 (+ 450us) write_op.cc:270] Start()
0928 20:02:53.801789 (+ 71us) write_op.cc:276] Timestamp: P: 1790625743910809 usec, L: 0
0928 20:02:53.802286 (+ 497us) write_op.cc:270] Start()
0928 20:02:53.802359 (+ 73us) write_op.cc:276] Timestamp: P: 1790625743919072 usec, L: 0
0928 20:02:53.802786 (+ 427us) write_op.cc:270] Start()
0928 20:02:53.802872 (+ 86us) write_op.cc:276] Timestamp: P: 1790625743983375 usec, L: 0
0928 20:02:53.803295 (+ 423us) write_op.cc:270] Start()
0928 20:02:53.803378 (+ 83us) write_op.cc:276] Timestamp: P: 1790625744018676 usec, L: 0
0928 20:02:53.803900 (+ 522us) write_op.cc:270] Start()
0928 20:02:53.804005 (+ 105us) write_op.cc:276] Timestamp: P: 1790625744045106 usec, L: 0
0928 20:02:53.804572 (+ 567us) write_op.cc:270] Start()
0928 20:02:53.804651 (+ 79us) write_op.cc:276] Timestamp: P: 1790625744113177 usec, L: 0
0928 20:02:53.805112 (+ 461us) write_op.cc:270] Start()
0928 20:02:53.805186 (+ 74us) write_op.cc:276] Timestamp: P: 1790625744148929 usec, L: 0
0928 20:02:53.805637 (+ 451us) write_op.cc:270] Start()
0928 20:02:53.805718 (+ 81us) write_op.cc:276] Timestamp: P: 1790625744175733 usec, L: 0
0928 20:02:53.826275 (+ 20557us) write_op.cc:270] Start()
0928 20:02:53.826378 (+ 103us) write_op.cc:276] Timestamp: P: 1790625744198055 usec, L: 0
0928 20:02:53.827056 (+ 678us) write_op.cc:270] Start()
0928 20:02:53.827142 (+ 86us) write_op.cc:276] Timestamp: P: 1790625744261473 usec, L: 0
0928 20:02:53.827642 (+ 500us) write_op.cc:270] Start()
0928 20:02:53.827719 (+ 77us) write_op.cc:276] Timestamp: P: 1790625744292547 usec, L: 0
0928 20:02:53.837831 (+ 10112us) write_op.cc:270] Start()
0928 20:02:53.837935 (+ 104us) write_op.cc:276] Timestamp: P: 1790625744343210 usec, L: 0
0928 20:02:53.838483 (+ 548us) write_op.cc:270] Start()
0928 20:02:53.838560 (+ 77us) write_op.cc:276] Timestamp: P: 1790625744496514 usec, L: 0
0928 20:02:53.839121 (+ 561us) write_op.cc:270] Start()
0928 20:02:53.839194 (+ 73us) write_op.cc:276] Timestamp: P: 1790625744628598 usec, L: 0
0928 20:02:53.839622 (+ 428us) write_op.cc:270] Start()
0928 20:02:53.839694 (+ 72us) write_op.cc:276] Timestamp: P: 1790625744710249 usec, L: 0
0928 20:02:53.840132 (+ 438us) write_op.cc:270] Start()
0928 20:02:53.840204 (+ 72us) write_op.cc:276] Timestamp: P: 1790625744782457 usec, L: 0
0928 20:02:53.840633 (+ 429us) write_op.cc:270] Start()
0928 20:02:53.840702 (+ 69us) write_op.cc:276] Timestamp: P: 1790625744845354 usec, L: 0
0928 20:02:53.841173 (+ 471us) write_op.cc:270] Start()
0928 20:02:53.841256 (+ 83us) write_op.cc:276] Timestamp: P: 1790625744905730 usec, L: 0
0928 20:02:53.841755 (+ 499us) write_op.cc:270] Start()
0928 20:02:53.841833 (+ 78us) write_op.cc:276] Timestamp: P: 1790625744931698 usec, L: 0
0928 20:02:53.842355 (+ 522us) write_op.cc:270] Start()
0928 20:02:53.842433 (+ 78us) write_op.cc:276] Timestamp: P: 1790625744970784 usec, L: 0
0928 20:02:53.842871 (+ 438us) write_op.cc:270] Start()
0928 20:02:53.842948 (+ 77us) write_op.cc:276] Timestamp: P: 1790625745010858 usec, L: 0
0928 20:02:53.843413 (+ 465us) write_op.cc:270] Start()
0928 20:02:53.843484 (+ 71us) write_op.cc:276] Timestamp: P: 1790625745051808 usec, L: 0
0928 20:02:53.843931 (+ 447us) write_op.cc:270] Start()
0928 20:02:53.844005 (+ 74us) write_op.cc:276] Timestamp: P: 1790625745090244 usec, L: 0
0928 20:02:53.844456 (+ 451us) write_op.cc:270] Start()
0928 20:02:53.844525 (+ 69us) write_op.cc:276] Timestamp: P: 1790625745142782 usec, L: 0
0928 20:02:53.844956 (+ 431us) write_op.cc:270] Start()
0928 20:02:53.845029 (+ 73us) write_op.cc:276] Timestamp: P: 1790625745375353 usec, L: 0
0928 20:02:53.845505 (+ 476us) write_op.cc:270] Start()
0928 20:02:53.845580 (+ 75us) write_op.cc:276] Timestamp: P: 1790625745527419 usec, L: 0
0928 20:02:53.846039 (+ 459us) write_op.cc:270] Start()
0928 20:02:53.869648 (+ 23609us) write_op.cc:276] Timestamp: P: 1790625745559099 usec, L: 0
0928 20:02:53.870356 (+ 708us) write_op.cc:270] Start()
0928 20:02:53.870455 (+ 99us) write_op.cc:276] Timestamp: P: 1790625745640356 usec, L: 0
0928 20:02:53.870964 (+ 509us) write_op.cc:270] Start()
0928 20:02:53.871110 (+ 146us) write_op.cc:276] Timestamp: P: 1790625745658888 usec, L: 0
0928 20:02:53.871664 (+ 554us) write_op.cc:270] Start()
0928 20:02:53.871737 (+ 73us) write_op.cc:276] Timestamp: P: 1790625745801443 usec, L: 0
0928 20:02:53.872228 (+ 491us) write_op.cc:270] Start()
0928 20:02:53.872310 (+ 82us) write_op.cc:276] Timestamp: P: 1790625745869679 usec, L: 0
0928 20:02:53.872778 (+ 468us) write_op.cc:270] Start()
0928 20:02:53.872865 (+ 87us) write_op.cc:276] Timestamp: P: 1790625745955450 usec, L: 0
0928 20:02:53.873354 (+ 489us) write_op.cc:270] Start()
0928 20:02:53.873435 (+ 81us) write_op.cc:276] Timestamp: P: 1790625745987441 usec, L: 0
0928 20:02:53.873881 (+ 446us) write_op.cc:270] Start()
0928 20:02:53.873953 (+ 72us) write_op.cc:276] Timestamp: P: 1790625745989834 usec, L: 0
0928 20:02:53.898583 (+ 24630us) write_op.cc:270] Start()
0928 20:02:53.898677 (+ 94us) write_op.cc:276] Timestamp: P: 1790625746006122 usec, L: 0
0928 20:02:53.899230 (+ 553us) write_op.cc:270] Start()
0928 20:02:53.899311 (+ 81us) write_op.cc:276] Timestamp: P: 1790625746013148 usec, L: 0
0928 20:02:53.899853 (+ 542us) write_op.cc:270] Start()
0928 20:02:53.899934 (+ 81us) write_op.cc:276] Timestamp: P: 1790625746035131 usec, L: 0
0928 20:02:53.900401 (+ 467us) write_op.cc:270] Start()
0928 20:02:53.900477 (+ 76us) write_op.cc:276] Timestamp: P: 1790625746111731 usec, L: 0
0928 20:02:53.900956 (+ 479us) write_op.cc:270] Start()
0928 20:02:53.901033 (+ 77us) write_op.cc:276] Timestamp: P: 1790625746188484 usec, L: 0
0928 20:02:53.901520 (+ 487us) write_op.cc:270] Start()
0928 20:02:53.901602 (+ 82us) write_op.cc:276] Timestamp: P: 1790625746241787 usec, L: 0
0928 20:02:53.902085 (+ 483us) write_op.cc:270] Start()
0928 20:02:53.906360 (+ 4275us) write_op.cc:276] Timestamp: P: 1790625746256101 usec, L: 0
0928 20:02:53.906951 (+ 591us) write_op.cc:270] Start()
0928 20:02:53.907035 (+ 84us) write_op.cc:276] Timestamp: P: 1790625746271370 usec, L: 0
0928 20:02:53.907548 (+ 513us) write_op.cc:270] Start()
0928 20:02:53.907629 (+ 81us) write_op.cc:276] Timestamp: P: 1790625746325308 usec, L: 0
0928 20:02:53.908149 (+ 520us) write_op.cc:270] Start()
0928 20:02:53.914064 (+ 5915us) write_op.cc:276] Timestamp: P: 1790625746363773 usec, L: 0
0928 20:02:53.914717 (+ 653us) write_op.cc:270] Start()
0928 20:02:53.914800 (+ 83us) write_op.cc:276] Timestamp: P: 1790625746375799 usec, L: 0
0928 20:02:53.915416 (+ 616us) write_op.cc:270] Start()
0928 20:02:53.915495 (+ 79us) write_op.cc:276] Timestamp: P: 1790625746445218 usec, L: 0
0928 20:02:53.915962 (+ 467us) write_op.cc:270] Start()
0928 20:02:53.916045 (+ 83us) write_op.cc:276] Timestamp: P: 1790625746499307 usec, L: 0
0928 20:02:53.916510 (+ 465us) write_op.cc:270] Start()
0928 20:02:53.916587 (+ 77us) write_op.cc:276] Timestamp: P: 1790625746584539 usec, L: 0
0928 20:02:53.917036 (+ 449us) write_op.cc:270] Start()
0928 20:02:53.917112 (+ 76us) write_op.cc:276] Timestamp: P: 1790625746659485 usec, L: 0
0928 20:02:53.917543 (+ 431us) write_op.cc:270] Start()
0928 20:02:53.917623 (+ 80us) write_op.cc:276] Timestamp: P: 1790625746737682 usec, L: 0
0928 20:02:53.918081 (+ 458us) write_op.cc:270] Start()
0928 20:02:53.934043 (+ 15962us) write_op.cc:276] Timestamp: P: 1790625746767109 usec, L: 0
0928 20:02:53.934665 (+ 622us) write_op.cc:270] Start()
0928 20:02:53.934746 (+ 81us) write_op.cc:276] Timestamp: P: 1790625746820202 usec, L: 0
0928 20:02:53.935217 (+ 471us) write_op.cc:270] Start()
0928 20:02:53.935291 (+ 74us) write_op.cc:276] Timestamp: P: 1790625746874973 usec, L: 0
0928 20:02:53.935740 (+ 449us) write_op.cc:270] Start()
0928 20:02:53.935815 (+ 75us) write_op.cc:276] Timestamp: P: 1790625746919135 usec, L: 0
0928 20:02:53.936289 (+ 474us) write_op.cc:270] Start()
0928 20:02:53.936363 (+ 74us) write_op.cc:276] Timestamp: P: 1790625746940070 usec, L: 0
0928 20:02:53.936814 (+ 451us) write_op.cc:270] Start()
0928 20:02:53.946153 (+ 9339us) write_op.cc:276] Timestamp: P: 1790625746948891 usec, L: 0
0928 20:02:53.946801 (+ 648us) write_op.cc:270] Start()
0928 20:02:53.946908 (+ 107us) write_op.cc:276] Timestamp: P: 1790625746971005 usec, L: 0
0928 20:02:53.947392 (+ 484us) write_op.cc:270] Start()
0928 20:02:53.947475 (+ 83us) write_op.cc:276] Timestamp: P: 1790625746985973 usec, L: 0
0928 20:02:53.947973 (+ 498us) write_op.cc:270] Start()
0928 20:02:53.948057 (+ 84us) write_op.cc:276] Timestamp: P: 1790625747051296 usec, L: 0
0928 20:02:53.953452 (+ 5395us) write_op.cc:270] Start()
0928 20:02:53.953565 (+ 113us) write_op.cc:276] Timestamp: P: 1790625747141331 usec, L: 0
0928 20:02:53.954186 (+ 621us) write_op.cc:270] Start()
0928 20:02:53.954276 (+ 90us) write_op.cc:276] Timestamp: P: 1790625747184180 usec, L: 0
0928 20:02:53.954785 (+ 509us) write_op.cc:270] Start()
0928 20:02:53.954879 (+ 94us) write_op.cc:276] Timestamp: P: 1790625747203216 usec, L: 0
0928 20:02:53.955402 (+ 523us) write_op.cc:270] Start()
0928 20:02:53.955484 (+ 82us) write_op.cc:276] Timestamp: P: 1790625747253796 usec, L: 0
0928 20:02:53.960289 (+ 4805us) write_op.cc:270] Start()
0928 20:02:53.960375 (+ 86us) write_op.cc:276] Timestamp: P: 1790625747266433 usec, L: 0
0928 20:02:53.960887 (+ 512us) write_op.cc:270] Start()
0928 20:02:53.960969 (+ 82us) write_op.cc:276] Timestamp: P: 1790625747291527 usec, L: 0
0928 20:02:53.961411 (+ 442us) write_op.cc:270] Start()
0928 20:02:53.961486 (+ 75us) write_op.cc:276] Timestamp: P: 1790625747300690 usec, L: 0
0928 20:02:53.961975 (+ 489us) write_op.cc:270] Start()
0928 20:02:53.962049 (+ 74us) write_op.cc:276] Timestamp: P: 1790625747392141 usec, L: 0
0928 20:02:53.962506 (+ 457us) write_op.cc:270] Start()
0928 20:02:53.962577 (+ 71us) write_op.cc:276] Timestamp: P: 1790625747436543 usec, L: 0
0928 20:02:53.963093 (+ 516us) write_op.cc:270] Start()
0928 20:02:53.963183 (+ 90us) write_op.cc:276] Timestamp: P: 1790625747554935 usec, L: 0
0928 20:02:53.963636 (+ 453us) write_op.cc:270] Start()
0928 20:02:53.963713 (+ 77us) write_op.cc:276] Timestamp: P: 1790625747585477 usec, L: 0
0928 20:02:53.964236 (+ 523us) write_op.cc:270] Start()
0928 20:02:53.964319 (+ 83us) write_op.cc:276] Timestamp: P: 1790625747673050 usec, L: 0
0928 20:02:53.964822 (+ 503us) write_op.cc:270] Start()
0928 20:02:53.964908 (+ 86us) write_op.cc:276] Timestamp: P: 1790625747764912 usec, L: 0
0928 20:02:53.965396 (+ 488us) write_op.cc:270] Start()
0928 20:02:53.965480 (+ 84us) write_op.cc:276] Timestamp: P: 1790625747805076 usec, L: 0
0928 20:02:53.965923 (+ 443us) write_op.cc:270] Start()
0928 20:02:53.966021 (+ 98us) write_op.cc:276] Timestamp: P: 1790625747822818 usec, L: 0
0928 20:02:54.016323 (+ 50302us) write_op.cc:270] Start()
0928 20:02:54.016419 (+ 96us) write_op.cc:276] Timestamp: P: 1790625747840276 usec, L: 0
0928 20:02:54.016957 (+ 538us) write_op.cc:270] Start()
0928 20:02:54.017032 (+ 75us) write_op.cc:276] Timestamp: P: 1790625747878901 usec, L: 0
0928 20:02:54.021333 (+ 4301us) write_op.cc:270] Start()
0928 20:02:54.021431 (+ 98us) write_op.cc:276] Timestamp: P: 1790625747894823 usec, L: 0
0928 20:02:54.021881 (+ 450us) write_op.cc:270] Start()
0928 20:02:54.021948 (+ 67us) write_op.cc:276] Timestamp: P: 1790625747918607 usec, L: 0
0928 20:02:54.022431 (+ 483us) write_op.cc:270] Start()
0928 20:02:54.022642 (+ 211us) write_op.cc:276] Timestamp: P: 1790625747939051 usec, L: 0
0928 20:02:54.023158 (+ 516us) write_op.cc:270] Start()
0928 20:02:54.023221 (+ 63us) write_op.cc:276] Timestamp: P: 1790625747996553 usec, L: 0
0928 20:02:54.023649 (+ 428us) write_op.cc:270] Start()
0928 20:02:54.023713 (+ 64us) write_op.cc:276] Timestamp: P: 1790625748033794 usec, L: 0
0928 20:02:54.024114 (+ 401us) write_op.cc:270] Start()
0928 20:02:54.024177 (+ 63us) write_op.cc:276] Timestamp: P: 1790625748082795 usec, L: 0
0928 20:02:54.024569 (+ 392us) write_op.cc:270] Start()
0928 20:02:54.024634 (+ 65us) write_op.cc:276] Timestamp: P: 1790625748101379 usec, L: 0
0928 20:02:54.025038 (+ 404us) write_op.cc:270] Start()
0928 20:02:54.025120 (+ 82us) write_op.cc:276] Timestamp: P: 1790625748111860 usec, L: 0
0928 20:02:54.047740 (+ 22620us) write_op.cc:270] Start()
0928 20:02:54.047832 (+ 92us) write_op.cc:276] Timestamp: P: 1790625748114071 usec, L: 0
0928 20:02:54.048373 (+ 541us) write_op.cc:270] Start()
0928 20:02:54.048446 (+ 73us) write_op.cc:276] Timestamp: P: 1790625748128563 usec, L: 0
0928 20:02:54.048908 (+ 462us) write_op.cc:270] Start()
0928 20:02:54.048972 (+ 64us) write_op.cc:276] Timestamp: P: 1790625748141495 usec, L: 0
0928 20:02:54.049343 (+ 371us) write_op.cc:270] Start()
0928 20:02:54.049405 (+ 62us) write_op.cc:276] Timestamp: P: 1790625748225732 usec, L: 0
0928 20:02:54.049795 (+ 390us) write_op.cc:270] Start()
0928 20:02:54.049867 (+ 72us) write_op.cc:276] Timestamp: P: 1790625748235103 usec, L: 0
0928 20:02:54.055578 (+ 5711us) write_op.cc:270] Start()
0928 20:02:54.055665 (+ 87us) write_op.cc:276] Timestamp: P: 1790625748269717 usec, L: 0
0928 20:02:54.056148 (+ 483us) write_op.cc:270] Start()
0928 20:02:54.056215 (+ 67us) write_op.cc:276] Timestamp: P: 1790625748284586 usec, L: 0
0928 20:02:54.056639 (+ 424us) write_op.cc:270] Start()
0928 20:02:54.056707 (+ 68us) write_op.cc:276] Timestamp: P: 1790625748313821 usec, L: 0
0928 20:02:54.057122 (+ 415us) write_op.cc:270] Start()
0928 20:02:54.057193 (+ 71us) write_op.cc:276] Timestamp: P: 1790625748334154 usec, L: 0
0928 20:02:54.057579 (+ 386us) write_op.cc:270] Start()
0928 20:02:54.057646 (+ 67us) write_op.cc:276] Timestamp: P: 1790625748381269 usec, L: 0
0928 20:02:54.058073 (+ 427us) write_op.cc:270] Start()
0928 20:02:54.058161 (+ 88us) write_op.cc:276] Timestamp: P: 1790625748429440 usec, L: 0
0928 20:02:54.069878 (+ 11717us) write_op.cc:270] Start()
0928 20:02:54.069948 (+ 70us) write_op.cc:276] Timestamp: P: 1790625748470933 usec, L: 0
0928 20:02:54.070409 (+ 461us) write_op.cc:270] Start()
0928 20:02:54.070473 (+ 64us) write_op.cc:276] Timestamp: P: 1790625748506584 usec, L: 0
0928 20:02:54.074224 (+ 3751us) write_op.cc:270] Start()
0928 20:02:54.074306 (+ 82us) write_op.cc:276] Timestamp: P: 1790625748612769 usec, L: 0
0928 20:02:54.074739 (+ 433us) write_op.cc:270] Start()
0928 20:02:54.074806 (+ 67us) write_op.cc:276] Timestamp: P: 1790625748659608 usec, L: 0
0928 20:02:54.081298 (+ 6492us) write_op.cc:270] Start()
0928 20:02:54.081388 (+ 90us) write_op.cc:276] Timestamp: P: 1790625748712227 usec, L: 0
0928 20:02:54.081873 (+ 485us) write_op.cc:270] Start()
0928 20:02:54.081941 (+ 68us) write_op.cc:276] Timestamp: P: 1790625748714354 usec, L: 0
0928 20:02:54.082403 (+ 462us) write_op.cc:270] Start()
0928 20:02:54.082471 (+ 68us) write_op.cc:276] Timestamp: P: 1790625748743438 usec, L: 0
0928 20:02:54.082902 (+ 431us) write_op.cc:270] Start()
0928 20:02:54.082966 (+ 64us) write_op.cc:276] Timestamp: P: 1790625748745422 usec, L: 0
0928 20:02:54.083358 (+ 392us) write_op.cc:270] Start()
0928 20:02:54.083421 (+ 63us) write_op.cc:276] Timestamp: P: 1790625748753405 usec, L: 0
0928 20:02:54.083814 (+ 393us) write_op.cc:270] Start()
0928 20:02:54.110243 (+ 26429us) write_op.cc:276] Timestamp: P: 1790625748755539 usec, L: 0
0928 20:02:54.110931 (+ 688us) write_op.cc:270] Start()
0928 20:02:54.111021 (+ 90us) write_op.cc:276] Timestamp: P: 1790625748757452 usec, L: 0
0928 20:02:54.111478 (+ 457us) write_op.cc:270] Start()
0928 20:02:54.111542 (+ 64us) write_op.cc:276] Timestamp: P: 1790625748802902 usec, L: 0
0928 20:02:54.112002 (+ 460us) write_op.cc:270] Start()
0928 20:02:54.112068 (+ 66us) write_op.cc:276] Timestamp: P: 1790625748838238 usec, L: 0
0928 20:02:54.112542 (+ 474us) write_op.cc:270] Start()
0928 20:02:54.112611 (+ 69us) write_op.cc:276] Timestamp: P: 1790625748906912 usec, L: 0
0928 20:02:54.113172 (+ 561us) write_op.cc:270] Start()
0928 20:02:54.113238 (+ 66us) write_op.cc:276] Timestamp: P: 1790625749036807 usec, L: 0
0928 20:02:54.113644 (+ 406us) write_op.cc:270] Start()
0928 20:02:54.113710 (+ 66us) write_op.cc:276] Timestamp: P: 1790625749062475 usec, L: 0
0928 20:02:54.158320 (+ 44610us) write_op.cc:270] Start()
0928 20:02:54.158490 (+ 170us) write_op.cc:276] Timestamp: P: 1790625749107867 usec, L: 0
0928 20:02:54.159003 (+ 513us) write_op.cc:270] Start()
0928 20:02:54.159070 (+ 67us) write_op.cc:276] Timestamp: P: 1790625749123599 usec, L: 0
0928 20:02:54.159531 (+ 461us) write_op.cc:270] Start()
0928 20:02:54.159598 (+ 67us) write_op.cc:276] Timestamp: P: 1790625749195743 usec, L: 0
0928 20:02:54.160031 (+ 433us) write_op.cc:270] Start()
0928 20:02:54.160098 (+ 67us) write_op.cc:276] Timestamp: P: 1790625749259770 usec, L: 0
0928 20:02:54.160481 (+ 383us) write_op.cc:270] Start()
0928 20:02:54.160543 (+ 62us) write_op.cc:276] Timestamp: P: 1790625749354214 usec, L: 0
0928 20:02:54.160970 (+ 427us) write_op.cc:270] Start()
0928 20:02:54.161038 (+ 68us) write_op.cc:276] Timestamp: P: 1790625749436033 usec, L: 0
0928 20:02:54.161428 (+ 390us) write_op.cc:270] Start()
0928 20:02:54.161493 (+ 65us) write_op.cc:276] Timestamp: P: 1790625749473104 usec, L: 0
0928 20:02:54.161949 (+ 456us) write_op.cc:270] Start()
0928 20:02:54.162022 (+ 73us) write_op.cc:276] Timestamp: P: 1790625749594676 usec, L: 0
0928 20:02:54.176779 (+ 14757us) write_op.cc:270] Start()
0928 20:02:54.176862 (+ 83us) write_op.cc:276] Timestamp: P: 1790625749600332 usec, L: 0
0928 20:02:54.177301 (+ 439us) write_op.cc:270] Start()
0928 20:02:54.177374 (+ 73us) write_op.cc:276] Timestamp: P: 1790625749673425 usec, L: 0
0928 20:02:54.222471 (+ 45097us) write_op.cc:270] Start()
0928 20:02:54.222575 (+ 104us) write_op.cc:276] Timestamp: P: 1790625749801985 usec, L: 0
0928 20:02:54.223200 (+ 625us) write_op.cc:270] Start()
0928 20:02:54.223279 (+ 79us) write_op.cc:276] Timestamp: P: 1790625749891850 usec, L: 0
0928 20:02:54.223886 (+ 607us) write_op.cc:270] Start()
0928 20:02:54.223963 (+ 77us) write_op.cc:276] Timestamp: P: 1790625749924465 usec, L: 0
0928 20:02:54.224412 (+ 449us) write_op.cc:270] Start()
0928 20:02:54.224493 (+ 81us) write_op.cc:276] Timestamp: P: 1790625749991254 usec, L: 0
0928 20:02:54.224938 (+ 445us) write_op.cc:270] Start()
0928 20:02:54.225007 (+ 69us) write_op.cc:276] Timestamp: P: 1790625750038886 usec, L: 0
0928 20:02:54.225486 (+ 479us) write_op.cc:270] Start()
0928 20:02:54.225580 (+ 94us) write_op.cc:276] Timestamp: P: 1790625750077357 usec, L: 0
0928 20:02:54.226048 (+ 468us) write_op.cc:270] Start()
0928 20:02:54.226253 (+ 205us) write_op.cc:276] Timestamp: P: 1790625750138820 usec, L: 0
0928 20:02:54.226813 (+ 560us) write_op.cc:270] Start()
0928 20:02:54.226890 (+ 77us) write_op.cc:276] Timestamp: P: 1790625750156326 usec, L: 0
0928 20:02:54.227282 (+ 392us) write_op.cc:270] Start()
0928 20:02:54.227346 (+ 64us) write_op.cc:276] Timestamp: P: 1790625750237391 usec, L: 0
0928 20:02:54.236436 (+ 9090us) write_op.cc:270] Start()
0928 20:02:54.236518 (+ 82us) write_op.cc:276] Timestamp: P: 1790625750281685 usec, L: 0
0928 20:02:54.236972 (+ 454us) write_op.cc:270] Start()
0928 20:02:54.237045 (+ 73us) write_op.cc:276] Timestamp: P: 1790625750309970 usec, L: 0
0928 20:02:54.237481 (+ 436us) write_op.cc:270] Start()
0928 20:02:54.237557 (+ 76us) write_op.cc:276] Timestamp: P: 1790625750337027 usec, L: 0
0928 20:02:54.237970 (+ 413us) write_op.cc:270] Start()
0928 20:02:54.238040 (+ 70us) write_op.cc:276] Timestamp: P: 1790625750400178 usec, L: 0
0928 20:02:54.247888 (+ 9848us) write_op.cc:270] Start()
0928 20:02:54.247959 (+ 71us) write_op.cc:276] Timestamp: P: 1790625750489523 usec, L: 0
0928 20:02:54.248411 (+ 452us) write_op.cc:270] Start()
0928 20:02:54.248476 (+ 65us) write_op.cc:276] Timestamp: P: 1790625750523661 usec, L: 0
0928 20:02:54.248892 (+ 416us) write_op.cc:270] Start()
0928 20:02:54.248959 (+ 67us) write_op.cc:276] Timestamp: P: 1790625750602551 usec, L: 0
0928 20:02:54.249389 (+ 430us) write_op.cc:270] Start()
0928 20:02:54.249462 (+ 73us) write_op.cc:276] Timestamp: P: 1790625750628931 usec, L: 0
0928 20:02:54.249865 (+ 403us) write_op.cc:270] Start()
0928 20:02:54.249927 (+ 62us) write_op.cc:276] Timestamp: P: 1790625750671887 usec, L: 0
0928 20:02:54.250340 (+ 413us) write_op.cc:270] Start()
0928 20:02:54.250403 (+ 63us) write_op.cc:276] Timestamp: P: 1790625750697822 usec, L: 0
0928 20:02:54.250801 (+ 398us) write_op.cc:270] Start()
0928 20:02:54.250877 (+ 76us) write_op.cc:276] Timestamp: P: 1790625750766898 usec, L: 0
0928 20:02:54.251271 (+ 394us) write_op.cc:270] Start()
0928 20:02:54.251333 (+ 62us) write_op.cc:276] Timestamp: P: 1790625750825512 usec, L: 0
0928 20:02:54.251762 (+ 429us) write_op.cc:270] Start()
0928 20:02:54.251827 (+ 65us) write_op.cc:276] Timestamp: P: 1790625750839089 usec, L: 0
0928 20:02:54.252736 (+ 909us) write_op.cc:270] Start()
0928 20:02:54.252803 (+ 67us) write_op.cc:276] Timestamp: P: 1790625751128775 usec, L: 0
0928 20:02:54.253214 (+ 411us) write_op.cc:270] Start()
0928 20:02:54.253277 (+ 63us) write_op.cc:276] Timestamp: P: 1790625751132187 usec, L: 0
0928 20:02:54.253671 (+ 394us) write_op.cc:270] Start()
0928 20:02:54.253734 (+ 63us) write_op.cc:276] Timestamp: P: 1790625751135001 usec, L: 0
0928 20:02:54.278066 (+ 24332us) write_op.cc:270] Start()
0928 20:02:54.278177 (+ 111us) write_op.cc:276] Timestamp: P: 1790625751137482 usec, L: 0
0928 20:02:54.278766 (+ 589us) write_op.cc:270] Start()
0928 20:02:54.278939 (+ 173us) write_op.cc:276] Timestamp: P: 1790625751140515 usec, L: 0
0928 20:02:54.279400 (+ 461us) write_op.cc:270] Start()
0928 20:02:54.279472 (+ 72us) write_op.cc:276] Timestamp: P: 1790625751143651 usec, L: 0
0928 20:02:54.279916 (+ 444us) write_op.cc:270] Start()
0928 20:02:54.279982 (+ 66us) write_op.cc:276] Timestamp: P: 1790625751238971 usec, L: 0
0928 20:02:54.280422 (+ 440us) write_op.cc:270] Start()
0928 20:02:54.280485 (+ 63us) write_op.cc:276] Timestamp: P: 1790625751292101 usec, L: 0
0928 20:02:54.280897 (+ 412us) write_op.cc:270] Start()
0928 20:02:54.280965 (+ 68us) write_op.cc:276] Timestamp: P: 1790625751305577 usec, L: 0
0928 20:02:54.281366 (+ 401us) write_op.cc:270] Start()
0928 20:02:54.281429 (+ 63us) write_op.cc:276] Timestamp: P: 1790625751316481 usec, L: 0
0928 20:02:54.281807 (+ 378us) write_op.cc:270] Start()
0928 20:02:54.281883 (+ 76us) write_op.cc:276] Timestamp: P: 1790625751433444 usec, L: 0
0928 20:02:54.302432 (+ 20549us) write_op.cc:270] Start()
0928 20:02:54.302520 (+ 88us) write_op.cc:276] Timestamp: P: 1790625751451966 usec, L: 0
0928 20:02:54.303012 (+ 492us) write_op.cc:270] Start()
0928 20:02:54.303086 (+ 74us) write_op.cc:276] Timestamp: P: 1790625751525168 usec, L: 0
0928 20:02:54.303502 (+ 416us) write_op.cc:270] Start()
0928 20:02:54.303563 (+ 61us) write_op.cc:276] Timestamp: P: 1790625751716576 usec, L: 0
0928 20:02:54.303950 (+ 387us) write_op.cc:270] Start()
0928 20:02:54.304011 (+ 61us) write_op.cc:276] Timestamp: P: 1790625751770852 usec, L: 0
0928 20:02:54.304399 (+ 388us) write_op.cc:270] Start()
0928 20:02:54.304461 (+ 62us) write_op.cc:276] Timestamp: P: 1790625751812809 usec, L: 0
0928 20:02:54.304834 (+ 373us) write_op.cc:270] Start()
0928 20:02:54.304912 (+ 78us) write_op.cc:276] Timestamp: P: 1790625751851344 usec, L: 0
0928 20:02:54.305348 (+ 436us) write_op.cc:270] Start()
0928 20:02:54.305421 (+ 73us) write_op.cc:276] Timestamp: P: 1790625751854194 usec, L: 0
0928 20:02:54.305811 (+ 390us) write_op.cc:270] Start()
0928 20:02:54.305890 (+ 79us) write_op.cc:276] Timestamp: P: 1790625751913921 usec, L: 0
0928 20:02:54.326411 (+ 20521us) write_op.cc:270] Start()
0928 20:02:54.326505 (+ 94us) write_op.cc:276] Timestamp: P: 1790625751920091 usec, L: 0
0928 20:02:54.327145 (+ 640us) write_op.cc:270] Start()
0928 20:02:54.327221 (+ 76us) write_op.cc:276] Timestamp: P: 1790625751921994 usec, L: 0
0928 20:02:54.327660 (+ 439us) write_op.cc:270] Start()
0928 20:02:54.327726 (+ 66us) write_op.cc:276] Timestamp: P: 1790625751937406 usec, L: 0
0928 20:02:54.328131 (+ 405us) write_op.cc:270] Start()
0928 20:02:54.328198 (+ 67us) write_op.cc:276] Timestamp: P: 1790625751959725 usec, L: 0
0928 20:02:54.328597 (+ 399us) write_op.cc:270] Start()
0928 20:02:54.328663 (+ 66us) write_op.cc:276] Timestamp: P: 1790625752145899 usec, L: 0
0928 20:02:54.329087 (+ 424us) write_op.cc:270] Start()
0928 20:02:54.329159 (+ 72us) write_op.cc:276] Timestamp: P: 1790625752182186 usec, L: 0
0928 20:02:54.338604 (+ 9445us) write_op.cc:270] Start()
0928 20:02:54.338704 (+ 100us) write_op.cc:276] Timestamp: P: 1790625752189883 usec, L: 0
0928 20:02:54.339193 (+ 489us) write_op.cc:270] Start()
0928 20:02:54.339259 (+ 66us) write_op.cc:276] Timestamp: P: 1790625752275360 usec, L: 0
0928 20:02:54.339676 (+ 417us) write_op.cc:270] Start()
0928 20:02:54.339742 (+ 66us) write_op.cc:276] Timestamp: P: 1790625752325427 usec, L: 0
0928 20:02:54.340155 (+ 413us) write_op.cc:270] Start()
0928 20:02:54.340237 (+ 82us) write_op.cc:276] Timestamp: P: 1790625752370086 usec, L: 0
0928 20:02:54.340686 (+ 449us) write_op.cc:270] Start()
0928 20:02:54.340749 (+ 63us) write_op.cc:276] Timestamp: P: 1790625752428957 usec, L: 0
0928 20:02:54.341173 (+ 424us) write_op.cc:270] Start()
0928 20:02:54.341241 (+ 68us) write_op.cc:276] Timestamp: P: 1790625752526315 usec, L: 0
0928 20:02:54.341630 (+ 389us) write_op.cc:270] Start()
0928 20:02:54.341694 (+ 64us) write_op.cc:276] Timestamp: P: 1790625752601675 usec, L: 0
0928 20:02:54.366136 (+ 24442us) write_op.cc:270] Start()
0928 20:02:54.366251 (+ 115us) write_op.cc:276] Timestamp: P: 1790625752707949 usec, L: 0
0928 20:02:54.366795 (+ 544us) write_op.cc:270] Start()
0928 20:02:54.366890 (+ 95us) write_op.cc:276] Timestamp: P: 1790625752721730 usec, L: 0
0928 20:02:54.367386 (+ 496us) write_op.cc:270] Start()
0928 20:02:54.367455 (+ 69us) write_op.cc:276] Timestamp: P: 179062
I20260928 20:03:00.804064 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
W20260928 20:03:00.967703 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 163730us
I20260928 20:03:00.971763 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:00.972864 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.973913 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a8177684ed461cbc7bbc4aeb30873c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.974341 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.975358 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.975926 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:00.978608 26495 consensus_meta.cc:287] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.806s user 0.008s sys 0.000s
I20260928 20:03:00.979478 28362 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 20:03:00.980762 26595 leader_election.cc:343] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:03:00.982671 28359 raft_consensus.cc:493] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.983019 26494 tablet_service.cc:1558] Processing DeleteTablet for tablet fa49943f465f47778ac985cb5f4e6c0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:03:00.983206 28359 raft_consensus.cc:515] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:00.984253 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf943cffdd440caa2978769faed7f2c (DEFAULT_TABLE table=default.Table_39e9fc84df3844129902f8bb568244e2 [id=43ecf4974c7f4dc7a1ebcb5091d78076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.985421 28359 leader_election.cc:290] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:00.986285 26490 tablet_service.cc:1558] Processing DeleteTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
W20260928 20:03:00.986346 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 70530.9us
I20260928 20:03:00.987092 26450 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:00.988626 28373 raft_consensus.cc:2749] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:00.991416 26781 consensus_meta.cc:287] T 0b42615f62284e359cdc1f4c9cc715c5 P b2d286f4404146278f5e0785ed9fcee4: Time spent flushing consensus metadata: real 0.626s user 0.005s sys 0.000s
W20260928 20:03:00.970263 28284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s user 0.014s sys 0.001s
I20260928 20:03:00.993480 26780 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 493) took 2185 ms. Trace:
I20260928 20:03:00.993788 26780 rpcz_store.cc:276] 0928 20:02:58.807706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.676965 (+869259us) service_pool.cc:224] Handling call
0928 20:03:00.051007 (+374042us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.065012 (+ 14005us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.065091 (+ 79us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.076899 (+ 11808us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.465795 (+388896us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.993423 (+527628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835942784}
I20260928 20:03:00.995349 26780 tablet_service.cc:1511] Processing CreateTablet for tablet f32d0e469bac4306b719d26290570bf0 (DEFAULT_TABLE table=default.Table_1d04da9e1ce749aaafdc63f86a11535e [id=aa9d03a4e0a840659761ea54cbb4519f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.996315 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32d0e469bac4306b719d26290570bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:00.998461 26774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 491) took 2191 ms. Trace:
I20260928 20:03:00.998829 26774 rpcz_store.cc:276] 0928 20:02:58.807163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.674384 (+867221us) service_pool.cc:224] Handling call
0928 20:03:00.050323 (+375939us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.055322 (+ 4999us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.055403 (+ 81us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.081085 (+ 25682us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.484801 (+403716us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:00.998393 (+513592us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841999616}
I20260928 20:03:01.000414 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 42cf8cc998fb4039897ca93158c2202a (DEFAULT_TABLE table=default.Table_53c689bd6dc0475da06ec57192aaa587 [id=d739d9bcee244c8db96567e6cbc0fdc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.001410 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cf8cc998fb4039897ca93158c2202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.002664 26776 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 492) took 2195 ms. Trace:
I20260928 20:03:01.003012 26776 rpcz_store.cc:276] 0928 20:02:58.807447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.675383 (+867936us) service_pool.cc:224] Handling call
0928 20:03:00.041449 (+366066us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.041907 (+ 458us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.041974 (+ 67us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.061388 (+ 19414us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.485345 (+423957us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.002610 (+517265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837435136}
I20260928 20:03:01.004671 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 25595d85d1ad4ac7a80db4c55cd9c86f (DEFAULT_TABLE table=default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.005661 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25595d85d1ad4ac7a80db4c55cd9c86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.006440 26784 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 494) took 2198 ms. Trace:
I20260928 20:03:01.006771 26784 rpcz_store.cc:276] 0928 20:02:58.807974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.677106 (+869132us) service_pool.cc:224] Handling call
0928 20:03:00.047630 (+370524us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.047727 (+ 97us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.047798 (+ 71us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.082486 (+ 34688us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.484388 (+401902us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.006382 (+521994us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473306496}
I20260928 20:03:01.008364 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 29c54767c86649b599ef539765d2b2dd (DEFAULT_TABLE table=default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.009382 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c54767c86649b599ef539765d2b2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.010752 26768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 481) took 2466 ms. Trace:
I20260928 20:03:01.011089 26768 rpcz_store.cc:276] 0928 20:02:58.544184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.562419 (+1018235us) service_pool.cc:224] Handling call
0928 20:02:59.570257 (+ 7838us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.570361 (+ 104us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.035188 (+464827us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.785938 (+750750us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.010692 (+224754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.012337 26779 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 508) took 1214 ms. Trace:
I20260928 20:03:01.012648 26779 rpcz_store.cc:276] 0928 20:02:59.798229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.264261 (+466032us) service_pool.cc:224] Handling call
0928 20:03:00.265484 (+ 1223us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.265552 (+ 68us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.306040 (+ 40488us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.494797 (+188757us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.012287 (+517490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5004}
W20260928 20:03:01.014438 26450 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:00.992385 26647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:00.998840 26626 tablet_service.cc:1511] Processing CreateTablet for tablet b31777af7102483fbcaab35a47d27852 (DEFAULT_TABLE table=default.Table_2a6a2e75f86f4344ba5d2e495190619b [id=e5a58b48db114aa29aca24eec47130d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:00.993172 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.007112 26624 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 452) took 2335 ms. Trace:
I20260928 20:03:01.014070 26767 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 496) took 2205 ms. Trace:
I20260928 20:03:00.915130 28353 raft_consensus.cc:493] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:00.957096 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.011135 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf943cffdd440caa2978769faed7f2c (DEFAULT_TABLE table=default.Table_39e9fc84df3844129902f8bb568244e2 [id=43ecf4974c7f4dc7a1ebcb5091d78076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.012460 26621 tablet_service.cc:1511] Processing CreateTablet for tablet 44f337138bc84030a3edf1ec1248d456 (DEFAULT_TABLE table=default.Table_faf293f941b845a992e4a5bc2f0d8e97 [id=00b3eb91544b41a1ab2a3b09f4f003ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.018781 26767 rpcz_store.cc:276] 0928 20:02:58.808532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.681075 (+872543us) service_pool.cc:224] Handling call
0928 20:03:00.047924 (+366849us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.048048 (+ 124us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.048143 (+ 95us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.078021 (+ 29878us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.792813 (+714792us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.014015 (+221202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374316416}
I20260928 20:03:01.023227 26770 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 482) took 2478 ms. Trace:
I20260928 20:03:01.016292 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8536f4a4a0904806b71d4e7bf20c6bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.023602 26770 rpcz_store.cc:276] 0928 20:02:58.544427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.572109 (+1027682us) service_pool.cc:224] Handling call
0928 20:02:59.575489 (+ 3380us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.575599 (+ 110us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.933753 (+358154us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.793418 (+859665us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.023159 (+229741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.016772 26636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 466) took 2323 ms. Trace:
I20260928 20:03:01.022665 26625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 453) took 2350 ms. Trace:
I20260928 20:03:01.024782 26782 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 505) took 1355 ms. Trace:
I20260928 20:03:01.025087 26782 rpcz_store.cc:276] 0928 20:02:59.673484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.127283 (+453799us) service_pool.cc:224] Handling call
0928 20:03:00.226140 (+ 98857us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.226245 (+ 105us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.234317 (+ 8072us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.785120 (+550803us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.024728 (+239608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8466}
I20260928 20:03:01.026249 26778 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 468) took 2687 ms. Trace:
I20260928 20:03:01.026551 26778 rpcz_store.cc:276] 0928 20:02:58.338665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.132648 (+793983us) service_pool.cc:224] Handling call
0928 20:02:59.541677 (+409029us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.541765 (+ 88us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.273813 (+732048us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.529876 (+256063us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.026193 (+496317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8279}
I20260928 20:03:01.026796 26490 tablet_service.cc:1511] Processing CreateTablet for tablet faefa3535ee54987b76cc6782b988c90 (DEFAULT_TABLE table=default.Table_c909970e41b44433885b634d80002868 [id=2e3160a2ecb54b22a2a543498ec403b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.028004 26766 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 478) took 2484 ms. Trace:
I20260928 20:03:01.028352 26766 rpcz_store.cc:276] 0928 20:02:58.543497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.502221 (+958724us) service_pool.cc:224] Handling call
0928 20:02:59.541272 (+ 39051us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.541356 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.857362 (+316006us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.816226 (+958864us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.027948 (+211722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.029587 26772 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 483) took 2484 ms. Trace:
I20260928 20:03:01.029943 26772 rpcz_store.cc:276] 0928 20:02:58.544644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.574290 (+1029646us) service_pool.cc:224] Handling call
0928 20:03:00.048455 (+474165us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.048555 (+ 100us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.048636 (+ 81us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.084014 (+ 35378us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.816631 (+732617us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.029527 (+212896us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10253,"spinlock_wait_cycles":846711040}
I20260928 20:03:01.024765 26636 rpcz_store.cc:276] 0928 20:02:58.693077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.731506 (+1038429us) service_pool.cc:224] Handling call
0928 20:02:59.798614 (+ 67108us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.798901 (+ 287us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.258266 (+459365us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.951279 (+693013us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.016714 (+ 65435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4735}
I20260928 20:03:01.032796 26636 tablet_service.cc:1511] Processing CreateTablet for tablet faefa3535ee54987b76cc6782b988c90 (DEFAULT_TABLE table=default.Table_c909970e41b44433885b634d80002868 [id=2e3160a2ecb54b22a2a543498ec403b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.023144 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 8536f4a4a0904806b71d4e7bf20c6bce (DEFAULT_TABLE table=default.Table_a343f55509fc4555836efe7503996740 [id=569aa44462c74840b9cd56304974e74e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.014228 26480 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 452) took 2279 ms. Trace:
I20260928 20:03:01.058082 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf943cffdd440caa2978769faed7f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.042240 26450 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:01.059453 26636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefa3535ee54987b76cc6782b988c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.061606 26628 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 479) took 2098 ms. Trace:
I20260928 20:03:01.061998 26628 rpcz_store.cc:276] 0928 20:02:58.963070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.679663 (+1716593us) service_pool.cc:224] Handling call
0928 20:03:00.681094 (+ 1431us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.681185 (+ 91us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.746637 (+ 65452us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.920287 (+173650us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.061222 (+140935us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:01.061546 (+ 324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12656896}
I20260928 20:03:01.063848 26628 tablet_service.cc:1511] Processing CreateTablet for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a (DEFAULT_TABLE table=default.Table_18c37f8dfcdb47169eb7230ea02b7b2a [id=03435de0a7f1414ca9387b9a6695e4a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.064911 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.066267 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8147a650aa614b2fb0af08077e60ddc8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:01.066455 26783 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 490) took 2259 ms. Trace:
I20260928 20:03:01.019333 28359 raft_consensus.cc:2804] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:01.066771 26783 rpcz_store.cc:276] 0928 20:02:58.806890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.669479 (+862589us) service_pool.cc:224] Handling call
0928 20:03:00.071367 (+401888us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.071462 (+ 95us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.071528 (+ 66us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.093757 (+ 22229us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.819979 (+726222us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.066395 (+246416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841700736}
I20260928 20:03:01.071921 28030 ts_tablet_manager.cc:1996] T 80d7ab92a37c4f9b865fa9fe49d46916 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:01.072467 28059 tablet_replica.cc:333] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:01.073969 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 361) took 8432 ms. Trace:
I20260928 20:03:01.074312 28030 rpcz_store.cc:276] 0928 20:02:52.641223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.641309 (+ 86us) service_pool.cc:224] Handling call
0928 20:03:00.047159 (+7405850us) ts_tablet_manager.cc:1197] Deleting tablet 80d7ab92a37c4f9b865fa9fe49d46916
0928 20:03:00.047220 (+ 61us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:00.265256 (+218036us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.889183 (+623927us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.073900 (+184717us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7405391}
I20260928 20:03:01.075836 28030 tablet_replica.cc:333] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:01.082860 28059 raft_consensus.cc:2243] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:01.083814 28059 pending_rounds.cc:70] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:03:01.084065 28059 pending_rounds.cc:77] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403171121917952 op_type: NO_OP noop_request { }
I20260928 20:03:01.084446 28059 raft_consensus.cc:2889] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:01.084816 28059 raft_consensus.cc:2272] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:03:01.088290 26638 consensus_meta.cc:287] T eec056d6f6b0461da1f0a4525b711c8c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.779s user 0.010s sys 0.000s
I20260928 20:03:01.092744 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]). Expected version 1 got 0
I20260928 20:03:01.093532 26235 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a]). Expected version 2 got 1
I20260928 20:03:01.069325 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:01.070667 26629 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 450) took 2386 ms. Trace:
I20260928 20:03:01.111119 26629 rpcz_store.cc:276] 0928 20:02:58.671050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.785779 (+114729us) service_pool.cc:224] Handling call
0928 20:02:58.787730 (+ 1951us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.787935 (+ 205us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.566316 (+1778381us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.970540 (+404224us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.057619 (+ 87079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.112317 26629 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:03:01.113397 26629 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6d3f0467684127af0fcaa3ddac3fdd (DEFAULT_TABLE table=default.Table_66f34d73b85d4af58844cc7ea97a7866 [id=7915573b0b384fb693d6bdafe1bb095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.019049 26624 rpcz_store.cc:276] 0928 20:02:58.671521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.806593 (+135072us) service_pool.cc:224] Handling call
0928 20:02:58.808171 (+ 1578us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.808364 (+ 193us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.153157 (+1344793us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.749949 (+596792us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.007038 (+257089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.027993 26625 rpcz_store.cc:276] 0928 20:02:58.671739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.879226 (+207487us) service_pool.cc:224] Handling call
0928 20:02:58.883440 (+ 4214us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.883521 (+ 81us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.474485 (+590964us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.705580 (+1231095us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.022590 (+317010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":447}
I20260928 20:03:01.140125 26625 tablet_service.cc:1511] Processing CreateTablet for tablet 2034cd490bd14992aa2572f31d2ff63b (DEFAULT_TABLE table=default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.142197 26913 tablet_bootstrap.cc:492] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:01.142643 26913 ts_tablet_manager.cc:1449] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 1.690s user 0.005s sys 0.016s
I20260928 20:03:01.142762 26626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31777af7102483fbcaab35a47d27852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.083035 26769 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 500) took 1428 ms. Trace:
I20260928 20:03:01.143051 26769 rpcz_store.cc:276] 0928 20:02:59.654455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.067911 (+413456us) service_pool.cc:224] Handling call
0928 20:03:00.069577 (+ 1666us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.069647 (+ 70us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.786572 (+716925us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.834046 (+ 47474us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.082975 (+248929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.083614 26771 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 504) took 1416 ms. Trace:
I20260928 20:03:01.144002 26771 rpcz_store.cc:276] 0928 20:02:59.667601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.101166 (+433565us) service_pool.cc:224] Handling call
0928 20:03:00.226466 (+125300us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.226646 (+ 180us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.827795 (+601149us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.877249 (+ 49454us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.083562 (+206313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.084172 26765 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 502) took 1419 ms. Trace:
I20260928 20:03:01.144999 26765 rpcz_store.cc:276] 0928 20:02:59.664472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.080470 (+415998us) service_pool.cc:224] Handling call
0928 20:03:00.081727 (+ 1257us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.081798 (+ 71us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.823408 (+741610us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.882339 (+ 58931us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.084118 (+201779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.084781 26773 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 489) took 2278 ms. Trace:
I20260928 20:03:01.145954 26773 rpcz_store.cc:276] 0928 20:02:58.806578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.666465 (+859887us) service_pool.cc:224] Handling call
0928 20:02:59.668518 (+ 2053us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.061913 (+393395us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.339628 (+277715us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.824997 (+485369us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.084731 (+259734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.085541 26781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 488) took 2539 ms. Trace:
I20260928 20:03:01.146582 28059 ts_tablet_manager.cc:1962] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:01.147336 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:01.067483 26486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31777af7102483fbcaab35a47d27852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.146776 28284 tablet.cc:1751] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:03:01.146893 26781 rpcz_store.cc:276] 0928 20:02:58.545976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.665755 (+1119779us) service_pool.cc:224] Handling call
0928 20:02:59.666838 (+ 1083us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.666911 (+ 73us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.364283 (+697372us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.991947 (+627664us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.085481 (+ 93534us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:01.085901 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 94212.6us
W20260928 20:03:01.150360 26739 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:01.150981 26739 leader_election.cc:343] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: ee464b814dbf4e4b89b2d1c019befac6
I20260928 20:03:01.151787 26739 leader_election.cc:304] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:01.152532 28373 raft_consensus.cc:2749] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:01.157140 26776 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 511) took 1302 ms. Trace:
I20260928 20:03:01.086721 26775 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 484) took 2541 ms. Trace:
I20260928 20:03:00.988168 26740 leader_election.cc:304] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:03:01.116638 28047 raft_consensus.cc:515] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.158931 26775 rpcz_store.cc:276] 0928 20:02:58.544862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.574274 (+1029412us) service_pool.cc:224] Handling call
0928 20:02:59.575872 (+ 1598us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.575944 (+ 72us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.236983 (+661039us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.837448 (+600465us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.086555 (+249107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:01.160506 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 172405us
I20260928 20:03:01.160933 28373 raft_consensus.cc:2804] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:01.161286 28373 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:01.161612 28373 raft_consensus.cc:3060] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:01.163085 26740 leader_election.cc:304] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:03:01.163813 28370 raft_consensus.cc:2804] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:01.164132 28370 raft_consensus.cc:493] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:01.164875 28370 raft_consensus.cc:3060] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:01.168008 26740 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:01.170945 26740 leader_election.cc:304] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:01.174988 26740 leader_election.cc:304] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:01.176102 28375 raft_consensus.cc:2749] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:01.176014 28369 raft_consensus.cc:2749] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:01.176900 28375 raft_consensus.cc:2749] T 756342f2b9a245c89ad8dbc6089b71d7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:01.178506 28047 leader_election.cc:290] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:01.180317 28370 raft_consensus.cc:515] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.099812 28354 raft_consensus.cc:493] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:01.106850 28357 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:01.039894 28353 raft_consensus.cc:515] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.179432 26913 raft_consensus.cc:359] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.190935 26774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 510) took 1337 ms. Trace:
I20260928 20:03:01.191258 26774 rpcz_store.cc:276] 0928 20:02:59.853344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.999772 (+1146428us) service_pool.cc:224] Handling call
0928 20:03:01.000966 (+ 1194us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.001046 (+ 80us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.073577 (+ 72531us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.158637 (+ 85060us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.190880 (+ 32243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.191824 28370 leader_election.cc:290] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:01.194641 26784 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 512) took 1339 ms. Trace:
I20260928 20:03:01.196322 26784 rpcz_store.cc:276] 0928 20:02:59.854788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.007754 (+1152966us) service_pool.cc:224] Handling call
0928 20:03:01.008933 (+ 1179us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.009039 (+ 106us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.098953 (+ 89914us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.194247 (+ 95294us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.194589 (+ 342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.186717 26913 raft_consensus.cc:385] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:01.197906 26913 raft_consensus.cc:740] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:01.198498 26913 consensus_queue.cc:260] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.200430 26913 ts_tablet_manager.cc:1480] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.057s user 0.005s sys 0.000s
I20260928 20:03:01.148105 28359 raft_consensus.cc:697] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:01.206883 26780 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 509) took 1354 ms. Trace:
I20260928 20:03:01.207716 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:55881 (request call id 367) took 1840 ms. Trace:
I20260928 20:03:01.208056 26658 rpcz_store.cc:276] 0928 20:02:59.367764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.367867 (+ 103us) service_pool.cc:224] Handling call
0928 20:02:59.370580 (+ 2713us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 20:02:59.590912 (+220332us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 20:02:59.590938 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 20:02:59.591286 (+ 348us) log.cc:844] Serialized 26 byte log entry
0928 20:03:00.767422 (+1176136us) raft_consensus.cc:1645] Marking committed up to 1
0928 20:03:01.206443 (+439021us) log.cc:844] Serialized 14 byte log entry
0928 20:03:01.207439 (+ 996us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 20:03:01.207518 (+ 79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 20:03:01.207551 (+ 33us) raft_consensus.cc:1685] finished
0928 20:03:01.207562 (+ 11us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 20:03:01.207664 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":289583,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":5122,"raft.run_cpu_time_us":660,"raft.run_wall_time_us":662,"spinlock_wait_cycles":21376,"thread_start_us":1614486,"threads_started":2,"wal-append.queue_time_us":1109273}
I20260928 20:03:01.169425 28373 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.225556 26916 tablet_bootstrap.cc:654] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:01.184511 28357 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:01.210001 26776 rpcz_store.cc:276] 0928 20:02:59.854522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.004011 (+1149489us) service_pool.cc:224] Handling call
0928 20:03:01.005237 (+ 1226us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.005311 (+ 74us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.119148 (+113837us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.156747 (+ 37599us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.157088 (+ 341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.234351 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.235693 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.237985 28373 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:01.207203 26780 rpcz_store.cc:276] 0928 20:02:59.852499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.994769 (+1142270us) service_pool.cc:224] Handling call
0928 20:03:00.995915 (+ 1146us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.995992 (+ 77us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.111797 (+115805us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.189121 (+ 77324us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.206830 (+ 17709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.058168 26480 rpcz_store.cc:276] 0928 20:02:58.722732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.871929 (+149197us) service_pool.cc:224] Handling call
0928 20:02:58.925711 (+ 53782us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:58.936340 (+ 10629us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:59.911338 (+974998us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.471467 (+560129us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.002084 (+530617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.207077 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f337138bc84030a3edf1ec1248d456. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:01.241894 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 66994.8us
I20260928 20:03:01.242374 28358 raft_consensus.cc:493] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:01.242873 28358 raft_consensus.cc:515] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.234153 28370 raft_consensus.cc:493] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:01.254658 28370 raft_consensus.cc:515] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.256881 28370 leader_election.cc:290] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:01.259094 28059 ts_tablet_manager.cc:1975] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:01.262584 28059 log.cc:1199] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/4b91a573103c4c2d995abde8db91b821
I20260928 20:03:01.270340 28059 ts_tablet_manager.cc:1996] T 4b91a573103c4c2d995abde8db91b821 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:01.270592 28359 consensus_queue.cc:237] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.275451 26480 tablet_service.cc:1511] Processing CreateTablet for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a (DEFAULT_TABLE table=default.Table_18c37f8dfcdb47169eb7230ea02b7b2a [id=03435de0a7f1414ca9387b9a6695e4a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.277916 28353 leader_election.cc:290] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:01.282740 26485 consensus_meta.cc:287] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.757s user 0.004s sys 0.005s
I20260928 20:03:01.195343 28354 raft_consensus.cc:515] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:01.285382 28354 leader_election.cc:290] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:01.238897 28357 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:01.313048 28388 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:01.313638 28388 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:01.252064 28358 leader_election.cc:290] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:01.316470 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:01.290421 26512 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.011s sys 0.011s
W20260928 20:03:01.318734 26512 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.805s user 0.012s sys 0.012s
I20260928 20:03:01.318444 28284 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 429) took 3319 ms. Trace:
I20260928 20:03:01.354444 28284 rpcz_store.cc:276] 0928 20:02:57.998663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.999209 (+ 546us) service_pool.cc:224] Handling call
0928 20:03:01.318350 (+3319141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:58.534550 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:58.605526 (+ 70976us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:58.605559 (+ 33us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:58.605604 (+ 45us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:58.605716 (+ 112us) alter_schema_op.cc:128] START. Timestamp: 1790625778599048
0928 20:02:58.605737 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:58.607110 (+ 1373us) log.cc:844] Serialized 173 byte log entry
0928 20:03:01.070233 (+2463123us) op_driver.cc:464] REPLICATION: finished
0928 20:03:01.115069 (+ 44836us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:01.150141 (+ 35072us) log.cc:844] Serialized 5 byte log entry
0928 20:03:01.285082 (+134941us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.316449 (+ 31367us) log.cc:844] Serialized 14 byte log entry
0928 20:03:01.317392 (+ 943us) alter_schema_op.cc:73] Released schema lock
0928 20:03:01.318158 (+ 766us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7932,"prepare.queue_time_us":514747,"prepare.run_cpu_time_us":11183,"prepare.run_wall_time_us":446736,"raft.queue_time_us":162,"raft.run_cpu_time_us":1445,"raft.run_wall_time_us":1444,"replication_time_us":2451742,"spinlock_wait_cycles":156160,"thread_start_us":879327,"threads_started":4,"wal-append.queue_time_us":425488,"wal-append.run_cpu_time_us":1440,"wal-append.run_wall_time_us":1004840}]]}
I20260928 20:03:01.394960 28388 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
W20260928 20:03:01.405418 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 149614us
I20260928 20:03:01.405648 28385 consensus_queue.cc:1048] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:01.406252 26740 leader_election.cc:304] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:01.407433 28385 raft_consensus.cc:2749] T 8147a650aa614b2fb0af08077e60ddc8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:01.421113 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.422207 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.422467 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.423002 26790 raft_consensus.cc:2393] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:01.421855 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.326056 28358 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:01.439277 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd2204d99e14a07af962295b152d60f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:01.439896 26796 raft_consensus.cc:3060] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:01.447665 26796 raft_consensus.cc:2468] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:01.449541 28030 raft_consensus.cc:2243] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:01.450379 28030 raft_consensus.cc:2272] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:01.454254 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.455735 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0cbde5f5dc4ff6a046b16b1e2b9786" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:01.456226 26790 raft_consensus.cc:3060] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:01.457902 28370 raft_consensus.cc:493] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:01.458370 28370 raft_consensus.cc:515] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:01.460201 28370 leader_election.cc:290] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:01.462196 28370 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:01.462656 28370 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:01.462929 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385278bf2df34f4f960a0cfdebd79be5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.464550 28370 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:01.465029 26790 raft_consensus.cc:2468] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:01.466316 28233 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Append to log took a long time: real 0.080s user 0.002s sys 0.000s
I20260928 20:03:01.471581 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 3 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:01.472158 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.472324 27924 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd517ada41af42d8b8d85ba1e657e003 in term 2.
I20260928 20:03:01.474257 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003; no voters:
I20260928 20:03:01.477360 28388 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:03:01.477689 28388 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:01.478046 28388 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:01.128511 28379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
W20260928 20:03:01.232188 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e1d6dcd913394d4ca2e4b9f5be5ea069 consensus state has no leader
I20260928 20:03:01.481784 28379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:03:01.483539 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 3 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
I20260928 20:03:01.491252 28387 tablet.cc:1751] T ef3e590ceb1345da99e67e5fa627fa9f P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:01.496171 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet ee4c267b42754dbca8eb5ebec2d66a23 (table default.Table_8b11a40dd3f14c58ba9ea4e903c7f9d0 [id=899ddfb9d42b4edab7acc6c374382cce]) successfully deleted
I20260928 20:03:01.498888 26777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41770 (request call id 499) took 1505 ms. Trace:
I20260928 20:03:01.499269 26777 rpcz_store.cc:276] 0928 20:02:59.636786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.011553 (+374767us) service_pool.cc:224] Handling call
0928 20:03:00.147812 (+136259us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5800000f98. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0cf96ec881 00007f0cf9830ba1 00007f0cf9830a52 00007f0d027811c9 00007f0d019bad70 00007f0d01aa1521 00007f0d01a7d523 00007f0d01a2b9b0 00007f0cfffb2bf4 00007f0cfffb2b82 00007f0cfffb2ab1
0928 20:03:00.147931 (+ 119us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.148008 (+ 77us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.827796 (+679788us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.141304 (+313508us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.141663 (+ 359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308778240}
I20260928 20:03:01.513571 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626a876a51d04095b5dd54726bb995f3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.494042 28388 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:01.518450 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a616a7dbd8e4a99bc133f2bd61a4808" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.519315 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.526443 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 3 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1"
I20260928 20:03:01.527580 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:01.535261 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 1edf314241784091a603907a43429b28 (table default.Table_63e2c04c6cdc43a8a911b566a6ec7a78 [id=b39c31256b914e41bdb078ad90d6506b]) successfully deleted
I20260928 20:03:01.543437 28388 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 election: Requested vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:01.543948 27923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 3 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63"
I20260928 20:03:01.546366 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:03:01.547245 28388 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260928 20:03:01.550588 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.551327 26515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 371) took 1027 ms. Trace:
I20260928 20:03:01.569769 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.569969 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.569890 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.569710 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.572162 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:01.572774 26516 raft_consensus.cc:3060] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:00.982242 26594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:01.574216 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.572413 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:01.575542 26594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:01.578431 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.580184 28030 ts_tablet_manager.cc:1962] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:01.581635 26595 leader_election.cc:304] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:01.482527 28358 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:01.591212 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:01.596616 28392 log.cc:927] Time spent T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260928 20:03:01.604142 28357 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:01.608487 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:01.611604 28358 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:01.606320 28321 consensus_meta.cc:287] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.743s user 0.011s sys 0.000s
I20260928 20:03:01.612385 28321 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.612066 28344 tablet.cc:1751] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:01.614202 28321 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:01.618410 26513 raft_consensus.cc:2393] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:01.635492 26624 tablet_service.cc:1558] Processing DeleteTablet for tablet ed48087b59c744f9a928c8d529b69211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:59 UTC) from {username='slave'} at 127.0.0.1:53864
W20260928 20:03:01.578598 26450 leader_election.cc:343] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:01.636901 26624 tablet_service.cc:1558] Processing DeleteTablet for tablet a86e8a782b3e46d09a45bbb7025546af with delete_type TABLET_DATA_DELETED (replaced by tablet 8a3021bc9be24874a6ebee01dfb6d7fa) from {username='slave'} at 127.0.0.1:53864
W20260928 20:03:01.637225 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 58668.6us
I20260928 20:03:01.637843 26624 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd2204d99e14a07af962295b152d60f with delete_type TABLET_DATA_DELETED (replaced by tablet e8de132c03884597a311898f4d427bb1) from {username='slave'} at 127.0.0.1:53864
I20260928 20:03:01.638697 26624 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0cbde5f5dc4ff6a046b16b1e2b9786 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:43 UTC) from {username='slave'} at 127.0.0.1:53864
I20260928 20:03:01.639395 26621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f337138bc84030a3edf1ec1248d456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.640188 26624 tablet_service.cc:1511] Processing CreateTablet for tablet cc643a95793d4797afb8889fcb54ef41 (DEFAULT_TABLE table=default.Table_92cd775d03ce43259e1527778a376855 [id=3bc1c712116e4b1bae264afc0f8030ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.641829 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:01.647372 28233 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Append to log took a long time: real 0.110s user 0.001s sys 0.000s
W20260928 20:03:01.654542 26627 consensus_meta.cc:287] T 807f3ef3db0f4319801baf86a331b98d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.603s user 0.000s sys 0.008s
I20260928 20:03:01.666347 26777 tablet_service.cc:1511] Processing CreateTablet for tablet a8909dfef9034dcc8e899fac6ae5d8f1 (DEFAULT_TABLE table=default.Table_7cf3f31c382c41328b3bc3b015ec4320 [id=880148005f7949888ad9308950ae5b32]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:03:01.668169 26450 leader_election.cc:343] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:01.691820 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8909dfef9034dcc8e899fac6ae5d8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.693594 26912 tablet_bootstrap.cc:654] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:01.726128 26169 raft_consensus.cc:1240] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Rejecting Update request from peer 5308dad1e3384995a990de7c4866f1b1 for earlier term 2. Current term is 3. Ops: [2.620-2.620]
I20260928 20:03:01.736479 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.740933 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.742690 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7242f71b93914dbeadb60617b3f2be3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.729334 28379 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 }, Status: INVALID_TERM, Last received: 2.619, Next index: 620, Last known committed idx: 619, Time since last communication: 0.001s
I20260928 20:03:01.745296 28379 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 20:03:01.745638 28379 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5308dad1e3384995a990de7c4866f1b1, State: Running, Role: LEADER
I20260928 20:03:01.746450 28379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 619, Committed index: 619, Last appended: 2.620, Last appended by leader: 620, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:01.747648 28379 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:01.749828 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed48087b59c744f9a928c8d529b69211" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.753229 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef3e590ceb1345da99e67e5fa627fa9f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.753633 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.754983 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626a876a51d04095b5dd54726bb995f3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.755242 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.760013 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718a2abfe21b4a2986b77e14e4e52152" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.765120 28030 ts_tablet_manager.cc:1975] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:03:01.765635 28030 log.cc:1199] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/ee464b814dbf4e4b89b2d1c019befac6
I20260928 20:03:01.766489 28030 ts_tablet_manager.cc:1996] T ee464b814dbf4e4b89b2d1c019befac6 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:01.768620 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 362) took 9126 ms. Trace:
I20260928 20:03:01.771579 26647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de800a9344d4507b7903d08fcf8e988" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.753621 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.783077 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c37ee6dd0e14f038c557985ab4c5b0b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.783293 28240 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:01.783951 28240 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.785604 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d016129c3a140518cf310089360c7b7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.749706 28306 raft_consensus.cc:2764] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260928 20:03:01.788172 26222 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 252908us
I20260928 20:03:01.790208 26912 tablet_bootstrap.cc:492] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:01.790695 26912 ts_tablet_manager.cc:1449] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 1.717s user 0.012s sys 0.006s
I20260928 20:03:01.793085 26912 raft_consensus.cc:359] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.793694 26912 raft_consensus.cc:385] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:01.671787 26512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 374) took 1191 ms. Trace:
I20260928 20:03:01.798069 26512 rpcz_store.cc:276] 0928 20:03:00.415966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.419622 (+ 3656us) service_pool.cc:224] Handling call
0928 20:03:00.419973 (+ 351us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 20:03:00.420236 (+ 263us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 20:03:00.420262 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 20:03:00.427811 (+ 7549us) alter_schema_op.cc:128] START. Timestamp: 1790625779679193
0928 20:03:01.346915 (+919104us) log.cc:844] Serialized 173 byte log entry
0928 20:03:01.438617 (+ 91702us) raft_consensus.cc:1645] Marking committed up to 2
0928 20:03:01.438653 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 20:03:01.438726 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 20:03:01.607406 (+168680us) raft_consensus.cc:1685] finished
0928 20:03:01.607424 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 20:03:01.607553 (+ 129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:01.182603 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:01.187484 (+ 4881us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:01.187528 (+ 44us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:01.187572 (+ 44us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"thread_start_us":91399,"threads_started":1,"wal-append.queue_time_us":210533,"child_traces":[["op",{"prepare.queue_time_us":629510,"prepare.run_cpu_time_us":706,"prepare.run_wall_time_us":10864,"thread_start_us":834245,"threads_started":1}]]}
I20260928 20:03:01.682204 26516 raft_consensus.cc:2468] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:01.787544 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.607102 28357 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:03:01.765745 26481 consensus_meta.cc:287] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.504s user 0.008s sys 0.001s
I20260928 20:03:01.801417 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.778297 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 373) took 1207 ms. Trace:
I20260928 20:03:01.551719 26515 rpcz_store.cc:276] 0928 20:03:00.414779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.418793 (+ 4014us) service_pool.cc:224] Handling call
0928 20:03:00.861731 (+442938us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866ea52 00007f65515bf1c9 00007f65507f8d70 00007f65508c1b0b 00007f65508c1b91 00007f65508838e0 00007f655086ded9 00007f655086d982 00007f654eee6d34
0928 20:03:00.861916 (+ 185us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 20:03:00.896205 (+ 34289us) raft_consensus.cc:1534] Early marking committed up to index 1
0928 20:03:01.410538 (+514333us) log.cc:844] Serialized 14 byte log entry
0928 20:03:01.419436 (+ 8898us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 20:03:01.419734 (+ 298us) alter_schema_op.cc:128] START. Timestamp: 1790625777045414
0928 20:03:01.420422 (+ 688us) log.cc:844] Serialized 173 byte log entry
0928 20:03:01.420551 (+ 129us) raft_consensus.cc:1645] Marking committed up to 2
0928 20:03:01.420779 (+ 228us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 20:03:01.420953 (+ 174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 20:03:01.424964 (+ 4011us) raft_consensus.cc:1685] finished
0928 20:03:01.424991 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 20:03:01.425113 (+ 122us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:01.420735 (+ 0us) op_driver.cc:464] REPLICATION: finished
0928 20:03:01.424534 (+ 3799us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:01.424993 (+ 459us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:01.425023 (+ 30us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:01.425106 (+ 83us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
Metrics: {"prepare.queue_time_us":298333,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":100,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"spinlock_wait_cycles":4995456,"thread_start_us":400093,"threads_started":2,"wal-append.queue_time_us":2404,"child_traces":[["op",{"prepare.queue_time_us":4510,"replication_time_us":897,"threads_started":1}]]}
I20260928 20:03:01.802884 26507 rpcz_store.cc:276] 0928 20:03:00.415578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.420638 (+ 5060us) service_pool.cc:224] Handling call
0928 20:03:00.464270 (+ 43632us) raft_consensus.cc:1471] Updating replica for 0 ops
0928 20:03:00.510871 (+ 46601us) raft_consensus.cc:1534] Early marking committed up to index 1
0928 20:03:01.118184 (+607313us) log.cc:844] Serialized 14 byte log entry
0928 20:03:01.574781 (+456597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0928 20:03:01.576155 (+ 1374us) raft_consensus.cc:1645] Marking committed up to 1
0928 20:03:01.583759 (+ 7604us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 20:03:01.589881 (+ 6122us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 20:03:01.607634 (+ 17753us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":655483,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":26942,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":14987,"thread_start_us":756156,"threads_started":2,"wal-append.queue_time_us":394159}
I20260928 20:03:01.807408 26916 tablet_bootstrap.cc:492] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:01.808036 26916 ts_tablet_manager.cc:1449] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 1.327s user 0.065s sys 0.062s
I20260928 20:03:01.810976 26916 raft_consensus.cc:359] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.811764 26916 raft_consensus.cc:385] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:01.812114 26916 raft_consensus.cc:740] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:01.813052 26916 consensus_queue.cc:260] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:01.816071 26620 consensus_meta.cc:287] T 029a15ae85ff48d897493156fdd41d3b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.816s user 0.003s sys 0.013s
I20260928 20:03:01.817761 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6b825af9d04df38aebbb056f174ef7 (DEFAULT_TABLE table=default.Table_3697e383390b4709b95e01cb55f17c34 [id=23a824778def463ebc96837ae1766677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.818353 26450 leader_election.cc:304] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:01.818845 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b825af9d04df38aebbb056f174ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.769030 28030 rpcz_store.cc:276] 0928 20:02:52.642068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.642388 (+ 320us) service_pool.cc:224] Handling call
0928 20:03:01.075682 (+8433294us) ts_tablet_manager.cc:1197] Deleting tablet ee464b814dbf4e4b89b2d1c019befac6
0928 20:03:01.075741 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:01.601045 (+525304us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.665356 (+ 64311us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.768557 (+103201us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8432873}
I20260928 20:03:01.822817 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 03d9d379b2e647d1a020406acc54bc75 (DEFAULT_TABLE table=default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.823174 28030 tablet_replica.cc:333] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:01.823808 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9d379b2e647d1a020406acc54bc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.802426 28240 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:01.826628 26632 consensus_meta.cc:287] T 95dfce3de1374f7a8c02c6898f6a741c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.819s user 0.010s sys 0.001s
I20260928 20:03:01.826864 26784 tablet_service.cc:1511] Processing CreateTablet for tablet d046e04498494659a96139f051e7bbc9 (DEFAULT_TABLE table=default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 [id=c4fd9da4958c44e19d97f5fb4d1ef9d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.827910 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d046e04498494659a96139f051e7bbc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:01.827797 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 246454us
I20260928 20:03:01.830873 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 9536760eb5114f23acac2918a0cd28bd (DEFAULT_TABLE table=default.Table_850721f396e049e48b48b6a6636ff076 [id=75699f46194e46278a2fa055683b658f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.831923 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9536760eb5114f23acac2918a0cd28bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.803381 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.842407 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.845144 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01533b61bad74ddb9056aeacef13a126" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:01.845788 26656 raft_consensus.cc:3060] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 2
I20260928 20:03:01.849120 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:01.850550 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1284d1f7fa774033b90133447627df4f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:01.830017 26595 consensus_peers.cc:597] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:01.853960 26595 leader_election.cc:343] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4cd2204d99e14a07af962295b152d60f
I20260928 20:03:01.854888 26490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faefa3535ee54987b76cc6782b988c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.855376 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:01.856022 26648 raft_consensus.cc:3060] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:01.864471 26495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 468) took 2666 ms. Trace:
I20260928 20:03:01.864820 26495 rpcz_store.cc:276] 0928 20:02:59.198320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.439034 (+240714us) service_pool.cc:224] Handling call
0928 20:02:59.514123 (+ 75089us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.514228 (+ 105us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.172421 (+658193us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.979184 (+806763us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.864411 (+885227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.865649 26483 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 474) took 2665 ms. Trace:
I20260928 20:03:01.866307 26491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 482) took 2664 ms. Trace:
I20260928 20:03:01.866587 26491 rpcz_store.cc:276] 0928 20:02:59.202318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.254920 (+1052602us) service_pool.cc:224] Handling call
0928 20:03:00.286964 (+ 32044us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.287040 (+ 76us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.049503 (+762463us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.065921 (+ 16418us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.866257 (+800336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.868939 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8536f4a4a0904806b71d4e7bf20c6bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.869455 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf943cffdd440caa2978769faed7f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.865948 26483 rpcz_store.cc:276] 0928 20:02:59.199961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.362585 (+162624us) service_pool.cc:224] Handling call
0928 20:02:59.363918 (+ 1333us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.363987 (+ 69us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.277808 (+913821us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.919849 (+642041us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.865599 (+945750us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:01.739959 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 161626us
I20260928 20:03:01.875344 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 401) took 6801 ms. Trace:
I20260928 20:03:01.875658 27857 rpcz_store.cc:276] 0928 20:02:55.073971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.074062 (+ 91us) service_pool.cc:224] Handling call
0928 20:02:59.231439 (+4157377us) ts_tablet_manager.cc:1197] Deleting tablet 0a2d13d16d9946c6b09f9197c165033c
0928 20:02:59.231489 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:00.112515 (+881026us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.535258 (+422743us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.875284 (+1340026us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4028215}
I20260928 20:03:01.881134 26477 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 479) took 2679 ms. Trace:
I20260928 20:03:01.881479 26477 rpcz_store.cc:276] 0928 20:02:59.201597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.123360 (+921763us) service_pool.cc:224] Handling call
0928 20:03:00.124631 (+ 1271us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.124707 (+ 76us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.173807 (+1049100us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.388107 (+214300us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.881079 (+492972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.883003 26647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.886483 26480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.888713 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b8e89ff26a439c8f6d7784cd179698" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.889120 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.889705 26485 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 475) took 2689 ms. Trace:
I20260928 20:03:01.890362 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.890085 26485 rpcz_store.cc:276] 0928 20:02:59.200212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.904313 (+704101us) service_pool.cc:224] Handling call
0928 20:02:59.905718 (+ 1405us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.905800 (+ 82us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.525482 (+619682us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.283216 (+757734us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.889640 (+606424us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:01.892529 26622 consensus_meta.cc:287] T 2a5ef01e0dbd49398b27911a713626cd P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent flushing consensus metadata: real 0.826s user 0.012s sys 0.004s
I20260928 20:03:01.894586 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:03:01.895740 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 29c54767c86649b599ef539765d2b2dd (DEFAULT_TABLE table=default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.896747 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c54767c86649b599ef539765d2b2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.899780 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6d3f0467684127af0fcaa3ddac3fdd (DEFAULT_TABLE table=default.Table_66f34d73b85d4af58844cc7ea97a7866 [id=7915573b0b384fb693d6bdafe1bb095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.900702 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6d3f0467684127af0fcaa3ddac3fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.903267 26483 tablet_service.cc:1511] Processing CreateTablet for tablet 2034cd490bd14992aa2572f31d2ff63b (DEFAULT_TABLE table=default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.904207 26483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2034cd490bd14992aa2572f31d2ff63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.905023 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e86d2d680c545e0b0511dec35ba6c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:01.907013 26594 leader_election.cc:304] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:01.907598 27857 tablet_replica.cc:333] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:01.909157 26477 tablet_service.cc:1558] Processing DeleteTablet for tablet ed48087b59c744f9a928c8d529b69211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:59 UTC) from {username='slave'} at 127.0.0.1:36268
I20260928 20:03:01.910396 26477 tablet_service.cc:1511] Processing CreateTablet for tablet cc643a95793d4797afb8889fcb54ef41 (DEFAULT_TABLE table=default.Table_92cd775d03ce43259e1527778a376855 [id=3bc1c712116e4b1bae264afc0f8030ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.910426 26623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 456) took 3227 ms. Trace:
I20260928 20:03:01.911455 26477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc643a95793d4797afb8889fcb54ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.910931 26623 rpcz_store.cc:276] 0928 20:02:58.690628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.960163 (+269535us) service_pool.cc:224] Handling call
0928 20:02:59.450964 (+490801us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.451066 (+ 102us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.654256 (+1203190us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.754062 (+ 99806us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.635209 (+881147us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:01.910212 (+275003us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3374,"spinlock_wait_cycles":12514304}
I20260928 20:03:01.913427 26623 tablet_service.cc:1511] Processing CreateTablet for tablet f32d0e469bac4306b719d26290570bf0 (DEFAULT_TABLE table=default.Table_1d04da9e1ce749aaafdc63f86a11535e [id=aa9d03a4e0a840659761ea54cbb4519f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.914216 26485 tablet_service.cc:1511] Processing CreateTablet for tablet f32d0e469bac4306b719d26290570bf0 (DEFAULT_TABLE table=default.Table_1d04da9e1ce749aaafdc63f86a11535e [id=aa9d03a4e0a840659761ea54cbb4519f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.914650 26624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc643a95793d4797afb8889fcb54ef41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.915278 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32d0e469bac4306b719d26290570bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.923033 26631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 469) took 3229 ms. Trace:
I20260928 20:03:01.923519 26631 rpcz_store.cc:276] 0928 20:02:58.693760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.786859 (+1093099us) service_pool.cc:224] Handling call
0928 20:03:00.655593 (+868734us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58cda52 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:00.677538 (+ 21945us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.677640 (+ 102us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.955931 (+278291us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.040067 (+ 84136us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.922820 (+882753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032712960}
I20260928 20:03:01.924608 26633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 489) took 1325 ms. Trace:
I20260928 20:03:01.924728 26634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 478) took 2961 ms. Trace:
I20260928 20:03:01.924938 26633 rpcz_store.cc:276] 0928 20:03:00.599521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.991466 (+391945us) service_pool.cc:224] Handling call
0928 20:03:01.057582 (+ 66116us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.057669 (+ 87us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.094827 (+ 37158us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.123434 (+ 28607us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.924405 (+800971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.925004 26634 rpcz_store.cc:276] 0928 20:02:58.962768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.339302 (+1376534us) service_pool.cc:224] Handling call
0928 20:03:00.578730 (+239428us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.578832 (+ 102us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.764220 (+185388us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:00.971090 (+206870us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.142496 (+171406us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:01.924551 (+782055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5931,"spinlock_wait_cycles":23091584}
I20260928 20:03:01.925777 26631 tablet_service.cc:1511] Processing CreateTablet for tablet a8909dfef9034dcc8e899fac6ae5d8f1 (DEFAULT_TABLE table=default.Table_7cf3f31c382c41328b3bc3b015ec4320 [id=880148005f7949888ad9308950ae5b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.926513 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 42cf8cc998fb4039897ca93158c2202a (DEFAULT_TABLE table=default.Table_53c689bd6dc0475da06ec57192aaa587 [id=d739d9bcee244c8db96567e6cbc0fdc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.928207 26625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2034cd490bd14992aa2572f31d2ff63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.928179 26489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 484) took 2688 ms. Trace:
I20260928 20:03:01.928408 28401 raft_consensus.cc:2804] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:01.928505 26489 rpcz_store.cc:276] 0928 20:02:59.240066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.262878 (+1022812us) service_pool.cc:224] Handling call
0928 20:03:00.280882 (+ 18004us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.280987 (+ 105us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.358767 (+1077780us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.481199 (+122432us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.928113 (+446914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.928905 28401 raft_consensus.cc:697] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:01.929876 26489 tablet_service.cc:1511] Processing CreateTablet for tablet 42cf8cc998fb4039897ca93158c2202a (DEFAULT_TABLE table=default.Table_53c689bd6dc0475da06ec57192aaa587 [id=d739d9bcee244c8db96567e6cbc0fdc4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:03:01.923848 26595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:01.926529 26634 tablet_service.cc:1511] Processing CreateTablet for tablet 25595d85d1ad4ac7a80db4c55cd9c86f (DEFAULT_TABLE table=default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.929798 28401 consensus_queue.cc:237] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.955245 26635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 475) took 2993 ms. Trace:
I20260928 20:03:01.955607 26635 rpcz_store.cc:276] 0928 20:02:58.961999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.042446 (+1080447us) service_pool.cc:224] Handling call
0928 20:03:00.340012 (+297566us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.340772 (+ 760us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.081274 (+740502us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.179081 (+ 97807us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.954731 (+775650us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58ce2e8 00007f5df58ce20b 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:01.955076 (+ 345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54633216}
I20260928 20:03:01.957427 26635 tablet_service.cc:1511] Processing CreateTablet for tablet 29c54767c86649b599ef539765d2b2dd (DEFAULT_TABLE table=default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.793938 26912 raft_consensus.cc:740] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:01.970446 26489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cf8cc998fb4039897ca93158c2202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:01.972211 26488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 490) took 2661 ms. Trace:
I20260928 20:03:01.982942 26637 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 488) took 1385 ms. Trace:
I20260928 20:03:01.983225 26621 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 483) took 3019 ms. Trace:
I20260928 20:03:01.983408 26594 leader_election.cc:304] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:01.983376 26637 rpcz_store.cc:276] 0928 20:03:00.596954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.957578 (+360624us) service_pool.cc:224] Handling call
0928 20:03:01.015837 (+ 58259us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.015920 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.075211 (+ 59291us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.168357 (+ 93146us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.982756 (+814399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.986789 26594 leader_election.cc:304] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:01.987504 26637 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6b825af9d04df38aebbb056f174ef7 (DEFAULT_TABLE table=default.Table_3697e383390b4709b95e01cb55f17c34 [id=23a824778def463ebc96837ae1766677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.988824 26638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 472) took 3027 ms. Trace:
I20260928 20:03:01.989056 28306 raft_consensus.cc:2804] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:01.989188 26638 rpcz_store.cc:276] 0928 20:02:58.961261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.799833 (+838572us) service_pool.cc:224] Handling call
0928 20:03:00.117780 (+317947us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.117850 (+ 70us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.309224 (+191374us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.098645 (+789421us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.988617 (+889972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.989647 28306 raft_consensus.cc:697] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:01.989831 28298 raft_consensus.cc:2749] T 1d016129c3a140518cf310089360c7b7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:01.990794 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 03d9d379b2e647d1a020406acc54bc75 (DEFAULT_TABLE table=default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:01.990675 28306 consensus_queue.cc:237] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:01.957891 26656 raft_consensus.cc:2468] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:01.972604 26488 rpcz_store.cc:276] 0928 20:02:59.310350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.863528 (+1553178us) service_pool.cc:224] Handling call
0928 20:03:01.101697 (+238169us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.148506 (+ 46809us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.624737 (+476231us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.672805 (+ 48068us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.972155 (+299350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:01.997380 26639 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 465) took 3304 ms. Trace:
I20260928 20:03:01.997695 26639 rpcz_store.cc:276] 0928 20:02:58.692843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.730116 (+1037273us) service_pool.cc:224] Handling call
0928 20:03:00.159303 (+429187us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58cda52 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:00.159416 (+ 113us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.159497 (+ 81us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.572219 (+412722us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.013042 (+440823us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.997210 (+984168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140701568}
W20260928 20:03:02.005568 28233 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Append to log took a long time: real 0.356s user 0.000s sys 0.003s
I20260928 20:03:02.008805 26912 consensus_queue.cc:260] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.010385 26630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 482) took 3046 ms. Trace:
I20260928 20:03:02.010833 26913 tablet_bootstrap.cc:492] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:02.010759 26630 rpcz_store.cc:276] 0928 20:02:58.963838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.981870 (+1018032us) service_pool.cc:224] Handling call
0928 20:02:59.990678 (+ 8808us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.990750 (+ 72us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.771378 (+780628us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.105522 (+334144us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.010164 (+904642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.011662 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 368) took 8625 ms. Trace:
I20260928 20:03:02.012351 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 9536760eb5114f23acac2918a0cd28bd (DEFAULT_TABLE table=default.Table_850721f396e049e48b48b6a6636ff076 [id=75699f46194e46278a2fa055683b658f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.013340 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9536760eb5114f23acac2918a0cd28bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.013477 26912 ts_tablet_manager.cc:1480] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.222s user 0.004s sys 0.002s
I20260928 20:03:02.011972 28059 rpcz_store.cc:276] 0928 20:02:53.426726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.427021 (+ 295us) service_pool.cc:224] Handling call
0928 20:03:00.923495 (+7496474us) ts_tablet_manager.cc:1197] Deleting tablet 4b91a573103c4c2d995abde8db91b821
0928 20:03:01.072203 (+148708us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e6f9 00007f5dfdb1ecf3 00007f5dfdb51080 00007f5dfdb374ad 00007f5dfdb37459 00007f5dfdb373e9
0928 20:03:01.072272 (+ 69us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:01.193779 (+121507us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.258938 (+ 65159us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.011466 (+752528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9295,"spinlock_wait_cycles":3597568,"tablet-delete.queue_time_us":7495917}
I20260928 20:03:01.996259 26488 tablet_service.cc:1511] Processing CreateTablet for tablet 25595d85d1ad4ac7a80db4c55cd9c86f (DEFAULT_TABLE table=default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.018374 26912 tablet_bootstrap.cc:492] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:02.020409 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 80d7ab92a37c4f9b865fa9fe49d46916 (table default.Table_afc7904735e94895aa832ee117628bac [id=15aa9f1d18a24b75b9d5c43329d8ddd9]) successfully deleted
I20260928 20:03:01.999409 26639 tablet_service.cc:1511] Processing CreateTablet for tablet d046e04498494659a96139f051e7bbc9 (DEFAULT_TABLE table=default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 [id=c4fd9da4958c44e19d97f5fb4d1ef9d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.025483 28405 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:02.026146 26629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6d3f0467684127af0fcaa3ddac3fdd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:02.001937 26739 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.036801 26740 leader_election.cc:343] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f
I20260928 20:03:02.037295 26740 leader_election.cc:304] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:02.044245 26620 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 477) took 3081 ms. Trace:
I20260928 20:03:02.044787 26620 rpcz_store.cc:276] 0928 20:02:58.962480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.134859 (+1172379us) service_pool.cc:224] Handling call
0928 20:03:00.548630 (+413771us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.555360 (+ 6730us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.999177 (+443817us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.816693 (+817516us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.888173 (+ 71480us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.044162 (+155989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51292032}
I20260928 20:03:02.046545 26622 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 480) took 3083 ms. Trace:
I20260928 20:03:02.046917 26622 rpcz_store.cc:276] 0928 20:02:58.963317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.688205 (+1724888us) service_pool.cc:224] Handling call
0928 20:03:00.689562 (+ 1357us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.689656 (+ 94us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.065713 (+376057us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.893082 (+827369us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.046482 (+153400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.048306 26626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 481) took 3084 ms. Trace:
I20260928 20:03:02.048657 26626 rpcz_store.cc:276] 0928 20:02:58.963562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.745746 (+1782184us) service_pool.cc:224] Handling call
0928 20:03:01.036886 (+291140us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.057534 (+ 20648us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.652776 (+595242us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.816876 (+164100us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.903946 (+ 87070us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.048128 (+144182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45378432}
I20260928 20:03:02.050401 26635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c54767c86649b599ef539765d2b2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.050478 26627 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 471) took 3099 ms. Trace:
I20260928 20:03:02.050905 26627 rpcz_store.cc:276] 0928 20:02:58.951113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.980182 (+1029069us) service_pool.cc:224] Handling call
0928 20:03:00.565789 (+585607us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.575843 (+ 10054us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.051259 (+475416us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.817334 (+766075us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.884884 (+ 67550us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.050413 (+165529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42149760}
I20260928 20:03:02.053613 26632 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 468) took 3360 ms. Trace:
I20260928 20:03:02.053930 26632 rpcz_store.cc:276] 0928 20:02:58.693539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.734428 (+1040889us) service_pool.cc:224] Handling call
0928 20:03:00.160372 (+425944us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58cda52 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:00.161161 (+ 789us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.161246 (+ 85us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.006777 (+845531us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.827156 (+820379us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.884399 (+ 57243us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.053551 (+169152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191646848}
I20260928 20:03:02.054836 26636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 490) took 1453 ms. Trace:
I20260928 20:03:02.055140 26636 rpcz_store.cc:276] 0928 20:03:00.601081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.032091 (+431010us) service_pool.cc:224] Handling call
0928 20:03:01.058892 (+ 26801us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.059013 (+ 121us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.274277 (+215264us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.349283 (+ 75006us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.054645 (+705362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.056226 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 369) took 8627 ms. Trace:
I20260928 20:03:02.056617 26623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32d0e469bac4306b719d26290570bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.056540 28059 rpcz_store.cc:276] 0928 20:02:53.428455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.430764 (+ 2309us) service_pool.cc:224] Handling call
0928 20:03:02.055782 (+8625018us) ts_tablet_manager.cc:1197] Deleting tablet b97ad3f841f54aa38bbb312c50db384e
0928 20:03:02.055860 (+ 78us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.056172 (+ 312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8624478}
I20260928 20:03:02.057832 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 372) took 7626 ms. Trace:
I20260928 20:03:02.052452 26648 raft_consensus.cc:2468] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:02.058634 26479 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 485) took 2818 ms. Trace:
I20260928 20:03:02.058995 26479 rpcz_store.cc:276] 0928 20:02:59.240336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.279445 (+1039109us) service_pool.cc:224] Handling call
0928 20:03:00.280658 (+ 1213us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.280736 (+ 78us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.549582 (+1268846us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.768715 (+219133us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.058568 (+289853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.060631 26479 tablet_service.cc:1511] Processing CreateTablet for tablet a8909dfef9034dcc8e899fac6ae5d8f1 (DEFAULT_TABLE table=default.Table_7cf3f31c382c41328b3bc3b015ec4320 [id=880148005f7949888ad9308950ae5b32]), partition=RANGE (key) PARTITION UNBOUNDED
W20260928 20:03:02.063441 26478 consensus_meta.cc:287] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.829s user 0.003s sys 0.005s
I20260928 20:03:02.063400 28059 rpcz_store.cc:276] 0928 20:02:54.431863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.431964 (+ 101us) service_pool.cc:224] Handling call
0928 20:03:02.057410 (+7625446us) ts_tablet_manager.cc:1197] Deleting tablet f478cce587a548e1aab620721c3bb1c1
0928 20:03:02.057460 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.057759 (+ 299us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7624897}
I20260928 20:03:02.064081 28030 raft_consensus.cc:2243] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:02.065907 28417 tablet.cc:1751] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260928 20:03:02.073436 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 405274us
W20260928 20:03:02.074259 26450 leader_election.cc:343] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.074739 26450 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.067410 28030 raft_consensus.cc:2272] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:02.071262 26739 leader_election.cc:304] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:02.080735 26448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:01.983626 26621 rpcz_store.cc:276] 0928 20:02:58.964081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.754677 (+1790596us) service_pool.cc:224] Handling call
0928 20:03:01.074647 (+319970us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.638548 (+563901us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.899048 (+260500us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.982666 (+ 83618us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.983148 (+ 482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.072263 26913 tablet_bootstrap.cc:654] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.085821 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 0a2d13d16d9946c6b09f9197c165033c (table default.Table_0db7c57c88674a57b2c4faceaa98eb1e [id=17447ae0353e48e3b1fb75ff64ada358]) successfully deleted
I20260928 20:03:02.087601 27857 raft_consensus.cc:2243] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:02.080394 28047 raft_consensus.cc:2706] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Received pre-election callback for term 2 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260928 20:03:02.080513 26628 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 491) took 1374 ms. Trace:
I20260928 20:03:02.091512 26487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 478) took 2890 ms. Trace:
I20260928 20:03:02.091367 26594 leader_election.cc:304] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.091506 26628 rpcz_store.cc:276] 0928 20:03:00.652511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.063122 (+410611us) service_pool.cc:224] Handling call
0928 20:03:01.064468 (+ 1346us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.064547 (+ 79us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.822604 (+758057us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.937951 (+115347us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.956655 (+ 18704us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.027227 (+ 70572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30869376}
I20260928 20:03:02.092674 26492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 488) took 2782 ms. Trace:
I20260928 20:03:02.093000 26492 rpcz_store.cc:276] 0928 20:02:59.309802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.481574 (+1171772us) service_pool.cc:224] Handling call
0928 20:03:00.906897 (+425323us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.907003 (+ 106us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.111312 (+204309us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.138907 (+ 27595us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.830659 (+691752us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866f1d2 00007f65515e8379 00007f65507f8c18 00007f65508bf3d3 00007f65508bb16f 00007f65508bb92d 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82
0928 20:03:02.092618 (+261959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662961408}
I20260928 20:03:02.096097 28047 raft_consensus.cc:2804] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:02.096477 28047 raft_consensus.cc:697] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:02.096601 28402 raft_consensus.cc:2749] T 8a616a7dbd8e4a99bc133f2bd61a4808 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.091814 26487 rpcz_store.cc:276] 0928 20:02:59.201347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.031684 (+830337us) service_pool.cc:224] Handling call
0928 20:03:00.033162 (+ 1478us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.033245 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.806852 (+773607us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.136741 (+329889us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.823488 (+686747us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866f1d2 00007f65515e8379 00007f65507f8c18 00007f65508bf3d3 00007f65508bb16f 00007f65508bb92d 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82
0928 20:03:02.091457 (+267969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564198784}
I20260928 20:03:02.097184 28047 consensus_queue.cc:237] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.098268 26487 tablet_service.cc:1511] Processing CreateTablet for tablet 03d9d379b2e647d1a020406acc54bc75 (DEFAULT_TABLE table=default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.099466 28030 ts_tablet_manager.cc:1962] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:02.104485 26487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9d379b2e647d1a020406acc54bc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.107090 26496 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 471) took 2907 ms. Trace:
I20260928 20:03:02.107440 26496 rpcz_store.cc:276] 0928 20:02:59.199212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.659565 (+460353us) service_pool.cc:224] Handling call
0928 20:02:59.662648 (+ 3083us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:59.662899 (+ 251us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:00.814733 (+1151834us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.122913 (+308180us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:01.771884 (+648971us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866f1d2 00007f65515e8379 00007f65507f8c18 00007f65508bf3d3 00007f65508bb16f 00007f65508bb92d 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82
0928 20:03:02.107029 (+335145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6684,"spinlock_wait_cycles":560373120}
I20260928 20:03:02.108955 26496 tablet_service.cc:1511] Processing CreateTablet for tablet d046e04498494659a96139f051e7bbc9 (DEFAULT_TABLE table=default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 [id=c4fd9da4958c44e19d97f5fb4d1ef9d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.110392 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.111274 27857 raft_consensus.cc:2272] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:02.026031 28405 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.126389 26912 tablet_bootstrap.cc:654] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.133569 28405 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:02.137193 28387 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41770 (request call id 436) took 4651 ms. Trace:
I20260928 20:03:02.137634 28387 rpcz_store.cc:276] 0928 20:02:57.485537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.485811 (+ 274us) service_pool.cc:224] Handling call
0928 20:03:02.137111 (+4651300us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:57.490336 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:57.490647 (+ 311us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:57.867643 (+376996us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:57.878802 (+ 11159us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:57.878902 (+ 100us) alter_schema_op.cc:128] START. Timestamp: 1790625777868908
0928 20:02:57.878923 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:02:57.879363 (+ 440us) log.cc:844] Serialized 173 byte log entry
0928 20:03:01.246402 (+3367039us) op_driver.cc:464] REPLICATION: finished
0928 20:03:01.491023 (+244621us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:01.492507 (+ 1484us) log.cc:844] Serialized 5 byte log entry
0928 20:03:02.114262 (+621755us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.136144 (+ 21882us) log.cc:844] Serialized 14 byte log entry
0928 20:03:02.136965 (+ 821us) alter_schema_op.cc:73] Released schema lock
0928 20:03:02.136996 (+ 31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":244458,"prepare.queue_time_us":3766,"prepare.run_cpu_time_us":2793,"prepare.run_wall_time_us":389210,"replication_time_us":3367366,"thread_start_us":346934,"threads_started":2,"wal-append.queue_time_us":88672}]]}
W20260928 20:03:02.148787 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 69130.9us
I20260928 20:03:02.140398 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.156536 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6b825af9d04df38aebbb056f174ef7 (DEFAULT_TABLE table=default.Table_3697e383390b4709b95e01cb55f17c34 [id=23a824778def463ebc96837ae1766677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.089778 28353 raft_consensus.cc:2749] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.158118 28354 raft_consensus.cc:2749] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.162180 26482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 476) took 2958 ms. Trace:
I20260928 20:03:02.162626 26482 rpcz_store.cc:276] 0928 20:02:59.200500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.917113 (+716613us) service_pool.cc:224] Handling call
0928 20:03:00.276691 (+359578us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.276807 (+ 116us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.510962 (+1234155us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.672626 (+161664us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.158543 (+485917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1308}
I20260928 20:03:02.155292 26481 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 483) took 2901 ms. Trace:
I20260928 20:03:02.166322 26481 rpcz_store.cc:276] 0928 20:02:59.239770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.260352 (+1020582us) service_pool.cc:224] Handling call
0928 20:03:00.284357 (+ 24005us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.284462 (+ 105us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.261303 (+976841us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:01.801694 (+540391us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.141231 (+339537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.167869 26916 ts_tablet_manager.cc:1480] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.359s user 0.006s sys 0.001s
I20260928 20:03:02.177601 26482 tablet_service.cc:1511] Processing CreateTablet for tablet 9536760eb5114f23acac2918a0cd28bd (DEFAULT_TABLE table=default.Table_850721f396e049e48b48b6a6636ff076 [id=75699f46194e46278a2fa055683b658f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:03:02.192898 26916 tablet_bootstrap.cc:492] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:02.184623 28400 tablet.cc:1751] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:02.185637 26479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8909dfef9034dcc8e899fac6ae5d8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.195523 26482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9536760eb5114f23acac2918a0cd28bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.196174 26488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25595d85d1ad4ac7a80db4c55cd9c86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.196269 28353 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.196666 28353 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.197978 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d046e04498494659a96139f051e7bbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.200162 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b825af9d04df38aebbb056f174ef7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260928 20:03:02.205700 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 134490us
I20260928 20:03:02.215140 27857 ts_tablet_manager.cc:1962] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:03:02.222208 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 147962us
W20260928 20:03:02.222916 26450 leader_election.cc:343] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.223284 26450 leader_election.cc:304] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.223940 28321 raft_consensus.cc:2749] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.224813 26450 leader_election.cc:343] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.225221 26450 leader_election.cc:304] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.225953 28321 raft_consensus.cc:2749] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.233886 26484 consensus_meta.cc:287] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.658s user 0.002s sys 0.011s
I20260928 20:03:02.234967 26484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 486) took 2925 ms. Trace:
I20260928 20:03:02.235333 26484 rpcz_store.cc:276] 0928 20:02:59.309245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.288836 (+979591us) service_pool.cc:224] Handling call
0928 20:03:00.290140 (+ 1304us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.290224 (+ 84us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.544689 (+1254465us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.234430 (+689741us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.234899 (+ 469us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:02.243963 26486 consensus_meta.cc:287] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54: Time spent flushing consensus metadata: real 0.626s user 0.010s sys 0.001s
I20260928 20:03:02.249734 28321 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.250258 28321 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.252147 28321 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:02.265370 26739 leader_election.cc:304] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:02.250492 28387 tablet.cc:1751] T 2d90ce97d3db4bff8b2eea71c530c351 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:03:02.272698 28353 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:02.190860 26510 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.633s user 0.006s sys 0.007s
I20260928 20:03:02.191604 26478 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 477) took 2990 ms. Trace:
I20260928 20:03:02.278769 26913 tablet_bootstrap.cc:492] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:02.279314 26913 ts_tablet_manager.cc:1449] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.269s user 0.003s sys 0.013s
I20260928 20:03:02.282724 28419 raft_consensus.cc:2804] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:02.283406 28419 raft_consensus.cc:697] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:02.284490 28419 consensus_queue.cc:237] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.264163 26912 tablet_bootstrap.cc:492] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:02.289410 26912 ts_tablet_manager.cc:1449] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.271s user 0.011s sys 0.004s
I20260928 20:03:02.290095 28402 raft_consensus.cc:493] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:02.290633 28402 raft_consensus.cc:515] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.292207 26912 raft_consensus.cc:359] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.292670 28402 leader_election.cc:290] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:02.299170 26634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25595d85d1ad4ac7a80db4c55cd9c86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.302737 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cf8cc998fb4039897ca93158c2202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.306674 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d9d379b2e647d1a020406acc54bc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.308542 26637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b825af9d04df38aebbb056f174ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.309113 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d046e04498494659a96139f051e7bbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.309947 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8909dfef9034dcc8e899fac6ae5d8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:03:02.310300 26635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 503) took 1380 ms. Trace:
I20260928 20:03:02.310621 26635 rpcz_store.cc:276] 0928 20:03:00.929823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.956686 (+1026863us) service_pool.cc:224] Handling call
0928 20:03:02.049718 (+ 93032us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.049863 (+ 145us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.091005 (+ 41142us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.145357 (+ 54352us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.293654 (+148297us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.310067 (+ 16413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339700992}
I20260928 20:03:02.315564 28059 tablet_replica.cc:333] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:03:02.278632 26510 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.729s user 0.007s sys 0.007s
I20260928 20:03:02.275219 28306 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
W20260928 20:03:02.289307 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 64509.9us
W20260928 20:03:02.331630 26450 leader_election.cc:343] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.331991 26450 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.332902 26450 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.334008 26450 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.336707 26450 leader_election.cc:304] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.338012 26450 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.338382 26450 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.339462 26450 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.343691 26493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 493) took 2986 ms. Trace:
I20260928 20:03:02.344062 26493 rpcz_store.cc:276] 0928 20:02:59.357315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.955399 (+1598084us) service_pool.cc:224] Handling call
0928 20:03:01.854162 (+898763us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.854251 (+ 89us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.970081 (+115830us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.275554 (+305473us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.343633 (+ 68079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.349617 26912 raft_consensus.cc:385] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:02.350085 26912 raft_consensus.cc:740] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:02.241886 28030 ts_tablet_manager.cc:1975] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:02.350704 28030 log.cc:1199] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/1284d1f7fa774033b90133447627df4f
I20260928 20:03:02.351491 28030 ts_tablet_manager.cc:1996] T 1284d1f7fa774033b90133447627df4f P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:03:02.307529 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 153887us
I20260928 20:03:02.352892 26740 leader_election.cc:304] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:03:02.332207 28306 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:02.354728 26912 consensus_queue.cc:260] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.355302 26492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 507) took 1839 ms. Trace:
I20260928 20:03:02.355990 28306 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:02.356406 26494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 494) took 2840 ms. Trace:
I20260928 20:03:02.356621 26489 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 503) took 2403 ms. Trace:
I20260928 20:03:02.358738 26487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 508) took 1842 ms. Trace:
I20260928 20:03:02.360016 26486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 487) took 3050 ms. Trace:
I20260928 20:03:02.360417 26486 rpcz_store.cc:276] 0928 20:02:59.309554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.388932 (+1079378us) service_pool.cc:224] Handling call
0928 20:03:00.849022 (+460090us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866ea52 00007f65515bf1c9 00007f65507f8d70 00007f65508df521 00007f65508bb523 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82 00007f654edf0ab1
0928 20:03:00.952503 (+103481us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.002358 (+ 49855us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.617311 (+614953us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.244574 (+627263us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.359961 (+115387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24636800}
I20260928 20:03:02.356905 26489 rpcz_store.cc:276] 0928 20:02:59.952990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.929324 (+1976334us) service_pool.cc:224] Handling call
0928 20:03:01.931902 (+ 2578us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.931972 (+ 70us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.213492 (+281520us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.354217 (+140725us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.356573 (+ 2356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.364565 28321 raft_consensus.cc:2749] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.365293 28321 raft_consensus.cc:2749] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.365855 28354 raft_consensus.cc:2749] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.366693 28059 raft_consensus.cc:2243] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:02.367206 28059 raft_consensus.cc:2272] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:02.367264 28047 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.369225 28059 ts_tablet_manager.cc:1962] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:02.369303 26480 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 496) took 2506 ms. Trace:
W20260928 20:03:02.372044 26740 leader_election.cc:343] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 01533b61bad74ddb9056aeacef13a126
I20260928 20:03:02.372162 26625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 494) took 1690 ms. Trace:
I20260928 20:03:02.372516 26625 rpcz_store.cc:276] 0928 20:03:00.682016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.139427 (+457411us) service_pool.cc:224] Handling call
0928 20:03:01.914885 (+775458us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.915032 (+ 147us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.945566 (+ 30534us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.100887 (+155321us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.348783 (+247896us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:03:02.372102 (+ 23319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442706816}
I20260928 20:03:02.373555 28428 raft_consensus.cc:2804] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:02.374022 28428 raft_consensus.cc:697] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:02.278492 26478 rpcz_store.cc:276] 0928 20:02:59.201090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.921504 (+720414us) service_pool.cc:224] Handling call
0928 20:03:00.026460 (+104956us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:00.026550 (+ 90us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.183494 (+1156944us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.105298 (+921804us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.191532 (+ 86234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.367672 28047 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.374846 28428 consensus_queue.cc:237] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.356731 26494 rpcz_store.cc:276] 0928 20:02:59.516457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.983577 (+1467120us) service_pool.cc:224] Handling call
0928 20:03:01.854418 (+870841us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.854509 (+ 91us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.981257 (+126748us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.330628 (+349371us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.356352 (+ 25724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26808}
I20260928 20:03:02.380146 26623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 500) took 1451 ms. Trace:
I20260928 20:03:02.380664 26623 rpcz_store.cc:276] 0928 20:03:00.929079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.912614 (+983535us) service_pool.cc:224] Handling call
0928 20:03:02.056108 (+143494us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.056223 (+ 115us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.105883 (+ 49660us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.379397 (+273514us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.380072 (+ 675us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:02.389240 28363 log.cc:927] Time spent T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54: Append to log took a long time: real 0.066s user 0.001s sys 0.000s
I20260928 20:03:02.357529 28353 raft_consensus.cc:2749] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.355993 28357 raft_consensus.cc:2749] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.391948 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 363) took 9748 ms. Trace:
I20260928 20:03:02.392282 28030 rpcz_store.cc:276] 0928 20:02:52.643101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.643182 (+ 81us) service_pool.cc:224] Handling call
0928 20:03:01.822860 (+9179678us) ts_tablet_manager.cc:1197] Deleting tablet 1284d1f7fa774033b90133447627df4f
0928 20:03:01.822926 (+ 66us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.120036 (+297110us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.241759 (+121723us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.391884 (+150125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267335,"tablet-delete.queue_time_us":9179227}
I20260928 20:03:02.393465 28030 tablet_replica.cc:333] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:02.394714 26483 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 499) took 2442 ms. Trace:
I20260928 20:03:02.395089 26483 rpcz_store.cc:276] 0928 20:02:59.951839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.902728 (+1950889us) service_pool.cc:224] Handling call
0928 20:03:01.903826 (+ 1098us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.903909 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.975234 (+ 71325us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.394264 (+419030us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.394655 (+ 391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.397197 27857 ts_tablet_manager.cc:1975] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:02.397760 28047 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:02.402288 27857 log.cc:1199] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:02.403074 27857 ts_tablet_manager.cc:1996] T 0aad5c72e4c64b9e91082860477c78fa P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:02.407810 26913 raft_consensus.cc:359] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.408545 26913 raft_consensus.cc:385] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:02.408814 26913 raft_consensus.cc:740] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:02.404599 26479 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 506) took 2450 ms. Trace:
I20260928 20:03:02.369668 26480 rpcz_store.cc:276] 0928 20:02:59.862943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.274312 (+1411369us) service_pool.cc:224] Handling call
0928 20:03:01.854794 (+580482us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.868492 (+ 13698us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.219593 (+351101us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.368789 (+149196us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.369233 (+ 444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.409698 26479 rpcz_store.cc:276] 0928 20:02:59.953723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.059913 (+2106190us) service_pool.cc:224] Handling call
0928 20:03:02.071203 (+ 11290us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.090392 (+ 19189us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.325068 (+234676us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.404060 (+ 78992us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.404536 (+ 476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.355649 26492 rpcz_store.cc:276] 0928 20:03:00.515889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.093871 (+1577982us) service_pool.cc:224] Handling call
0928 20:03:02.168581 (+ 74710us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866ea52 00007f65515bf1c9 00007f65507f8d70 00007f65508df521 00007f65508bb523 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82 00007f654edf0ab1
0928 20:03:02.168735 (+ 154us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.168832 (+ 97us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.300192 (+131360us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.325256 (+ 25064us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.355246 (+ 29990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25307520}
I20260928 20:03:02.416680 26740 leader_election.cc:304] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:02.418143 26496 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 509) took 1901 ms. Trace:
I20260928 20:03:02.423026 26496 rpcz_store.cc:276] 0928 20:03:00.516324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.108390 (+1592066us) service_pool.cc:224] Handling call
0928 20:03:02.109469 (+ 1079us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.109535 (+ 66us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.383587 (+274052us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.408241 (+ 24654us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.418071 (+ 9830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.421583 26491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 498) took 2471 ms. Trace:
I20260928 20:03:02.422176 26482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 510) took 1905 ms. Trace:
I20260928 20:03:02.422241 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 402) took 7347 ms. Trace:
I20260928 20:03:02.429692 27857 rpcz_store.cc:276] 0928 20:02:55.074793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.074901 (+ 108us) service_pool.cc:224] Handling call
0928 20:03:01.907433 (+6832532us) ts_tablet_manager.cc:1197] Deleting tablet 0aad5c72e4c64b9e91082860477c78fa
0928 20:03:01.907487 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.380003 (+472516us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.397063 (+ 17060us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.422188 (+ 25125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162070,"tablet-delete.queue_time_us":6704011}
I20260928 20:03:02.422719 26490 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 495) took 2598 ms. Trace:
I20260928 20:03:02.422035 26916 tablet_bootstrap.cc:654] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.359130 26487 rpcz_store.cc:276] 0928 20:03:00.516108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.097597 (+1581489us) service_pool.cc:224] Handling call
0928 20:03:02.103979 (+ 6382us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5800000f98. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654852a881 00007f654866eba1 00007f654866ea52 00007f65515bf1c9 00007f65507f8d70 00007f65508df521 00007f65508bb523 00007f65508699b0 00007f654edf0bf4 00007f654edf0b82 00007f654edf0ab1
0928 20:03:02.104082 (+ 103us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.104154 (+ 72us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.340925 (+236771us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.352024 (+ 11099us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.358686 (+ 6662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11027712}
I20260928 20:03:02.431157 26490 rpcz_store.cc:276] 0928 20:02:59.824535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.986840 (+1162305us) service_pool.cc:224] Handling call
0928 20:03:01.853665 (+866825us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.853750 (+ 85us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.382197 (+528447us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.388490 (+ 6293us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.422670 (+ 34180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.409499 26913 consensus_queue.cc:260] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.442741 26488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 504) took 2489 ms. Trace:
W20260928 20:03:02.459396 26220 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d2a658eaaedb4432a4dc2e1f5df6cc58 consensus state has no leader
I20260928 20:03:02.463009 26913 ts_tablet_manager.cc:1480] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.183s user 0.007s sys 0.000s
I20260928 20:03:02.464044 26913 tablet_bootstrap.cc:492] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:02.435935 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 396) took 7363 ms. Trace:
I20260928 20:03:02.464407 27857 rpcz_store.cc:276] 0928 20:02:55.072716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.078184 (+ 5468us) service_pool.cc:224] Handling call
0928 20:03:02.431021 (+7352837us) ts_tablet_manager.cc:1197] Deleting tablet b059111d6383414890a28c2947934dd8
0928 20:03:02.433409 (+ 2388us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.435882 (+ 2473us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7227504}
I20260928 20:03:02.436851 26477 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 501) took 2484 ms. Trace:
I20260928 20:03:02.465620 26477 rpcz_store.cc:276] 0928 20:02:59.952380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.909659 (+1957279us) service_pool.cc:224] Handling call
0928 20:03:01.911016 (+ 1357us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.911099 (+ 83us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.264867 (+353768us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.436391 (+171524us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.436798 (+ 407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.429510 26482 rpcz_store.cc:276] 0928 20:03:00.516541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.163851 (+1647310us) service_pool.cc:224] Handling call
0928 20:03:02.192396 (+ 28545us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.192484 (+ 88us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.241500 (+ 49016us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.413830 (+172330us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.422079 (+ 8249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494}
I20260928 20:03:02.467885 26488 rpcz_store.cc:276] 0928 20:02:59.953238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.995666 (+2042428us) service_pool.cc:224] Handling call
0928 20:03:02.105786 (+110120us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.105879 (+ 93us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.424273 (+318394us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.442004 (+ 17731us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.442688 (+ 684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.468763 28402 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:02.469266 28402 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:02.425369 26485 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 502) took 2472 ms. Trace:
I20260928 20:03:02.471026 26485 rpcz_store.cc:276] 0928 20:02:59.952631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.913544 (+1960913us) service_pool.cc:224] Handling call
0928 20:03:01.914881 (+ 1337us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.914958 (+ 77us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.217940 (+302982us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.424926 (+206986us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.425313 (+ 387us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:02.449440 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 110018us
I20260928 20:03:02.427295 26491 rpcz_store.cc:276] 0928 20:02:59.951082 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.899222 (+1948140us) service_pool.cc:224] Handling call
0928 20:03:01.900342 (+ 1120us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.900414 (+ 72us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.231458 (+331044us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.413294 (+181836us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.421532 (+ 8238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.472302 28402 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:02.466905 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 399) took 7393 ms. Trace:
I20260928 20:03:02.472801 26450 leader_election.cc:304] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.472640 27857 rpcz_store.cc:276] 0928 20:02:55.073503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.078605 (+ 5102us) service_pool.cc:224] Handling call
0928 20:03:02.466600 (+7387995us) ts_tablet_manager.cc:1197] Deleting tablet bd3fa371924149fb814c8458488aea61
0928 20:03:02.466656 (+ 56us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.466853 (+ 197us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7262932}
I20260928 20:03:02.469718 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 0aad5c72e4c64b9e91082860477c78fa (table default.Table_a79a8a3ed31b47348f4de573aef54ed6 [id=eb4db143a6e04cab9ef4d9f60b540953]) successfully deleted
I20260928 20:03:02.473977 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 400) took 7400 ms. Trace:
I20260928 20:03:02.473917 26450 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.474579 28357 raft_consensus.cc:2749] T a9a8177684ed461cbc7bbc4aeb30873c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.474293 27857 rpcz_store.cc:276] 0928 20:02:55.073729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.078992 (+ 5263us) service_pool.cc:224] Handling call
0928 20:03:02.473689 (+7394697us) ts_tablet_manager.cc:1197] Deleting tablet 12a86cd5167c43a4beb51cd3138cdef8
0928 20:03:02.473746 (+ 57us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.473927 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7269881}
I20260928 20:03:02.475138 28357 raft_consensus.cc:2749] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.475720 27857 tablet_replica.cc:333] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
W20260928 20:03:02.475934 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet b059111d6383414890a28c2947934dd8 because the tablet was not found. No further retry: Not found: Tablet not found: b059111d6383414890a28c2947934dd8
I20260928 20:03:02.476166 26450 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.476444 27857 raft_consensus.cc:2243] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:02.476843 27857 pending_rounds.cc:70] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Trying to abort 1 pending ops.
I20260928 20:03:02.477082 27857 pending_rounds.cc:77] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403190120460288 op_type: NO_OP noop_request { }
I20260928 20:03:02.477438 27857 raft_consensus.cc:2889] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:02.477785 27857 raft_consensus.cc:2272] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:03:02.477929 26450 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.476748 28357 raft_consensus.cc:2749] T 674eef4920f94d4f88aa5dc3a0b362d3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.478482 26450 leader_election.cc:304] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.478964 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 62361.3us
I20260928 20:03:02.479156 28357 raft_consensus.cc:2749] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.422726 28047 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
W20260928 20:03:02.479481 26450 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.479972 28047 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.480728 26450 leader_election.cc:304] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.481360 28357 raft_consensus.cc:2749] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.482566 26624 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 499) took 1553 ms. Trace:
I20260928 20:03:02.483624 26916 tablet_bootstrap.cc:492] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:02.484117 27857 ts_tablet_manager.cc:1962] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:02.485443 26495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36268 (request call id 505) took 2532 ms. Trace:
I20260928 20:03:02.485798 26495 rpcz_store.cc:276] 0928 20:02:59.953481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.895090 (+1941609us) service_pool.cc:224] Handling call
0928 20:03:01.896301 (+ 1211us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.896376 (+ 75us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.241500 (+345124us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.485029 (+243529us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.485395 (+ 366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.492873 26233 master_service.cc:960] ReplaceTablet: received request to replace tablet d479a8eabc624569968515684e8acb0c from {username='slave'} at 127.0.0.1:40138
I20260928 20:03:02.484176 26916 ts_tablet_manager.cc:1449] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.291s user 0.009s sys 0.002s
I20260928 20:03:02.505540 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 4b91a573103c4c2d995abde8db91b821 (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]) successfully deleted
I20260928 20:03:02.506319 26624 rpcz_store.cc:276] 0928 20:03:00.928755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.639226 (+710471us) service_pool.cc:224] Handling call
0928 20:03:01.914040 (+274814us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:01.914198 (+ 158us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:01.996765 (+ 82567us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.429928 (+433163us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.482505 (+ 52577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.509718 26450 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.512882 26450 leader_election.cc:343] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.515262 26450 leader_election.cc:304] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.515969 28436 raft_consensus.cc:2749] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.520183 26916 raft_consensus.cc:359] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:02.520907 26916 raft_consensus.cc:385] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:02.521167 26916 raft_consensus.cc:740] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:02.521747 26916 consensus_queue.cc:260] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:02.529775 26476 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:36252 (request call id 60) took 3773 ms. Trace:
I20260928 20:03:02.530272 26476 rpcz_store.cc:276] 0928 20:02:58.755798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.756015 (+ 217us) service_pool.cc:224] Handling call
0928 20:03:01.824650 (+3068635us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400170cd4. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654f773b01 00007f654f804788 00007f6550878cfd 00007f654efc5104 00007f654efc5092 00007f654efc4fc1 00007f654efc4f3c 00007f654efc41f2 00007f654d4d915c 00007f654d4d8596 00007f654d4d7f3f
0928 20:03:02.266995 (+442345us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b5c0010fe8c. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654fbcb651 00007f654fd71ee9 00007f654fc57cd0 00007f6550878cd0 00007f654efc5104 00007f654efc5092 00007f654efc4fc1 00007f654efc4f3c 00007f654efc41f2 00007f654d4d915c 00007f654d4d8596
0928 20:03:02.528959 (+261964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612152320}
I20260928 20:03:02.530730 28436 raft_consensus.cc:2749] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.531821 26450 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.532634 26450 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.532989 26450 leader_election.cc:304] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.481741 28047 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:02.443467 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.539463 26797 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:02.539921 26916 ts_tablet_manager.cc:1480] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260928 20:03:02.498899 28030 raft_consensus.cc:2243] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:02.541075 28030 pending_rounds.cc:70] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Trying to abort 1 pending ops.
I20260928 20:03:02.540966 28436 raft_consensus.cc:2749] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.541383 28030 pending_rounds.cc:77] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403181186514944 op_type: NO_OP noop_request { }
I20260928 20:03:02.541819 28030 raft_consensus.cc:2889] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:02.542237 28030 raft_consensus.cc:2272] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:03:02.543393 26450 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.424260 26912 ts_tablet_manager.cc:1480] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.134s user 0.000s sys 0.005s
I20260928 20:03:02.520995 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.544068 26799 raft_consensus.cc:2468] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:02.522369 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:02.544871 26450 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.545059 26791 raft_consensus.cc:2468] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:02.525724 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:02.546300 26450 leader_election.cc:343] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.547099 26912 tablet_bootstrap.cc:492] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:02.524416 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.530944 28427 raft_consensus.cc:2749] T caf030c329e64d208a3f507804edbd54 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.544284 26916 tablet_bootstrap.cc:492] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:02.532480 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 52900.1us
I20260928 20:03:02.553387 26740 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:02.491936 26629 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 493) took 1810 ms. Trace:
I20260928 20:03:02.554354 26629 rpcz_store.cc:276] 0928 20:03:00.681739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.112732 (+430993us) service_pool.cc:224] Handling call
0928 20:03:01.747697 (+634965us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdecc 00007f5df58cda8b 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:02.014159 (+266462us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.025642 (+ 11483us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.144462 (+118820us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.491465 (+347003us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.491875 (+ 410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18818944}
I20260928 20:03:02.557379 28435 raft_consensus.cc:2749] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.562523 28431 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.563899 27857 ts_tablet_manager.cc:1975] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:02.565760 28431 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:02.568085 27857 log.cc:1199] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/b94aed8337bb4b20b7977e91640c6710
I20260928 20:03:02.569209 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 4 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "5308dad1e3384995a990de7c4866f1b1" is_pre_election: true
W20260928 20:03:02.564461 26450 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.570480 26246 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd517ada41af42d8b8d85ba1e657e003 for term 4 because replica has last-logged OpId of term: 2 index: 620, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 619.
W20260928 20:03:02.570576 26450 leader_election.cc:343] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.571317 26450 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.571687 27923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 4 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
W20260928 20:03:02.571916 26450 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.574169 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
W20260928 20:03:02.574414 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet b97ad3f841f54aa38bbb312c50db384e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97ad3f841f54aa38bbb312c50db384e already in progress: creating tablet
I20260928 20:03:02.574739 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:02.575183 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet f478cce587a548e1aab620721c3bb1c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f478cce587a548e1aab620721c3bb1c1 already in progress: creating tablet
I20260928 20:03:02.576356 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.577836 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.581881 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.575452 27857 ts_tablet_manager.cc:1996] T b94aed8337bb4b20b7977e91640c6710 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:02.590286 26916 tablet_bootstrap.cc:654] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.583576 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.595508 28443 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 20:03:02.596858 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 403) took 7495 ms. Trace:
W20260928 20:03:02.607717 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet bd3fa371924149fb814c8458488aea61 because the tablet was not found. No further retry: Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:02.608548 28030 ts_tablet_manager.cc:1962] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:03:02.625162 26595 leader_election.cc:343] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 385278bf2df34f4f960a0cfdebd79be5
I20260928 20:03:02.625607 26595 leader_election.cc:304] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.627110 26737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:02.554023 26634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 502) took 1624 ms. Trace:
I20260928 20:03:02.632275 27857 rpcz_store.cc:276] 0928 20:02:55.101634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.101803 (+ 169us) service_pool.cc:224] Handling call
0928 20:03:02.475560 (+7373757us) ts_tablet_manager.cc:1197] Deleting tablet b94aed8337bb4b20b7977e91640c6710
0928 20:03:02.475619 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.501284 (+ 25665us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.563756 (+ 62472us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.596786 (+ 33030us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7261460}
I20260928 20:03:02.633874 28400 tablet.cc:1751] T 2d90ce97d3db4bff8b2eea71c530c351 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:03:02.634852 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 398) took 7561 ms. Trace:
I20260928 20:03:02.614984 28402 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.637041 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.637108 28402 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.639236 28402 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:02.651279 26223 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43581.3us
I20260928 20:03:02.652515 27857 rpcz_store.cc:276] 0928 20:02:55.073259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.088415 (+ 15156us) service_pool.cc:224] Handling call
0928 20:03:02.634266 (+7545851us) ts_tablet_manager.cc:1197] Deleting tablet 80d7ab92a37c4f9b865fa9fe49d46916
0928 20:03:02.634328 (+ 62us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.634781 (+ 453us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7417368}
I20260928 20:03:02.639423 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.640172 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.641176 26595 leader_election.cc:304] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.641810 28306 raft_consensus.cc:2749] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.660320 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:02.642501 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:02.631150 26634 rpcz_store.cc:276] 0928 20:03:00.929566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.926062 (+996496us) service_pool.cc:224] Handling call
0928 20:03:01.961652 (+ 35590us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58cda52 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:01.968670 (+ 7018us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdecc 00007f5df58cda8b 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:02.298576 (+329906us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58ce2e8 00007f5df58ce20b 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1a5e0 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1 00007f5dfc04fa2c
0928 20:03:02.298624 (+ 48us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.298740 (+ 116us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.478651 (+179911us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.553601 (+ 74950us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.553966 (+ 365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592498048}
I20260928 20:03:02.664604 26631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 504) took 1734 ms. Trace:
I20260928 20:03:02.665134 26631 rpcz_store.cc:276] 0928 20:03:00.930081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.924972 (+994891us) service_pool.cc:224] Handling call
0928 20:03:02.309490 (+384518us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.309605 (+ 115us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.539962 (+230357us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.663513 (+123551us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.664514 (+ 1001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:02.660907 28306 raft_consensus.cc:2749] T 6c37ee6dd0e14f038c557985ab4c5b0b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.661095 26656 raft_consensus.cc:2393] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:02.672878 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 397) took 7599 ms. Trace:
W20260928 20:03:02.673333 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 12a86cd5167c43a4beb51cd3138cdef8 because the tablet was not found. No further retry: Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:03:02.674575 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]) successfully deleted
I20260928 20:03:02.675256 28431 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:02.678381 26633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53864 (request call id 501) took 1749 ms. Trace:
I20260928 20:03:02.678851 26633 rpcz_store.cc:276] 0928 20:03:00.929322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.925859 (+996537us) service_pool.cc:224] Handling call
0928 20:03:01.962203 (+ 36344us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58cda52 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:01.969037 (+ 6834us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdecc 00007f5df58cda8b 00007f5dfe81e1c9 00007f5dfda57d70 00007f5dfdb3e521 00007f5dfdb1a523 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82 00007f5dfc04fab1
0928 20:03:02.302160 (+333123us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:03:02.302272 (+ 112us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:03:02.476876 (+174604us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.628037 (+151161us) tablet_replica.cc:206] Creating consensus instance
0928 20:03:02.678304 (+ 50267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66647552}
W20260928 20:03:02.686301 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 47415.2us
W20260928 20:03:02.687721 26594 consensus_peers.cc:597] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db5f5f16f2d7457799e1b96a293695f4. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:02.688515 26913 tablet_bootstrap.cc:654] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.689704 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.689622 27857 rpcz_store.cc:276] 0928 20:02:55.073005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.108175 (+ 35170us) service_pool.cc:224] Handling call
0928 20:03:02.672531 (+7564356us) ts_tablet_manager.cc:1197] Deleting tablet 3eb8477c5cb74205b4b55eb38d7f9542
0928 20:03:02.672583 (+ 52us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.672800 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7455468}
I20260928 20:03:02.691638 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3e86ccb8c334a54b42913bd5f405942" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:02.691673 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.692440 26657 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:02.692999 28402 raft_consensus.cc:493] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:02.695050 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:02.693506 28402 raft_consensus.cc:515] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:02.706250 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 395) took 7634 ms. Trace:
I20260928 20:03:02.707826 26912 tablet_bootstrap.cc:654] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:02.709575 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 49232.8us
I20260928 20:03:02.710769 26595 leader_election.cc:304] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.708694 26916 tablet_bootstrap.cc:492] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:02.711865 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.687508 28059 ts_tablet_manager.cc:1975] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:02.714838 28059 log.cc:1199] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/01533b61bad74ddb9056aeacef13a126
W20260928 20:03:02.715667 26594 consensus_peers.cc:597] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1284d1f7fa774033b90133447627df4f. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:02.715824 28059 ts_tablet_manager.cc:1996] T 01533b61bad74ddb9056aeacef13a126 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:02.721920 26916 ts_tablet_manager.cc:1449] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.178s user 0.008s sys 0.006s
I20260928 20:03:02.724617 26916 raft_consensus.cc:359] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.725311 26916 raft_consensus.cc:385] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:02.725576 26916 raft_consensus.cc:740] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:02.712731 27857 rpcz_store.cc:276] 0928 20:02:55.072347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.222719 (+150372us) service_pool.cc:224] Handling call
0928 20:03:02.705818 (+7483099us) ts_tablet_manager.cc:1197] Deleting tablet 8f5ee801a9354a858356fb4e055a1863
0928 20:03:02.705903 (+ 85us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.706170 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7482338}
I20260928 20:03:02.733980 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 404) took 7346 ms. Trace:
I20260928 20:03:02.719676 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:02.743938 27857 rpcz_store.cc:276] 0928 20:02:55.387201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.390201 (+ 3000us) service_pool.cc:224] Handling call
0928 20:03:02.733652 (+7343451us) ts_tablet_manager.cc:1197] Deleting tablet ee464b814dbf4e4b89b2d1c019befac6
0928 20:03:02.733716 (+ 64us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.733924 (+ 208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7342606}
I20260928 20:03:02.747412 27857 tablet_replica.cc:333] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:02.748942 27857 raft_consensus.cc:2243] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:02.756577 27857 raft_consensus.cc:2272] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:02.764856 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.755649 26916 consensus_queue.cc:260] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:02.770360 26223 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 95804.1us
I20260928 20:03:02.709030 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.711735 28387 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41770 (request call id 485) took 4166 ms. Trace:
I20260928 20:03:02.772724 28387 rpcz_store.cc:276] 0928 20:02:58.545106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.579159 (+1034053us) service_pool.cc:224] Handling call
0928 20:03:02.711668 (+3132509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:59.675751 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:59.679097 (+ 3346us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:02:59.679130 (+ 33us) alter_schema_op.cc:66] Acquired schema lock
0928 20:02:59.679171 (+ 41us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:02:59.679281 (+ 110us) alter_schema_op.cc:128] START. Timestamp: 1790625779679193
0928 20:02:59.679295 (+ 14us) op_driver.cc:348] REPLICATION: starting
0928 20:02:59.679838 (+ 543us) log.cc:844] Serialized 173 byte log entry
0928 20:03:02.221362 (+2541524us) op_driver.cc:464] REPLICATION: finished
0928 20:03:02.250367 (+ 29005us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:02.266748 (+ 16381us) log.cc:844] Serialized 5 byte log entry
0928 20:03:02.614543 (+347795us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.615282 (+ 739us) log.cc:844] Serialized 14 byte log entry
0928 20:03:02.700863 (+ 85581us) alter_schema_op.cc:73] Released schema lock
0928 20:03:02.711535 (+ 10672us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":28750,"prepare.queue_time_us":9817,"prepare.run_cpu_time_us":31785,"prepare.run_wall_time_us":201187,"replication_time_us":2541937,"thread_start_us":207048,"threads_started":2,"wal-append.queue_time_us":242406,"wal-append.run_cpu_time_us":1310,"wal-append.run_wall_time_us":1001332}]]}
I20260928 20:03:02.780855 28444 tablet.cc:1751] T 502edf35a86646178cfc121519c85c53 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:02.781379 26916 ts_tablet_manager.cc:1480] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.059s user 0.005s sys 0.000s
I20260928 20:03:02.792666 28452 raft_consensus.cc:2749] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.796269 28402 leader_election.cc:290] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:02.801736 26913 tablet_bootstrap.cc:492] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:02.802655 26913 ts_tablet_manager.cc:1449] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.339s user 0.013s sys 0.010s
W20260928 20:03:02.817399 26450 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.817864 26450 leader_election.cc:304] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.826462 28436 raft_consensus.cc:2749] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.826629 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 80d7ab92a37c4f9b865fa9fe49d46916 because the tablet was not found. No further retry: Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:02.728412 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:02.829525 26913 raft_consensus.cc:359] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.830399 26913 raft_consensus.cc:385] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:02.830662 26913 raft_consensus.cc:740] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:03:02.779808 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 43738.7us
I20260928 20:03:02.831362 26913 consensus_queue.cc:260] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:02.834317 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 123700us
I20260928 20:03:02.835924 26450 leader_election.cc:304] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.837525 28436 raft_consensus.cc:2749] T 718a2abfe21b4a2986b77e14e4e52152 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:02.838670 26450 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.839018 26450 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.840058 26595 leader_election.cc:343] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:03:02.841017 28436 raft_consensus.cc:2749] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.842001 26913 ts_tablet_manager.cc:1480] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.039s user 0.008s sys 0.000s
I20260928 20:03:02.843091 26913 tablet_bootstrap.cc:492] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:02.843655 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 380) took 8161 ms. Trace:
I20260928 20:03:02.844238 28059 rpcz_store.cc:276] 0928 20:02:54.682332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.682817 (+ 485us) service_pool.cc:224] Handling call
0928 20:03:02.090750 (+7407933us) ts_tablet_manager.cc:1197] Deleting tablet 01533b61bad74ddb9056aeacef13a126
0928 20:03:02.315396 (+224646us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e6f9 00007f5dfdb1ecf3 00007f5dfdb51080 00007f5dfdb374ad 00007f5dfdb37459 00007f5dfdb373e9
0928 20:03:02.315440 (+ 44us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.567202 (+251762us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.687366 (+120164us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:02.843575 (+156209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440606976,"tablet-delete.queue_time_us":7407431}
I20260928 20:03:02.846439 28059 tablet_replica.cc:333] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:02.762523 27857 ts_tablet_manager.cc:1962] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:02.847723 28059 raft_consensus.cc:2243] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:02.853101 28059 pending_rounds.cc:70] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:03:02.854372 26450 leader_election.cc:304] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.855182 28436 raft_consensus.cc:2749] T ef3e590ceb1345da99e67e5fa627fa9f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.856583 26450 leader_election.cc:304] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.857484 28436 raft_consensus.cc:2749] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.858772 26450 leader_election.cc:304] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.865428 28436 raft_consensus.cc:2749] T 29dd1355039e4bca952f13a9d174813e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:02.867223 26450 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.867650 26450 leader_election.cc:304] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.868338 28436 raft_consensus.cc:2749] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.870064 26450 leader_election.cc:304] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.870900 28436 raft_consensus.cc:2749] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.871548 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.872416 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d91ea748a94cb7a75cbbd2f39f49f6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.872633 26506 raft_consensus.cc:1240] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Rejecting Update request from peer 92fd8074a7df4bba87a73c0d84ed00c8 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:02.873698 26450 leader_election.cc:304] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.874370 26223 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 47787.2us
I20260928 20:03:02.874519 28436 raft_consensus.cc:2749] T 6c37ee6dd0e14f038c557985ab4c5b0b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:02.670531 26222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:02.874750 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.875572 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.878050 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:02.876972 26450 leader_election.cc:304] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.883395 28436 raft_consensus.cc:2749] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:02.640884 26868 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.25.129.253:32923)
I20260928 20:03:02.887928 26916 tablet_bootstrap.cc:492] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:02.887800 26868 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.ReplaceTablet -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 253077us
I20260928 20:03:02.894189 26916 tablet_bootstrap.cc:654] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.897315 26450 leader_election.cc:304] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.898088 28436 raft_consensus.cc:2749] T e6b8e89ff26a439c8f6d7784cd179698 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:02.899452 26450 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.900102 28436 raft_consensus.cc:2749] T edc62660134e45f8bc958e95f4e56906 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.901204 26450 leader_election.cc:304] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:02.902840 26740 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 51244us
W20260928 20:03:02.902961 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 3eb8477c5cb74205b4b55eb38d7f9542 because the tablet was not found. No further retry: Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542
W20260928 20:03:02.904019 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet 8f5ee801a9354a858356fb4e055a1863 because the tablet was not found. No further retry: Not found: Tablet not found: 8f5ee801a9354a858356fb4e055a1863
W20260928 20:03:02.904945 26223 catalog_manager.cc:5030] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): delete failed for tablet ee464b814dbf4e4b89b2d1c019befac6 because the tablet was not found. No further retry: Not found: Tablet not found: ee464b814dbf4e4b89b2d1c019befac6
I20260928 20:03:02.905670 28436 raft_consensus.cc:2749] T 7e86d2d680c545e0b0511dec35ba6c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:02.906693 26450 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.907032 26450 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.910192 26916 tablet_bootstrap.cc:492] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:02.910575 26916 ts_tablet_manager.cc:1449] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.009s
I20260928 20:03:02.912212 28436 raft_consensus.cc:2749] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.913482 26916 raft_consensus.cc:359] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:02.914089 26916 raft_consensus.cc:385] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:02.915154 26450 leader_election.cc:304] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.915750 28436 raft_consensus.cc:2749] T 1d016129c3a140518cf310089360c7b7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.914350 26916 raft_consensus.cc:740] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:02.918717 26125 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 125972us
I20260928 20:03:02.918929 26916 consensus_queue.cc:260] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:02.919797 26450 leader_election.cc:343] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.920226 26450 leader_election.cc:304] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.923096 28462 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.929904 26916 ts_tablet_manager.cc:1480] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260928 20:03:02.930495 28436 raft_consensus.cc:2749] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.931643 26450 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.932008 26450 leader_election.cc:304] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.932597 28436 raft_consensus.cc:2749] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.933570 26450 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.925568 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet ee464b814dbf4e4b89b2d1c019befac6 (table default.Table_cc5abaa8c7cd4a05b417f7cee23527e7 [id=94a4d6e455f045d8a6a756ef8f2c8499]) successfully deleted
I20260928 20:03:02.933909 26450 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.934548 28436 raft_consensus.cc:2749] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.935865 26450 leader_election.cc:343] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.936398 26450 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.936918 26450 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.937889 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 1284d1f7fa774033b90133447627df4f (table default.Table_de419094fd8a4aa5b9ff973562f7f89b [id=45c7b267d11c42098dcc5264a976ee7a]) successfully deleted
I20260928 20:03:02.940070 28462 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:03:02.945530 26450 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.946177 26450 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:02.946184 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 97890.8us
W20260928 20:03:02.947165 26739 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.948309 26739 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:02.949064 28435 raft_consensus.cc:2804] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:02.951454 28435 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:02.952299 28435 raft_consensus.cc:3060] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:02.954295 28436 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:02.954705 28436 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:02.956557 28436 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:02.957211 26450 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.957545 26450 leader_election.cc:304] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.958169 28436 raft_consensus.cc:2749] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.959090 26450 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.959411 26450 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.959982 28436 raft_consensus.cc:2749] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.961000 26450 leader_election.cc:304] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.853389 28059 pending_rounds.cc:77] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403190120460288 op_type: NO_OP noop_request { }
I20260928 20:03:02.963900 28436 raft_consensus.cc:2749] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.951478 26912 tablet_bootstrap.cc:492] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:02.965526 26912 ts_tablet_manager.cc:1449] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.419s user 0.010s sys 0.002s
I20260928 20:03:02.965565 26450 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.966193 28436 raft_consensus.cc:2749] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:03:02.966302 28059 raft_consensus.cc:2889] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:02.966691 28059 raft_consensus.cc:2272] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:02.967155 26450 leader_election.cc:304] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.967953 28461 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 20:03:02.973740 28306 consensus_queue.cc:1059] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 20:03:02.974287 28436 raft_consensus.cc:2749] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.975354 26450 leader_election.cc:343] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.975390 28455 raft_consensus.cc:3055] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:02.975704 26450 leader_election.cc:304] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.975925 26913 tablet_bootstrap.cc:654] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:02.975824 28455 raft_consensus.cc:740] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:02.976311 28436 raft_consensus.cc:2749] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.977221 26450 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.977550 26450 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.978274 28436 raft_consensus.cc:2749] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:02.979283 26450 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:02.979604 26450 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:02.983875 28059 ts_tablet_manager.cc:1962] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:02.984191 26594 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:02.985263 28448 raft_consensus.cc:2804] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:02.985565 28448 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:02.985878 28448 raft_consensus.cc:3060] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:02.988854 28455 consensus_queue.cc:260] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:02.996192 28436 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:02.970849 26236 master_service.cc:960] ReplaceTablet: received request to replace tablet 16796100116a4fe4a64893f49fb1cad4 from {username='slave'} at 127.0.0.1:40138
W20260928 20:03:03.004254 26450 consensus_peers.cc:597] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:03.007445 26594 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:03.014429 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.015341 28357 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.015993 28357 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.011267 28400 tablet.cc:1751] T 502edf35a86646178cfc121519c85c53 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:03.018198 28357 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:03.019794 26450 leader_election.cc:343] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.020309 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:03.023692 26450 leader_election.cc:343] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.025627 26594 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:03.026732 26594 leader_election.cc:304] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:03.027261 28435 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.033823 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 620 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:03.034849 26169 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5308dad1e3384995a990de7c4866f1b1 in term 3.
I20260928 20:03:03.036398 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003; no voters:
I20260928 20:03:03.039160 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 01533b61bad74ddb9056aeacef13a126 (table default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]) successfully deleted
I20260928 20:03:03.047254 28450 raft_consensus.cc:2749] T 34d91ea748a94cb7a75cbbd2f39f49f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:03.017745 26912 raft_consensus.cc:359] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.055245 28059 ts_tablet_manager.cc:1975] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:03.055744 28059 log.cc:1199] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/b94aed8337bb4b20b7977e91640c6710
I20260928 20:03:03.056581 28059 ts_tablet_manager.cc:1996] T b94aed8337bb4b20b7977e91640c6710 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:03.059346 28470 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 20:03:03.059942 26912 raft_consensus.cc:385] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.067297 26916 tablet_bootstrap.cc:492] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:03.068811 26912 raft_consensus.cc:740] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.073213 26916 tablet_bootstrap.cc:654] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:03.033845 26740 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:03.082937 26740 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:03.083971 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 50153.3us
I20260928 20:03:03.085803 28470 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:03.086265 28470 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 3 FOLLOWER]: Advancing to term 4
I20260928 20:03:03.080824 26912 consensus_queue.cc:260] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.092000 27923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 620 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:03.083972 28468 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 20:03:03.045001 28402 raft_consensus.cc:2804] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:03.102880 28402 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:03.103317 28402 raft_consensus.cc:3060] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:03.090256 28462 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:03.107194 26916 tablet_bootstrap.cc:492] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:03.111630 26916 ts_tablet_manager.cc:1449] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.002s
I20260928 20:03:03.120519 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f478cce587a548e1aab620721c3bb1c1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.122792 26916 raft_consensus.cc:359] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.124533 26916 raft_consensus.cc:385] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.124799 26916 raft_consensus.cc:740] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.125316 28387 tablet.cc:1751] T 502edf35a86646178cfc121519c85c53 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:03.127077 26916 consensus_queue.cc:260] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.130769 26916 ts_tablet_manager.cc:1480] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260928 20:03:03.135040 26916 tablet_bootstrap.cc:492] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:03.041100 28405 raft_consensus.cc:2804] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:03.115694 28427 raft_consensus.cc:2749] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.137702 28405 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:03.138156 28405 raft_consensus.cc:3060] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
W20260928 20:03:03.155094 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 63466.3us
W20260928 20:03:03.156989 26740 consensus_peers.cc:597] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b94aed8337bb4b20b7977e91640c6710. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:03.160995 28428 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.161487 28428 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.162587 26912 ts_tablet_manager.cc:1480] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.197s user 0.006s sys 0.000s
I20260928 20:03:03.165024 28428 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.179311 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:03.077389 28030 ts_tablet_manager.cc:1975] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:03.223984 26916 tablet_bootstrap.cc:654] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.189815 28030 log.cc:1199] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/385278bf2df34f4f960a0cfdebd79be5
I20260928 20:03:03.227382 28030 ts_tablet_manager.cc:1996] T 385278bf2df34f4f960a0cfdebd79be5 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:03.228384 28428 consensus_queue.cc:1048] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:03.265136 26739 consensus_peers.cc:597] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:03.266338 28357 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.280579 28357 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.283130 28357 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:03.143635 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 174723us
W20260928 20:03:03.198058 26594 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
W20260928 20:03:03.311441 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 113419us
I20260928 20:03:03.312191 28470 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:03.315291 27857 ts_tablet_manager.cc:1975] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:03.315299 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 620 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003"
I20260928 20:03:03.315666 27857 log.cc:1199] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:03.315989 26169 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 3 FOLLOWER]: Advancing to term 4
I20260928 20:03:03.316303 27857 ts_tablet_manager.cc:1996] T e5e8ff2ad1f745f88df6e471ed935f2f P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:03.179175 26655 raft_consensus.cc:3060] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:03.260170 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.181988 28455 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:03.278560 28466 tablet.cc:1746] T d5ed5998a6194061839143c4adf4d3d4 P 92fd8074a7df4bba87a73c0d84ed00c8: Skipping requested alter to schema version 2, tablet already version 3
I20260928 20:03:03.186187 28448 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.323375 26659 raft_consensus.cc:1240] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: []
W20260928 20:03:03.325944 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 55922.4us
I20260928 20:03:03.326617 26169 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5308dad1e3384995a990de7c4866f1b1 in term 4.
I20260928 20:03:03.328465 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003; no voters:
I20260928 20:03:03.329628 28462 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260928 20:03:03.154444 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.284531 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.333446 28454 consensus_queue.cc:1048] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260928 20:03:03.335983 28448 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.267609 28471 tablet.cc:1751] T 2d90ce97d3db4bff8b2eea71c530c351 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:03:03.340981 28462 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 4 LEADER]: Becoming Leader. State: Replica: 5308dad1e3384995a990de7c4866f1b1, State: Running, Role: LEADER
I20260928 20:03:03.342398 28462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 619, Committed index: 619, Last appended: 2.620, Last appended by leader: 620, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:03.285512 28405 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.287039 28402 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:03.347831 26450 leader_election.cc:343] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.348053 26916 tablet_bootstrap.cc:492] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:03.348629 26916 ts_tablet_manager.cc:1449] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.214s user 0.011s sys 0.004s
I20260928 20:03:03.351529 28357 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.352159 28357 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:03.355602 28357 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:03.342016 26595 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:03.368762 26595 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:03.369204 26595 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:03.371654 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 405) took 7909 ms. Trace:
I20260928 20:03:03.376226 28476 tablet.cc:1746] T d5ed5998a6194061839143c4adf4d3d4 P b2d286f4404146278f5e0785ed9fcee4: Skipping requested alter to schema version 2, tablet already version 3
I20260928 20:03:03.379454 28456 raft_consensus.cc:2749] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:03.381696 26595 leader_election.cc:343] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 775b9a076bf048bea39423d3554babf7
I20260928 20:03:03.382261 26595 leader_election.cc:304] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:03.388876 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.390214 26913 tablet_bootstrap.cc:492] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:03.390676 26913 ts_tablet_manager.cc:1449] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.548s user 0.037s sys 0.079s
I20260928 20:03:03.389619 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.394641 26913 raft_consensus.cc:359] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.395340 26913 raft_consensus.cc:385] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.395629 26913 raft_consensus.cc:740] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.396421 26913 consensus_queue.cc:260] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.396656 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:03.397639 28461 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.429s user 0.029s sys 0.054s
W20260928 20:03:03.397953 26450 leader_election.cc:343] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.398394 26450 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:03.399748 26450 leader_election.cc:343] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.399350 28357 raft_consensus.cc:2749] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.400679 28436 consensus_queue.cc:1059] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 20:03:03.401785 28436 raft_consensus.cc:3055] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:03.401393 28483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:03.402221 28483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:03:03.400143 26450 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:03.404364 26450 leader_election.cc:343] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.405453 28357 raft_consensus.cc:2749] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.406891 26912 tablet_bootstrap.cc:492] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:03.410650 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 364) took 10766 ms. Trace:
I20260928 20:03:03.411173 28435 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.411068 28030 rpcz_store.cc:276] 0928 20:02:52.643936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.644019 (+ 83us) service_pool.cc:224] Handling call
0928 20:03:02.393307 (+9749288us) ts_tablet_manager.cc:1197] Deleting tablet 385278bf2df34f4f960a0cfdebd79be5
0928 20:03:02.393361 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:02.952373 (+559012us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.077250 (+124877us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.410574 (+333324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9748843}
I20260928 20:03:03.412788 28030 tablet_replica.cc:333] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:03.417061 26222 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 385278bf2df34f4f960a0cfdebd79be5 (table default.Table_ba39b68fc8f040688126ae288d501ac3 [id=5f40398fa88449218e7d77ef265d2e04]) successfully deleted
I20260928 20:03:03.418601 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:03.419199 28405 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.421720 28030 raft_consensus.cc:2243] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:03.422585 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 389) took 8273 ms. Trace:
I20260928 20:03:03.422957 28059 rpcz_store.cc:276] 0928 20:02:55.149434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.152215 (+ 2781us) service_pool.cc:224] Handling call
0928 20:03:02.846205 (+7693990us) ts_tablet_manager.cc:1197] Deleting tablet b94aed8337bb4b20b7977e91640c6710
0928 20:03:02.846283 (+ 78us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.002780 (+156497us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.055083 (+ 52303us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.347282 (+292199us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1f1b2 00007f5dfdb51080 00007f5dfdb374ad 00007f5dfdb37459 00007f5dfdb373e9 00007f5dfdb373b1
0928 20:03:03.422484 (+ 75202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5088,"spinlock_wait_cycles":11112704,"tablet-delete.queue_time_us":7691783}
I20260928 20:03:03.424525 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 388) took 8275 ms. Trace:
I20260928 20:03:03.424842 28059 rpcz_store.cc:276] 0928 20:02:55.149144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.154414 (+ 5270us) service_pool.cc:224] Handling call
0928 20:03:03.424145 (+8269731us) ts_tablet_manager.cc:1197] Deleting tablet 0aad5c72e4c64b9e91082860477c78fa
0928 20:03:03.424205 (+ 60us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.424469 (+ 264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8266569}
I20260928 20:03:03.404253 26916 raft_consensus.cc:359] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.404812 28436 raft_consensus.cc:740] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:03.380422 27857 rpcz_store.cc:276] 0928 20:02:55.462449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.462580 (+ 131us) service_pool.cc:224] Handling call
0928 20:03:02.747243 (+7284663us) ts_tablet_manager.cc:1197] Deleting tablet e5e8ff2ad1f745f88df6e471ed935f2f
0928 20:03:02.747298 (+ 55us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.032450 (+285152us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.315163 (+282713us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.371584 (+ 56421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7283969}
I20260928 20:03:03.387849 28456 raft_consensus.cc:2749] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:03.426615 28436 consensus_queue.cc:260] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.426914 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet e5e8ff2ad1f745f88df6e471ed935f2f (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]) successfully deleted
I20260928 20:03:03.427208 27857 tablet_replica.cc:333] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:03.428283 28436 raft_consensus.cc:3060] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:03.425984 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 392) took 8123 ms. Trace:
I20260928 20:03:03.434306 26916 raft_consensus.cc:385] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.434617 26916 raft_consensus.cc:740] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.434213 28059 rpcz_store.cc:276] 0928 20:02:55.302707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.302823 (+ 116us) service_pool.cc:224] Handling call
0928 20:03:03.425700 (+8122877us) ts_tablet_manager.cc:1197] Deleting tablet 38abbc891d9c4268820cb0faba3d08b5
0928 20:03:03.425745 (+ 45us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.425936 (+ 191us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8122251}
I20260928 20:03:03.435384 26916 consensus_queue.cc:260] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.435724 28402 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:03.438297 28444 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 460) took 4746 ms. Trace:
I20260928 20:03:03.443307 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:03.445465 28059 tablet_replica.cc:333] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:03.446264 28059 raft_consensus.cc:2243] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:03.448038 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd]) successfully deleted
I20260928 20:03:03.449126 28400 tablet.cc:1751] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260928 20:03:03.449908 27923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 620 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63"
I20260928 20:03:03.451548 28470 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 4 election: Requested vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:03.457106 26507 raft_consensus.cc:2468] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:03.460672 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:03.461621 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:03.470017 27857 raft_consensus.cc:2243] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:03.470709 27857 raft_consensus.cc:2272] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:03.470727 28059 raft_consensus.cc:2272] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:03.472719 27857 ts_tablet_manager.cc:1962] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:03.472939 28059 ts_tablet_manager.cc:1962] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:03.473891 28466 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 428) took 5511 ms. Trace:
I20260928 20:03:03.475342 26913 ts_tablet_manager.cc:1480] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.084s user 0.005s sys 0.002s
W20260928 20:03:03.478938 26222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:03.482271 28030 raft_consensus.cc:2272] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:03.474323 28466 rpcz_store.cc:276] 0928 20:02:57.965600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.970157 (+ 4557us) service_pool.cc:224] Handling call
0928 20:03:03.473769 (+5503612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:02:58.981447 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:02:58.981750 (+ 303us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:01.317502 (+2335752us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:01.317564 (+ 62us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:03:01.317696 (+ 132us) alter_schema_op.cc:128] START. Timestamp: 1790625781280252
0928 20:03:01.317731 (+ 35us) op_driver.cc:348] REPLICATION: starting
0928 20:03:01.318954 (+ 1223us) log.cc:844] Serialized 173 byte log entry
0928 20:03:02.988491 (+1669537us) op_driver.cc:464] REPLICATION: finished
0928 20:03:03.255749 (+267258us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:03.322349 (+ 66600us) log.cc:844] Serialized 94 byte log entry
0928 20:03:03.384467 (+ 62118us) alter_schema_op.cc:73] Released schema lock
0928 20:03:03.410549 (+ 26082us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":266961,"prepare.queue_time_us":968706,"prepare.run_cpu_time_us":46176,"prepare.run_wall_time_us":2338670,"replication_time_us":1670618,"thread_start_us":317974,"threads_started":2,"wal-append.queue_time_us":65783}]]}
I20260928 20:03:03.487008 28466 tablet.cc:1751] T ef3e590ceb1345da99e67e5fa627fa9f P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:03.489384 28461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 476) took 4527 ms. Trace:
W20260928 20:03:03.491611 26222 catalog_manager.cc:5043] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 0aad5c72e4c64b9e91082860477c78fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0aad5c72e4c64b9e91082860477c78fa already in progress: creating tablet
I20260928 20:03:03.491969 26912 tablet_bootstrap.cc:654] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.489437 28436 raft_consensus.cc:493] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.494688 26913 tablet_bootstrap.cc:492] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:03.501387 28030 ts_tablet_manager.cc:1962] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:03.502267 26916 ts_tablet_manager.cc:1480] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.153s user 0.007s sys 0.001s
I20260928 20:03:03.441247 28444 rpcz_store.cc:276] 0928 20:02:58.691631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.510962 (+819331us) service_pool.cc:224] Handling call
0928 20:03:03.438203 (+3927241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:00.124235 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:00.124642 (+ 407us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:00.124674 (+ 32us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:00.589397 (+464723us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:03:00.589529 (+ 132us) alter_schema_op.cc:128] START. Timestamp: 1790625780552149
0928 20:03:00.589549 (+ 20us) op_driver.cc:348] REPLICATION: starting
0928 20:03:00.603263 (+ 13714us) log.cc:844] Serialized 173 byte log entry
0928 20:03:01.112371 (+509108us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b180010f060. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5dfe805c31 00007f5dfe812621 00007f5df5906543 00007f5df5908931 00007f5df59088e9 00007f5df5908879 00007f5df5908841 00007f5df5907b3d 00000000005bd5a4 00000000005bd3d9 00007f5df58e99fa
0928 20:03:02.583289 (+1470918us) op_driver.cc:464] REPLICATION: finished
0928 20:03:02.780720 (+197431us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:02.782172 (+ 1452us) log.cc:844] Serialized 5 byte log entry
0928 20:03:03.417243 (+635071us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.417980 (+ 737us) log.cc:844] Serialized 14 byte log entry
0928 20:03:03.418077 (+ 97us) alter_schema_op.cc:73] Released schema lock
0928 20:03:03.438037 (+ 19960us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":197236,"mutex_wait_us":844,"prepare.queue_time_us":381246,"prepare.run_cpu_time_us":13761,"prepare.run_wall_time_us":895667,"raft.queue_time_us":45166,"raft.run_cpu_time_us":805,"raft.run_wall_time_us":807,"replication_time_us":1993610,"spinlock_wait_cycles":45000576,"thread_start_us":854857,"threads_started":4,"wal-append.queue_time_us":520250,"wal-append.run_cpu_time_us":2006,"wal-append.run_wall_time_us":1084313}]]}
W20260928 20:03:03.514820 26595 consensus_peers.cc:597] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cd2204d99e14a07af962295b152d60f. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:03.516350 26595 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:03.517602 28405 raft_consensus.cc:2804] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:03.518038 28405 raft_consensus.cc:697] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:03.489782 28461 rpcz_store.cc:276] 0928 20:02:58.962246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.114367 (+1152121us) service_pool.cc:224] Handling call
0928 20:03:03.489302 (+3374935us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:00.150869 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:00.189661 (+ 38792us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:00.189697 (+ 36us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:00.597236 (+407539us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:03:00.597351 (+ 115us) alter_schema_op.cc:128] START. Timestamp: 1790625780559971
0928 20:03:00.597373 (+ 22us) op_driver.cc:348] REPLICATION: starting
0928 20:03:00.597929 (+ 556us) log.cc:844] Serialized 173 byte log entry
0928 20:03:02.839647 (+2241718us) op_driver.cc:464] REPLICATION: finished
0928 20:03:02.967813 (+128166us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:02.978892 (+ 11079us) log.cc:844] Serialized 5 byte log entry
0928 20:03:03.440477 (+461585us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.489056 (+ 48579us) log.cc:844] Serialized 14 byte log entry
0928 20:03:03.489146 (+ 90us) alter_schema_op.cc:73] Released schema lock
0928 20:03:03.489176 (+ 30us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":127971,"mutex_wait_us":2999,"prepare.queue_time_us":35559,"prepare.run_cpu_time_us":13394,"prepare.run_wall_time_us":964141,"replication_time_us":2242146,"thread_start_us":922027,"threads_started":4,"wal-append.queue_time_us":942131,"wal-append.run_cpu_time_us":2182,"wal-append.run_wall_time_us":1002180}]]}
I20260928 20:03:03.518862 28405 consensus_queue.cc:237] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.500751 28436 raft_consensus.cc:515] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:03.522883 26595 consensus_peers.cc:597] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad0cbde5f5dc4ff6a046b16b1e2b9786. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:03.525293 26646 raft_consensus.cc:1240] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:03.525820 26913 tablet_bootstrap.cc:654] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.526686 28357 consensus_queue.cc:1059] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 20:03:03.536538 28448 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.549129 28461 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260928 20:03:03.552276 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e1d6dcd913394d4ca2e4b9f5be5ea069 consensus state has no leader
I20260928 20:03:03.568671 26913 tablet_bootstrap.cc:492] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:03.568591 28461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:53864 (request call id 487) took 2974 ms. Trace:
I20260928 20:03:03.569077 26913 ts_tablet_manager.cc:1449] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.002s
I20260928 20:03:03.568958 28461 rpcz_store.cc:276] 0928 20:03:00.594333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.935505 (+341172us) service_pool.cc:224] Handling call
0928 20:03:03.568517 (+2633012us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:01.145770 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:01.146170 (+ 400us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:03.490227 (+2344057us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:03.490322 (+ 95us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:03:03.490473 (+ 151us) alter_schema_op.cc:128] START. Timestamp: 1790625783490382
0928 20:03:03.490488 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:03:03.494157 (+ 3669us) log.cc:844] Serialized 173 byte log entry
0928 20:03:03.547418 (+ 53261us) op_driver.cc:464] REPLICATION: finished
0928 20:03:03.549034 (+ 1616us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:03.550317 (+ 1283us) log.cc:844] Serialized 5 byte log entry
0928 20:03:03.567177 (+ 16860us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.567809 (+ 632us) log.cc:844] Serialized 14 byte log entry
0928 20:03:03.568372 (+ 563us) alter_schema_op.cc:73] Released schema lock
0928 20:03:03.568402 (+ 30us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1436,"mutex_wait_us":8808,"prepare.queue_time_us":154341,"prepare.run_cpu_time_us":106761,"prepare.run_wall_time_us":2364356,"raft.queue_time_us":1590,"raft.run_cpu_time_us":703,"raft.run_wall_time_us":704,"replication_time_us":56800}]]}
I20260928 20:03:03.571733 26913 raft_consensus.cc:359] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.572662 26913 raft_consensus.cc:385] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.572955 26913 raft_consensus.cc:740] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.574219 26913 consensus_queue.cc:260] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.575304 28496 raft_consensus.cc:3055] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:03.575760 28496 raft_consensus.cc:740] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:03.576157 26913 ts_tablet_manager.cc:1480] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260928 20:03:03.580236 26913 tablet_bootstrap.cc:492] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:03.581553 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.589669 26913 tablet_bootstrap.cc:654] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.580063 28436 leader_election.cc:290] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:03.581548 28357 raft_consensus.cc:493] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.596676 28357 raft_consensus.cc:515] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.598711 28357 leader_election.cc:290] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:03.586938 26450 leader_election.cc:343] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.603156 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.591079 28468 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 20:03:03.607991 26913 tablet_bootstrap.cc:492] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:03.608451 26913 ts_tablet_manager.cc:1449] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.001s
I20260928 20:03:03.604621 28496 consensus_queue.cc:260] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:03.610387 28496 raft_consensus.cc:3060] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:03.610922 26913 raft_consensus.cc:359] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.611562 26913 raft_consensus.cc:385] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.611501 28405 raft_consensus.cc:493] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:03.612311 26450 leader_election.cc:343] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.612036 28405 raft_consensus.cc:515] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.614073 28405 leader_election.cc:290] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.618608 26655 raft_consensus.cc:1240] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:03.618688 28400 tablet.cc:1746] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54: Skipping requested alter to schema version 2, tablet already version 3
I20260928 20:03:03.626648 26913 raft_consensus.cc:740] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.627619 26913 consensus_queue.cc:260] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.627933 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:03.630762 26913 ts_tablet_manager.cc:1480] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260928 20:03:03.632725 28059 ts_tablet_manager.cc:1975] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:03.636745 28436 consensus_queue.cc:1059] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 20:03:03.638011 28357 raft_consensus.cc:3055] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:03.638411 28357 raft_consensus.cc:740] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:03.639540 28357 consensus_queue.cc:260] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.644178 28357 raft_consensus.cc:3060] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:03.658083 28059 log.cc:1199] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/db5f5f16f2d7457799e1b96a293695f4
I20260928 20:03:03.674233 28059 ts_tablet_manager.cc:1996] T db5f5f16f2d7457799e1b96a293695f4 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:03.676631 26913 tablet_bootstrap.cc:492] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:03.694555 26916 tablet_bootstrap.cc:492] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:03.698688 28448 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.699234 28448 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.701538 28448 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.703305 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:03.709425 26916 tablet_bootstrap.cc:654] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.711193 26913 tablet_bootstrap.cc:654] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.726780 28357 raft_consensus.cc:493] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.727697 28357 raft_consensus.cc:515] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.729096 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 393) took 8425 ms. Trace:
I20260928 20:03:03.729516 28059 rpcz_store.cc:276] 0928 20:02:55.303330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.303530 (+ 200us) service_pool.cc:224] Handling call
0928 20:03:03.435312 (+8131782us) ts_tablet_manager.cc:1197] Deleting tablet db5f5f16f2d7457799e1b96a293695f4
0928 20:03:03.445141 (+ 9829us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.497351 (+ 52210us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.632605 (+135254us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.729019 (+ 96414us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8131330}
I20260928 20:03:03.729991 28357 leader_election.cc:290] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:03.731258 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:03.731547 26222 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet db5f5f16f2d7457799e1b96a293695f4 (table default.Table_1c2f2d6f4cda4715b2b22cf5a2106e5a [id=fd3816a55b234cad88a421587951bb94]) successfully deleted
I20260928 20:03:03.732350 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 394) took 8428 ms. Trace:
W20260928 20:03:03.732642 26450 leader_election.cc:343] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.732750 28059 rpcz_store.cc:276] 0928 20:02:55.303942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.304185 (+ 243us) service_pool.cc:224] Handling call
0928 20:03:03.730712 (+8426527us) ts_tablet_manager.cc:1197] Deleting tablet b0655fc043b9468ea51ce5ae983e8f06
0928 20:03:03.730777 (+ 65us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.732299 (+ 1522us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8426025}
W20260928 20:03:03.734046 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet b0655fc043b9468ea51ce5ae983e8f06 because the tablet was not found. No further retry: Not found: Tablet not found: b0655fc043b9468ea51ce5ae983e8f06
I20260928 20:03:03.734531 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 395) took 8428 ms. Trace:
I20260928 20:03:03.734841 28059 rpcz_store.cc:276] 0928 20:02:55.305992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.306115 (+ 123us) service_pool.cc:224] Handling call
0928 20:03:03.734214 (+8428099us) ts_tablet_manager.cc:1197] Deleting tablet 4d0308d824cf401c8cca0cf7a950fd53
0928 20:03:03.734280 (+ 66us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.734482 (+ 202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8427587}
W20260928 20:03:03.736119 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4d0308d824cf401c8cca0cf7a950fd53 because the tablet was not found. No further retry: Not found: Tablet not found: 4d0308d824cf401c8cca0cf7a950fd53
I20260928 20:03:03.737257 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 396) took 8431 ms. Trace:
I20260928 20:03:03.737568 28059 rpcz_store.cc:276] 0928 20:02:55.306316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.306744 (+ 428us) service_pool.cc:224] Handling call
0928 20:03:03.736927 (+8430183us) ts_tablet_manager.cc:1197] Deleting tablet 4c23636443834932852f21092be1d1ac
0928 20:03:03.736994 (+ 67us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.737203 (+ 209us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8429741}
W20260928 20:03:03.738884 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet 4c23636443834932852f21092be1d1ac because the tablet was not found. No further retry: Not found: Tablet not found: 4c23636443834932852f21092be1d1ac
I20260928 20:03:03.747579 26916 tablet_bootstrap.cc:492] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:03.748093 26916 ts_tablet_manager.cc:1449] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.001s
I20260928 20:03:03.750610 26916 raft_consensus.cc:359] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.751029 26913 tablet_bootstrap.cc:492] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:03.753183 26913 ts_tablet_manager.cc:1449] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.075s user 0.016s sys 0.002s
I20260928 20:03:03.753566 26916 raft_consensus.cc:385] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.753890 26916 raft_consensus.cc:740] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.754422 26169 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Refusing update from remote peer 5308dad1e3384995a990de7c4866f1b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 619. Preceding OpId from leader: term: 4 index: 621. (index mismatch)
I20260928 20:03:03.754807 26916 consensus_queue.cc:260] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.755769 26913 raft_consensus.cc:359] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.756072 28483 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 621, Last known committed idx: 619, Time since last communication: 0.000s
I20260928 20:03:03.756457 26913 raft_consensus.cc:385] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.756716 26913 raft_consensus.cc:740] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.762668 28448 raft_consensus.cc:493] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.763294 28448 raft_consensus.cc:515] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.765785 28448 leader_election.cc:290] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.767078 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:03.766793 26913 consensus_queue.cc:260] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.767904 26510 raft_consensus.cc:2393] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:03.769495 26913 ts_tablet_manager.cc:1480] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260928 20:03:03.770465 26913 tablet_bootstrap.cc:492] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:03.773975 26916 ts_tablet_manager.cc:1480] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260928 20:03:03.775985 27857 ts_tablet_manager.cc:1975] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:03.782925 27857 log.cc:1199] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/626a876a51d04095b5dd54726bb995f3
I20260928 20:03:03.782601 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.783329 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.784379 27857 ts_tablet_manager.cc:1996] T 626a876a51d04095b5dd54726bb995f3 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:03.785032 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.786926 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:03.789572 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 407) took 8243 ms. Trace:
I20260928 20:03:03.789880 27857 rpcz_store.cc:276] 0928 20:02:55.545833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.545931 (+ 98us) service_pool.cc:224] Handling call
0928 20:03:03.426962 (+7881031us) ts_tablet_manager.cc:1197] Deleting tablet 626a876a51d04095b5dd54726bb995f3
0928 20:03:03.427091 (+ 129us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.704418 (+277327us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.775810 (+ 71392us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.789512 (+ 13702us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30115,"tablet-delete.queue_time_us":7880331}
W20260928 20:03:03.782598 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 431725us
W20260928 20:03:03.795608 26450 leader_election.cc:343] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.796094 26450 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:03.797133 28357 raft_consensus.cc:2749] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.798357 26223 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 626a876a51d04095b5dd54726bb995f3 (table default.Table_487262bf721f4183a8850da9cac26908 [id=285085385d554cffa937cbcaa74294a1]) successfully deleted
I20260928 20:03:03.798759 27857 tablet_replica.cc:333] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:03.799569 27857 raft_consensus.cc:2243] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:03.800509 28427 raft_consensus.cc:493] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.803046 27857 raft_consensus.cc:2272] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:03.806627 27857 ts_tablet_manager.cc:1962] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:03.811532 26912 tablet_bootstrap.cc:492] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:03.812345 26912 ts_tablet_manager.cc:1449] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.406s user 0.009s sys 0.006s
I20260928 20:03:03.801417 28427 raft_consensus.cc:515] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.817198 28427 leader_election.cc:290] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:03.826210 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 391) took 8524 ms. Trace:
I20260928 20:03:03.826602 28059 rpcz_store.cc:276] 0928 20:02:55.302042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.325766 (+ 23724us) service_pool.cc:224] Handling call
0928 20:03:03.825826 (+8500060us) ts_tablet_manager.cc:1197] Deleting tablet b059111d6383414890a28c2947934dd8
0928 20:03:03.825890 (+ 64us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.826129 (+ 239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8499208}
W20260928 20:03:03.827958 26222 catalog_manager.cc:5030] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): delete failed for tablet b059111d6383414890a28c2947934dd8 because the tablet was not found. No further retry: Not found: Tablet not found: b059111d6383414890a28c2947934dd8
I20260928 20:03:03.828145 28059 tablet_replica.cc:333] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:03.818270 26912 raft_consensus.cc:359] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.829010 28059 raft_consensus.cc:2243] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:03.829525 28059 raft_consensus.cc:2272] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:03.830621 26912 raft_consensus.cc:385] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.832105 28059 ts_tablet_manager.cc:1962] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:03.830982 26912 raft_consensus.cc:740] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.838586 26912 consensus_queue.cc:260] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.841478 26912 ts_tablet_manager.cc:1480] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.029s user 0.004s sys 0.006s
I20260928 20:03:03.862622 28357 raft_consensus.cc:493] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:03.863176 28357 raft_consensus.cc:515] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.863729 26916 tablet_bootstrap.cc:492] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:03.865293 28357 leader_election.cc:290] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:03.867089 26913 tablet_bootstrap.cc:654] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.868659 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:03.870045 26450 leader_election.cc:343] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.846051 28030 ts_tablet_manager.cc:1975] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:03.884037 26912 tablet_bootstrap.cc:492] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:03.894151 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 113021us
W20260928 20:03:03.898602 26222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:03.920979 28503 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:03.921813 28503 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:03:03.929767 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 138224us
I20260928 20:03:03.940454 26916 tablet_bootstrap.cc:654] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.943137 28503 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:03.944000 28503 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:03:03.944803 26235 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1: default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af] alter complete (version 1)
W20260928 20:03:03.952638 26450 leader_election.cc:343] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.953075 26450 leader_election.cc:304] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:03.954138 26450 leader_election.cc:343] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.954480 26450 leader_election.cc:304] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:03.954613 26235 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43087 (request call id 68) took 4276 ms (client timeout 1000 ms). Trace:
W20260928 20:03:03.955435 26450 leader_election.cc:343] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.955760 26450 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:03.890774 28030 log.cc:1199] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4cd2204d99e14a07af962295b152d60f
I20260928 20:03:03.956418 28357 raft_consensus.cc:2749] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.956806 28496 raft_consensus.cc:2749] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.957010 28030 ts_tablet_manager.cc:1996] T 4cd2204d99e14a07af962295b152d60f P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:03.958069 28357 raft_consensus.cc:2749] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:03.955026 26235 rpcz_store.cc:269] 0928 20:02:59.678168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.679398 (+ 1230us) service_pool.cc:224] Handling call
0928 20:03:03.954529 (+4275131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:01.658761 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:01.683806 (+ 25045us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:01.683840 (+ 34us) write_op.cc:435] Acquired schema lock
0928 20:03:01.683861 (+ 21us) tablet.cc:662] Decoding operations
0928 20:03:01.684245 (+ 384us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:01.684312 (+ 67us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:01.684348 (+ 36us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:01.684535 (+ 187us) tablet.cc:701] Row locks acquired
0928 20:03:01.684556 (+ 21us) write_op.cc:260] PREPARE: finished
0928 20:03:01.684712 (+ 156us) write_op.cc:270] Start()
0928 20:03:01.684815 (+ 103us) write_op.cc:276] Timestamp: P: 1790625781684647 usec, L: 0
0928 20:03:01.684838 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:03:01.685743 (+ 905us) log.cc:844] Serialized 356 byte log entry
0928 20:03:01.787539 (+101796us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5400030fa0. stack: 00007ff796097373 00007ff796097270 00007ff795c3a574 0000000000516a24 00000000005169b9 00007ff79d196b01 00007ff79d1a33be 00007ff79d1adf30 00007ff79d1aded8 00007ff79d1ade58 00007ff79d1ade13 00007ff79d1ad09c 00007ff79f058e66 00007ff79f053618 00007ff79d1e9dcb 00007ff79d1ec8c0
0928 20:03:03.912703 (+2125164us) op_driver.cc:464] REPLICATION: finished
0928 20:03:03.935144 (+ 22441us) write_op.cc:301] APPLY: starting
0928 20:03:03.935252 (+ 108us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:03.935377 (+ 125us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:03.935408 (+ 31us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:03.935702 (+ 294us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:03.935891 (+ 189us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:03.935933 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:03:03.936245 (+ 312us) log.cc:844] Serialized 23 byte log entry
0928 20:03:03.942769 (+ 6524us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:03.942879 (+ 110us) write_op.cc:454] Released schema lock
0928 20:03:03.942926 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":22172,"num_ops":1,"prepare.queue_time_us":17107,"prepare.run_cpu_time_us":4785,"prepare.run_wall_time_us":64134,"raft.queue_time_us":116,"raft.run_cpu_time_us":985,"raft.run_wall_time_us":983,"replication_time_us":2227717,"spinlock_wait_cycles":54647552,"thread_start_us":433976,"threads_started":3,"wal-append.queue_time_us":49771,"wal-append.run_cpu_time_us":3327,"wal-append.run_wall_time_us":1052376}]]}
I20260928 20:03:03.958642 28357 consensus_queue.cc:1048] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:03.959688 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 365) took 11315 ms. Trace:
W20260928 20:03:03.960285 26450 leader_election.cc:343] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.960037 28030 rpcz_store.cc:276] 0928 20:02:52.644739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.644837 (+ 98us) service_pool.cc:224] Handling call
0928 20:03:03.412607 (+10767770us) ts_tablet_manager.cc:1197] Deleting tablet 4cd2204d99e14a07af962295b152d60f
0928 20:03:03.412674 (+ 67us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.589302 (+176628us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.845803 (+256501us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.959606 (+113803us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10767303}
I20260928 20:03:03.960632 26450 leader_election.cc:304] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:03.963361 28357 raft_consensus.cc:2749] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:03.967154 28470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:03.967939 28470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
W20260928 20:03:03.970566 26739 leader_election.cc:343] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:03.970590 27857 ts_tablet_manager.cc:1975] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:03.971253 27857 log.cc:1199] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/d8d27cbf353246fbb7fe09f385194d8a
I20260928 20:03:03.971092 26739 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:03.971927 27857 ts_tablet_manager.cc:1996] T d8d27cbf353246fbb7fe09f385194d8a P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:03.975929 26913 tablet_bootstrap.cc:492] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:03.976402 26913 ts_tablet_manager.cc:1449] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.206s user 0.006s sys 0.009s
I20260928 20:03:03.977216 28488 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 20:03:03.982993 26913 raft_consensus.cc:359] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.983692 26913 raft_consensus.cc:385] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:03.983948 26913 raft_consensus.cc:740] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:03.984596 26913 consensus_queue.cc:260] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:03.993675 26912 tablet_bootstrap.cc:654] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:03.999166 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 406) took 8453 ms. Trace:
I20260928 20:03:03.999480 27857 rpcz_store.cc:276] 0928 20:02:55.545501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.547106 (+ 1605us) service_pool.cc:224] Handling call
0928 20:03:03.798590 (+8251484us) ts_tablet_manager.cc:1197] Deleting tablet d8d27cbf353246fbb7fe09f385194d8a
0928 20:03:03.798647 (+ 57us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.905133 (+106486us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.970446 (+ 65313us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:03.999088 (+ 28642us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8250675}
I20260928 20:03:03.995949 28428 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:04.001704 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 408) took 7742 ms. Trace:
I20260928 20:03:04.002053 27857 rpcz_store.cc:276] 0928 20:02:56.259660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.259774 (+ 114us) service_pool.cc:224] Handling call
0928 20:03:04.001322 (+7741548us) ts_tablet_manager.cc:1197] Deleting tablet 762cb728cc574a36a68fbe9033544b04
0928 20:03:04.001374 (+ 52us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.001649 (+ 275us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7711446}
I20260928 20:03:04.002398 28059 ts_tablet_manager.cc:1975] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:04.002749 28059 log.cc:1199] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/775b9a076bf048bea39423d3554babf7
I20260928 20:03:04.003445 28059 ts_tablet_manager.cc:1996] T 775b9a076bf048bea39423d3554babf7 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:04.003523 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:04.005731 26450 leader_election.cc:343] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.007522 26450 leader_election.cc:304] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.008189 28357 raft_consensus.cc:2749] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.011854 26913 ts_tablet_manager.cc:1480] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260928 20:03:04.013671 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 398) took 8544 ms. Trace:
I20260928 20:03:04.013980 28059 rpcz_store.cc:276] 0928 20:02:55.469413 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.469532 (+ 119us) service_pool.cc:224] Handling call
0928 20:03:03.827958 (+8358426us) ts_tablet_manager.cc:1197] Deleting tablet 775b9a076bf048bea39423d3554babf7
0928 20:03:03.828018 (+ 60us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:03.913269 (+ 85251us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.002251 (+ 88982us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.013610 (+ 11359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8209,"tablet-delete.queue_time_us":8357819}
W20260928 20:03:04.016271 26740 consensus_peers.cc:597] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01533b61bad74ddb9056aeacef13a126. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:04.017764 26740 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542
I20260928 20:03:04.018771 26913 tablet_bootstrap.cc:492] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:04.030555 28059 tablet_replica.cc:333] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:04.031420 28059 raft_consensus.cc:2243] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.031849 28059 pending_rounds.cc:70] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:03:04.032078 28059 pending_rounds.cc:77] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403181186514944 op_type: NO_OP noop_request { }
I20260928 20:03:04.032428 28059 raft_consensus.cc:2889] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:04.032743 28059 raft_consensus.cc:2272] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.035921 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:04.043547 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:04.048646 28030 tablet_replica.cc:333] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:04.049571 28030 raft_consensus.cc:2243] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.050266 28030 raft_consensus.cc:2272] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.052443 28030 ts_tablet_manager.cc:1962] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.061232 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:04.050081 26913 tablet_bootstrap.cc:654] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.010092 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 409) took 7739 ms. Trace:
I20260928 20:03:04.066450 27857 rpcz_store.cc:276] 0928 20:02:56.271146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.271323 (+ 177us) service_pool.cc:224] Handling call
0928 20:03:04.009631 (+7738308us) ts_tablet_manager.cc:1197] Deleting tablet 03509d3602b345f69f059ae11c461920
0928 20:03:04.009696 (+ 65us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.010033 (+ 337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7719539}
I20260928 20:03:04.054724 28059 ts_tablet_manager.cc:1962] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.076737 28517 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260928 20:03:04.091564 26912 tablet_bootstrap.cc:492] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:04.092165 26912 ts_tablet_manager.cc:1449] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.208s user 0.010s sys 0.003s
I20260928 20:03:04.111850 26916 tablet_bootstrap.cc:492] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:04.112409 26916 ts_tablet_manager.cc:1449] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.249s user 0.010s sys 0.002s
I20260928 20:03:04.112548 26913 tablet_bootstrap.cc:492] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:04.112964 26913 ts_tablet_manager.cc:1449] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.094s user 0.008s sys 0.002s
I20260928 20:03:04.115020 26916 raft_consensus.cc:359] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.115334 26913 raft_consensus.cc:359] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.115702 26916 raft_consensus.cc:385] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.115998 26913 raft_consensus.cc:385] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.116045 26916 raft_consensus.cc:740] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.116269 26913 raft_consensus.cc:740] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.117008 26913 consensus_queue.cc:260] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.116974 26916 consensus_queue.cc:260] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.119982 26916 ts_tablet_manager.cc:1480] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260928 20:03:04.120261 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ba5d2cc979241c4918a154f25dcd305" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:04.121879 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:04.131184 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1c8e5a49db49f39e90c3737c33e8fc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:04.134132 26913 ts_tablet_manager.cc:1480] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20260928 20:03:04.135006 26913 tablet_bootstrap.cc:492] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:04.134757 26912 raft_consensus.cc:359] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.135543 26912 raft_consensus.cc:385] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.135878 26912 raft_consensus.cc:740] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.136797 26912 consensus_queue.cc:260] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.139075 26912 ts_tablet_manager.cc:1480] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.047s user 0.005s sys 0.001s
I20260928 20:03:04.153648 28059 ts_tablet_manager.cc:1975] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:04.170300 28059 log.cc:1199] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/385278bf2df34f4f960a0cfdebd79be5
I20260928 20:03:04.171211 28059 ts_tablet_manager.cc:1996] T 385278bf2df34f4f960a0cfdebd79be5 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:04.164594 26913 tablet_bootstrap.cc:654] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.142715 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 417) took 7586 ms. Trace:
I20260928 20:03:04.174952 26916 tablet_bootstrap.cc:492] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:04.175158 27857 rpcz_store.cc:276] 0928 20:02:56.556170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.556298 (+ 128us) service_pool.cc:224] Handling call
0928 20:03:04.067474 (+7511176us) ts_tablet_manager.cc:1197] Deleting tablet e868e5a3ebd2494ca20e1e08a146850e
0928 20:03:04.142354 (+ 74880us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.142653 (+ 299us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7510507}
I20260928 20:03:04.176394 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 418) took 7610 ms. Trace:
I20260928 20:03:04.176693 27857 rpcz_store.cc:276] 0928 20:02:56.565952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.570733 (+ 4781us) service_pool.cc:224] Handling call
0928 20:03:04.176002 (+7605269us) ts_tablet_manager.cc:1197] Deleting tablet 030f48d0d716450aaa4248d9fb1397ba
0928 20:03:04.176072 (+ 70us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.176343 (+ 271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7604675}
I20260928 20:03:04.178186 27857 tablet_replica.cc:333] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:04.179029 27857 raft_consensus.cc:2243] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.179617 27857 raft_consensus.cc:2272] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.180888 26916 tablet_bootstrap.cc:654] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.141316 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 775b9a076bf048bea39423d3554babf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:39 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:03:04.163844 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:03:04.183029 26912 tablet_bootstrap.cc:492] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:04.183084 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 385278bf2df34f4f960a0cfdebd79be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:36 UTC) from {username='slave'} at 127.0.0.1:41770
I20260928 20:03:04.187224 26655 raft_consensus.cc:3060] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.181991 27857 ts_tablet_manager.cc:1962] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.195339 26913 tablet_bootstrap.cc:492] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:04.195813 26913 ts_tablet_manager.cc:1449] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.061s user 0.006s sys 0.004s
I20260928 20:03:04.197733 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:03:04.204234 28233 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63: Append to log took a long time: real 0.139s user 0.019s sys 0.001s
I20260928 20:03:04.198148 26913 raft_consensus.cc:359] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.218289 26913 raft_consensus.cc:385] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.218628 26913 raft_consensus.cc:740] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.219343 26913 consensus_queue.cc:260] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.225123 26913 ts_tablet_manager.cc:1480] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.029s user 0.005s sys 0.001s
I20260928 20:03:04.228471 26646 raft_consensus.cc:3060] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.223670 27857 ts_tablet_manager.cc:1975] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:03:04.248175 27857 log.cc:1199] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/0de800a9344d4507b7903d08fcf8e988
I20260928 20:03:04.249423 27857 ts_tablet_manager.cc:1996] T 0de800a9344d4507b7903d08fcf8e988 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:04.256628 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 420) took 7666 ms. Trace:
I20260928 20:03:04.257175 27857 rpcz_store.cc:276] 0928 20:02:56.590270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.590405 (+ 135us) service_pool.cc:224] Handling call
0928 20:03:04.177484 (+7587079us) ts_tablet_manager.cc:1197] Deleting tablet 0de800a9344d4507b7903d08fcf8e988
0928 20:03:04.178030 (+ 546us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.202746 (+ 24716us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.223541 (+ 20795us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.256536 (+ 32995us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7586463}
I20260928 20:03:04.259949 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 429) took 7352 ms. Trace:
I20260928 20:03:04.261404 26656 raft_consensus.cc:3060] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.261626 27857 rpcz_store.cc:276] 0928 20:02:56.907838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.908031 (+ 193us) service_pool.cc:224] Handling call
0928 20:03:04.259512 (+7351481us) ts_tablet_manager.cc:1197] Deleting tablet fe680423497941578a5dfff2507e3334
0928 20:03:04.259577 (+ 65us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.259894 (+ 317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7350748}
I20260928 20:03:04.269830 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 431) took 7295 ms. Trace:
I20260928 20:03:04.270304 27857 rpcz_store.cc:276] 0928 20:02:56.974468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.996440 (+ 21972us) service_pool.cc:224] Handling call
0928 20:03:04.269461 (+7273021us) ts_tablet_manager.cc:1197] Deleting tablet b667a45712c1449384e1a288f55fd062
0928 20:03:04.269530 (+ 69us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.269765 (+ 235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7272425}
I20260928 20:03:04.272620 27857 tablet_replica.cc:333] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:04.275550 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 399) took 7098 ms. Trace:
I20260928 20:03:04.275882 28059 rpcz_store.cc:276] 0928 20:02:57.177164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.177296 (+ 132us) service_pool.cc:224] Handling call
0928 20:03:04.030382 (+6853086us) ts_tablet_manager.cc:1197] Deleting tablet 385278bf2df34f4f960a0cfdebd79be5
0928 20:03:04.030441 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.099570 (+ 69129us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.153519 (+ 53949us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.275470 (+121951us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6852534}
I20260928 20:03:04.278014 26913 tablet_bootstrap.cc:492] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:04.283442 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 401) took 7105 ms. Trace:
I20260928 20:03:04.283838 28059 rpcz_store.cc:276] 0928 20:02:57.178239 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.181234 (+ 2995us) service_pool.cc:224] Handling call
0928 20:03:04.276798 (+7095564us) ts_tablet_manager.cc:1197] Deleting tablet 762cb728cc574a36a68fbe9033544b04
0928 20:03:04.276855 (+ 57us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.283382 (+ 6527us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7095045}
I20260928 20:03:04.285312 28059 tablet_replica.cc:333] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:04.286964 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb8477c5cb74205b4b55eb38d7f9542" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:04.287758 26913 tablet_bootstrap.cc:654] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.287691 26653 raft_consensus.cc:2468] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:04.290165 28059 raft_consensus.cc:2243] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:04.291107 28059 pending_rounds.cc:70] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:03:04.291340 28059 pending_rounds.cc:77] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403192780214272 op_type: NO_OP noop_request { }
I20260928 20:03:04.291667 28059 raft_consensus.cc:2889] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:04.292455 28059 raft_consensus.cc:2272] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.294567 28059 ts_tablet_manager.cc:1962] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.304296 26913 tablet_bootstrap.cc:492] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:04.304847 26913 ts_tablet_manager.cc:1449] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.027s user 0.012s sys 0.000s
I20260928 20:03:04.307533 26913 raft_consensus.cc:359] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:04.308169 26913 raft_consensus.cc:385] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.308425 26913 raft_consensus.cc:740] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.311980 26913 consensus_queue.cc:260] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:04.315347 26913 ts_tablet_manager.cc:1480] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260928 20:03:04.316246 26913 tablet_bootstrap.cc:492] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:04.331416 26222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:04.321991 26913 tablet_bootstrap.cc:654] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.364028 26912 tablet_bootstrap.cc:654] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.371946 27857 raft_consensus.cc:2243] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.372505 27857 raft_consensus.cc:2272] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.374223 27857 ts_tablet_manager.cc:1962] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.364274 26594 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:04.391928 26594 consensus_peers.cc:597] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cd2204d99e14a07af962295b152d60f. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:04.392750 26594 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.401259 28525 raft_consensus.cc:2749] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:03:04.402797 28525 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.403203 28525 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.405416 28525 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.398844 28448 raft_consensus.cc:2749] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260928 20:03:04.408054 26594 consensus_peers.cc:597] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:04.419872 28448 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.420395 28448 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.422029 28357 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.422407 28448 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.422523 28357 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.423487 27857 ts_tablet_manager.cc:1975] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:04.424475 28357 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:04.423815 27857 log.cc:1199] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/f55c1732e13e4e2ab4f5c5d80d0fa4f6
W20260928 20:03:04.426615 26595 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:04.428207 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:04.428867 27857 ts_tablet_manager.cc:1996] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:04.389683 28030 ts_tablet_manager.cc:1975] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:04.434451 28030 log.cc:1199] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/ad0cbde5f5dc4ff6a046b16b1e2b9786
I20260928 20:03:04.435213 28030 ts_tablet_manager.cc:1996] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:03:04.435125 26450 leader_election.cc:343] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.436628 28421 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:04.437220 28421 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:03:04.446758 26595 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
W20260928 20:03:04.451921 27900 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:48177 (request call id 17) took 2442 ms (client timeout 1000 ms). Trace:
W20260928 20:03:04.452458 27900 rpcz_store.cc:269] 0928 20:03:02.009748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.012208 (+ 2460us) service_pool.cc:224] Handling call
0928 20:03:04.443989 (+2431781us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773e90ce 00007fab74f89fb4 00007fab74f89f42 00007fab74f89e71 00007fab74f89dec 00007fab74f890a2 00007fab7323b15c 00007fab7323a596
0928 20:03:04.451670 (+ 7681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5584160512}
I20260928 20:03:04.454499 26594 leader_election.cc:304] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.456738 26594 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.458257 28534 raft_consensus.cc:2749] T 4ba5d2cc979241c4918a154f25dcd305 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.459537 28534 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.459709 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 3 candidate_status { last_received { term: 2 index: 619 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:04.431900 26913 tablet_bootstrap.cc:492] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:04.462093 26913 ts_tablet_manager.cc:1449] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.146s user 0.014s sys 0.003s
I20260928 20:03:04.469218 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 434) took 7474 ms. Trace:
I20260928 20:03:04.469684 27857 rpcz_store.cc:276] 0928 20:02:56.995098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.004616 (+ 9518us) service_pool.cc:224] Handling call
0928 20:03:04.272457 (+7267841us) ts_tablet_manager.cc:1197] Deleting tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6
0928 20:03:04.272510 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.381704 (+109194us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.423353 (+ 41649us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.469153 (+ 45800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98168,"tablet-delete.queue_time_us":7265947}
W20260928 20:03:04.471692 27897 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43199 (request call id 10) took 2670 ms (client timeout 1000 ms). Trace:
I20260928 20:03:04.472049 26594 leader_election.cc:304] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:04.472108 27897 rpcz_store.cc:269] 0928 20:03:01.794463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.794605 (+ 142us) service_pool.cc:224] Handling call
0928 20:03:04.454657 (+2660052us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773e90ce 00007fab74f89fb4 00007fab74f89f42 00007fab74f89e71 00007fab74f89dec 00007fab74f890a2 00007fab7323b15c 00007fab7323a596
0928 20:03:04.464876 (+ 10219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6099331456}
I20260928 20:03:04.477313 28533 raft_consensus.cc:2749] T 2d1c8e5a49db49f39e90c3737c33e8fc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.480257 27894 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:55518 (request call id 0) took 1592 ms. Trace:
I20260928 20:03:04.480697 27894 rpcz_store.cc:276] 0928 20:03:02.887121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.890769 (+ 3648us) service_pool.cc:224] Handling call
0928 20:03:04.477231 (+1586462us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773ec3a9 00007fab74f8c534 00007fab74f8c4c2 00007fab74f8c3f1 00007fab74f8c36c 00007fab74f8b622 00007fab7323b15c 00007fab7323a596
0928 20:03:04.479806 (+ 2575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3595445632}
I20260928 20:03:04.495384 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:04.502287 27893 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:50897 (request call id 28) took 1403 ms (client timeout 1000 ms). Trace:
I20260928 20:03:04.505451 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 433) took 7510 ms. Trace:
I20260928 20:03:04.506129 27857 rpcz_store.cc:276] 0928 20:02:56.994832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.009459 (+ 14627us) service_pool.cc:224] Handling call
0928 20:03:04.505106 (+7495647us) ts_tablet_manager.cc:1197] Deleting tablet d13562e920244194969520df564a949d
0928 20:03:04.505182 (+ 76us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.505390 (+ 208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7494619}
W20260928 20:03:04.508085 27895 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43199 (request call id 11) took 1686 ms (client timeout 1000 ms). Trace:
W20260928 20:03:04.508546 27895 rpcz_store.cc:269] 0928 20:03:02.821259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.821450 (+ 191us) service_pool.cc:224] Handling call
0928 20:03:04.460455 (+1639005us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773e90ce 00007fab74f89fb4 00007fab74f89f42 00007fab74f89e71 00007fab74f89dec 00007fab74f890a2 00007fab7323b15c 00007fab7323a596
0928 20:03:04.507683 (+ 47228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3731956992}
W20260928 20:03:04.511480 27892 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:48177 (request call id 18) took 910 ms (client timeout 1000 ms). Trace:
W20260928 20:03:04.511879 27892 rpcz_store.cc:269] 0928 20:03:03.566170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:03.566368 (+ 198us) service_pool.cc:224] Handling call
0928 20:03:04.468060 (+901692us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773e90ce 00007fab74f89fb4 00007fab74f89f42 00007fab74f89e71 00007fab74f89dec 00007fab74f890a2 00007fab7323b15c 00007fab7323a596
0928 20:03:04.476583 (+ 8523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018854784}
I20260928 20:03:04.514577 27857 tablet_replica.cc:333] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:04.515401 27857 raft_consensus.cc:2243] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.516095 28421 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
W20260928 20:03:04.521530 27896 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:50897 (request call id 27) took 2436 ms (client timeout 1000 ms). Trace:
I20260928 20:03:04.495846 26916 tablet_bootstrap.cc:492] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:03:04.496701 26450 leader_election.cc:343] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.522336 26450 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.470242 26510 raft_consensus.cc:1275] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260928 20:03:04.522152 27896 rpcz_store.cc:269] 0928 20:03:02.076239 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:02.076416 (+ 177us) service_pool.cc:224] Handling call
0928 20:03:04.446823 (+2370407us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773e90ce 00007fab74f89fb4 00007fab74f89f42 00007fab74f89e71 00007fab74f89dec 00007fab74f890a2 00007fab7323b15c 00007fab7323a596
0928 20:03:04.512427 (+ 65604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5441635200}
I20260928 20:03:04.523367 28357 raft_consensus.cc:2749] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.524129 28448 consensus_queue.cc:1048] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260928 20:03:04.502996 27893 rpcz_store.cc:269] 0928 20:03:03.093872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:03.094069 (+ 197us) service_pool.cc:224] Handling call
0928 20:03:04.448027 (+1353958us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400080554. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab754d65d0 00007fab755757ca 00007fab772eae3c 00007fab773e90ce 00007fab74f89fb4 00007fab74f89f42 00007fab74f89e71 00007fab74f89dec 00007fab74f890a2 00007fab7323b15c 00007fab7323a596
0928 20:03:04.496763 (+ 48736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3099224960}
I20260928 20:03:04.525648 26916 ts_tablet_manager.cc:1449] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.351s user 0.005s sys 0.005s
I20260928 20:03:04.528081 26916 raft_consensus.cc:359] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.528695 26916 raft_consensus.cc:385] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.528939 26916 raft_consensus.cc:740] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.530793 26916 consensus_queue.cc:260] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.532742 28428 consensus_queue.cc:1048] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:04.533090 26916 ts_tablet_manager.cc:1480] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260928 20:03:04.533555 27857 raft_consensus.cc:2272] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.543527 27857 ts_tablet_manager.cc:1962] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.417795 28059 ts_tablet_manager.cc:1975] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:04.545722 26916 tablet_bootstrap.cc:492] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:04.550793 26912 tablet_bootstrap.cc:492] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:04.551335 26912 ts_tablet_manager.cc:1449] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.369s user 0.008s sys 0.007s
I20260928 20:03:04.549969 28059 log.cc:1199] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/1284d1f7fa774033b90133447627df4f
I20260928 20:03:04.560864 27923 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 2 FOLLOWER]: Advancing to term 4
I20260928 20:03:04.553467 26913 raft_consensus.cc:359] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.572625 26913 raft_consensus.cc:385] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.573185 26913 raft_consensus.cc:740] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.574472 26913 consensus_queue.cc:260] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.577270 26916 tablet_bootstrap.cc:654] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.577220 28059 ts_tablet_manager.cc:1996] T 1284d1f7fa774033b90133447627df4f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:03:04.578434 26740 consensus_peers.cc:597] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0de800a9344d4507b7903d08fcf8e988. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:04.579700 27924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56002 (request call id 1) took 3093 ms. Trace:
I20260928 20:03:04.590379 28357 raft_consensus.cc:493] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.590962 28357 raft_consensus.cc:515] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.594424 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:04.595373 28357 leader_election.cc:290] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:04.596025 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:04.595896 26450 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:04.597743 26450 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.598189 26450 leader_election.cc:304] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.598506 27923 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Refusing update from remote peer 5308dad1e3384995a990de7c4866f1b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 619. Preceding OpId from leader: term: 4 index: 621. (index mismatch)
I20260928 20:03:04.599340 28357 raft_consensus.cc:2749] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.605683 28428 raft_consensus.cc:493] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.606379 28428 raft_consensus.cc:515] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:04.610968 26740 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:03:04.623526 28483 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 621, Last known committed idx: 619, Time since last communication: 0.000s
W20260928 20:03:04.639717 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 159349us
I20260928 20:03:04.644462 26916 tablet_bootstrap.cc:492] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:04.646912 28428 leader_election.cc:290] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.647660 26916 ts_tablet_manager.cc:1449] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.102s user 0.011s sys 0.002s
I20260928 20:03:04.649999 28448 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.650511 28448 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.653918 26916 raft_consensus.cc:359] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:04.654485 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 56770.3us
I20260928 20:03:04.655998 28448 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.657222 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:04.657766 26504 raft_consensus.cc:2468] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:04.658571 26913 ts_tablet_manager.cc:1480] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.196s user 0.004s sys 0.004s
I20260928 20:03:04.658701 26595 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:04.659503 28448 raft_consensus.cc:2804] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:04.659880 28448 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:04.659655 26912 raft_consensus.cc:359] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:04.660295 26912 raft_consensus.cc:385] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.660534 26912 raft_consensus.cc:740] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.661369 28448 raft_consensus.cc:3060] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.661285 26912 consensus_queue.cc:260] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:04.668990 28448 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.686075 28543 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.686528 28543 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.687016 26794 raft_consensus.cc:1275] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260928 20:03:04.688478 28543 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.688874 28543 raft_consensus.cc:493] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.689229 28543 raft_consensus.cc:515] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.691188 28543 leader_election.cc:290] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.693068 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:04.693655 26505 raft_consensus.cc:2468] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:04.695016 26740 leader_election.cc:304] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:04.695904 28543 raft_consensus.cc:2804] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:04.696237 28543 raft_consensus.cc:493] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:04.696574 28543 raft_consensus.cc:3060] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.704842 27857 ts_tablet_manager.cc:1975] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:04.706439 28542 raft_consensus.cc:493] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.705514 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:04.710294 28542 raft_consensus.cc:515] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.711056 26510 raft_consensus.cc:2468] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:04.714262 27857 log.cc:1199] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/7242f71b93914dbeadb60617b3f2be3b
I20260928 20:03:04.714545 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:04.713843 28542 leader_election.cc:290] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:04.712574 26740 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:04.715675 26450 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.670006 26913 tablet_bootstrap.cc:492] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:04.674094 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 400) took 7496 ms. Trace:
I20260928 20:03:04.720537 28059 rpcz_store.cc:276] 0928 20:02:57.177927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.183384 (+ 5457us) service_pool.cc:224] Handling call
0928 20:03:04.285129 (+7101745us) ts_tablet_manager.cc:1197] Deleting tablet 1284d1f7fa774033b90133447627df4f
0928 20:03:04.285204 (+ 75us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.387056 (+101852us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.417661 (+ 30605us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.674033 (+256372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3019,"tablet-delete.queue_time_us":7101198}
I20260928 20:03:04.722451 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 402) took 7528 ms. Trace:
I20260928 20:03:04.713281 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:04.685025 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a86cd5167c43a4beb51cd3138cdef8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:04.723714 26646 raft_consensus.cc:2468] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:04.722833 28059 rpcz_store.cc:276] 0928 20:02:57.194443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.210027 (+ 15584us) service_pool.cc:224] Handling call
0928 20:03:04.722011 (+7511984us) ts_tablet_manager.cc:1197] Deleting tablet 03509d3602b345f69f059ae11c461920
0928 20:03:04.722074 (+ 63us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.722397 (+ 323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7510956}
I20260928 20:03:04.724315 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 366) took 12078 ms. Trace:
I20260928 20:03:04.724931 28428 raft_consensus.cc:2804] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:04.725235 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 411) took 7458 ms. Trace:
I20260928 20:03:04.725610 28059 rpcz_store.cc:276] 0928 20:02:57.266713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.271403 (+ 4690us) service_pool.cc:224] Handling call
0928 20:03:04.724829 (+7453426us) ts_tablet_manager.cc:1197] Deleting tablet e868e5a3ebd2494ca20e1e08a146850e
0928 20:03:04.724893 (+ 64us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.725159 (+ 266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7452864}
I20260928 20:03:04.724656 28030 rpcz_store.cc:276] 0928 20:02:52.645581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.685731 (+ 40150us) service_pool.cc:224] Handling call
0928 20:03:03.994818 (+11309087us) ts_tablet_manager.cc:1197] Deleting tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
0928 20:03:04.047558 (+ 52740us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.146220 (+ 98662us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.389561 (+243341us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.724236 (+334675us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11308445}
I20260928 20:03:04.727473 28428 raft_consensus.cc:493] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:04.727619 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 412) took 7357 ms. Trace:
I20260928 20:03:04.727820 28428 raft_consensus.cc:3060] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.727905 28059 rpcz_store.cc:276] 0928 20:02:57.370744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.371627 (+ 883us) service_pool.cc:224] Handling call
0928 20:03:04.727001 (+7355374us) ts_tablet_manager.cc:1197] Deleting tablet 030f48d0d716450aaa4248d9fb1397ba
0928 20:03:04.727059 (+ 58us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.727566 (+ 507us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7354773}
I20260928 20:03:04.728325 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 372) took 12022 ms. Trace:
I20260928 20:03:04.728641 28030 rpcz_store.cc:276] 0928 20:02:52.705577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.705674 (+ 97us) service_pool.cc:224] Handling call
0928 20:03:04.727903 (+12022229us) ts_tablet_manager.cc:1197] Deleting tablet 4056bc0590264672bd7c4f6d97050dd5
0928 20:03:04.727985 (+ 82us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.728272 (+ 287us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12021706}
I20260928 20:03:04.729364 28059 tablet_replica.cc:333] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:04.730191 28059 raft_consensus.cc:2243] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.729898 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 370) took 12025 ms. Trace:
I20260928 20:03:04.730772 28059 raft_consensus.cc:2272] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.730736 28030 rpcz_store.cc:276] 0928 20:02:52.704966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.708611 (+ 3645us) service_pool.cc:224] Handling call
0928 20:03:04.729509 (+12020898us) ts_tablet_manager.cc:1197] Deleting tablet d13562e920244194969520df564a949d
0928 20:03:04.729563 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.729842 (+ 279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12020367}
I20260928 20:03:04.727218 28543 raft_consensus.cc:515] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.734846 26913 tablet_bootstrap.cc:654] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.732182 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 373) took 11888 ms. Trace:
I20260928 20:03:04.654644 26916 raft_consensus.cc:385] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.735531 26916 raft_consensus.cc:740] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.735191 28030 rpcz_store.cc:276] 0928 20:02:52.844097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.930595 (+ 86498us) service_pool.cc:224] Handling call
0928 20:03:04.731745 (+11801150us) ts_tablet_manager.cc:1197] Deleting tablet 2239c466fa8e471e820173c67bc04cad
0928 20:03:04.731798 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.732131 (+ 333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11800254}
I20260928 20:03:04.736487 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 378) took 11889 ms. Trace:
I20260928 20:03:04.736478 26916 consensus_queue.cc:260] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.736797 28030 rpcz_store.cc:276] 0928 20:02:52.846828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.958254 (+111426us) service_pool.cc:224] Handling call
0928 20:03:04.736109 (+11777855us) ts_tablet_manager.cc:1197] Deleting tablet b667a45712c1449384e1a288f55fd062
0928 20:03:04.736159 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.736436 (+ 277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11777226}
I20260928 20:03:04.738068 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 380) took 11350 ms. Trace:
I20260928 20:03:04.742090 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:04.751478 26794 raft_consensus.cc:2468] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:04.752336 28030 rpcz_store.cc:276] 0928 20:02:53.387699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.388622 (+ 923us) service_pool.cc:224] Handling call
0928 20:03:04.737699 (+11349077us) ts_tablet_manager.cc:1197] Deleting tablet 5ac6aaf0a2434c1fb74dd313fd4b7116
0928 20:03:04.737749 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.738020 (+ 271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11348307}
I20260928 20:03:04.754213 28030 tablet_replica.cc:333] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:04.755681 28030 raft_consensus.cc:2243] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.756855 28059 ts_tablet_manager.cc:1962] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.766245 28534 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.766737 28534 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:04.766992 26450 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.767359 28357 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.767803 28357 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.768992 28534 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.769702 28357 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:04.767398 26450 leader_election.cc:304] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:04.773846 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:04.775355 28357 raft_consensus.cc:2749] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:04.776978 28030 raft_consensus.cc:2272] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.782231 28030 ts_tablet_manager.cc:1962] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:03:04.783515 26595 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
W20260928 20:03:04.784392 26450 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:04.786639 28517 tablet.cc:1751] T 47bf3dd9ed054197b4208324938d96b0 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260928 20:03:04.788225 28448 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.789322 27857 ts_tablet_manager.cc:1996] T 7242f71b93914dbeadb60617b3f2be3b P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:04.791507 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:04.792049 26505 raft_consensus.cc:3060] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.796496 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:04.797050 26504 raft_consensus.cc:3060] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.804287 26504 raft_consensus.cc:2468] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:04.805058 26913 tablet_bootstrap.cc:492] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:04.805528 26913 ts_tablet_manager.cc:1449] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.136s user 0.009s sys 0.000s
I20260928 20:03:04.807924 26913 raft_consensus.cc:359] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.809756 26595 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:04.812471 28448 raft_consensus.cc:2804] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:04.812911 28448 raft_consensus.cc:697] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:04.813679 28448 consensus_queue.cc:237] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.818254 26505 raft_consensus.cc:2468] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:04.823549 26916 ts_tablet_manager.cc:1480] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.172s user 0.005s sys 0.000s
I20260928 20:03:04.824920 26916 tablet_bootstrap.cc:492] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:04.826151 28504 raft_consensus.cc:493] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:04.826575 28504 raft_consensus.cc:515] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:04.828560 28504 leader_election.cc:290] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:04.791533 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 435) took 7796 ms. Trace:
I20260928 20:03:04.837200 27857 rpcz_store.cc:276] 0928 20:02:56.995376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.010519 (+ 15143us) service_pool.cc:224] Handling call
0928 20:03:04.514419 (+7503900us) ts_tablet_manager.cc:1197] Deleting tablet 7242f71b93914dbeadb60617b3f2be3b
0928 20:03:04.514469 (+ 50us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.593567 (+ 79098us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.704709 (+111142us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.791470 (+ 86761us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7502943}
I20260928 20:03:04.843251 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 440) took 6652 ms. Trace:
I20260928 20:03:04.843660 27857 rpcz_store.cc:276] 0928 20:02:58.190493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.190600 (+ 107us) service_pool.cc:224] Handling call
0928 20:03:04.842875 (+6652275us) ts_tablet_manager.cc:1197] Deleting tablet 46c39c6915964116ac14ea2781c7a52b
0928 20:03:04.842929 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.843193 (+ 264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6391448}
I20260928 20:03:04.845660 27857 tablet_replica.cc:333] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:04.795737 28544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:04.850399 28544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:03:04.850682 28552 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:04.802740 28421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5308dad1e3384995a990de7c4866f1b1. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:04.851477 28421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:03:04.851142 28552 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:04.854351 27857 raft_consensus.cc:2243] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:04.856916 27857 raft_consensus.cc:2272] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:04.808560 26913 raft_consensus.cc:385] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.859479 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:04.862380 26504 raft_consensus.cc:2468] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:04.860848 26916 tablet_bootstrap.cc:654] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.858913 26913 raft_consensus.cc:740] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.865031 27857 ts_tablet_manager.cc:1962] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:04.750172 28543 leader_election.cc:290] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.743742 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:04.760958 28428 raft_consensus.cc:515] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.770354 28506 consensus_queue.cc:1048] T e3e86ccb8c334a54b42913bd5f405942 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:04.884634 28428 leader_election.cc:290] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:04.886029 26222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:04.886682 26790 raft_consensus.cc:2393] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
W20260928 20:03:04.773509 26739 consensus_peers.cc:597] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01533b61bad74ddb9056aeacef13a126. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:04.889704 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 116307us
I20260928 20:03:04.750272 26912 ts_tablet_manager.cc:1480] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.199s user 0.006s sys 0.001s
I20260928 20:03:04.890704 26740 leader_election.cc:304] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:04.876436 26913 consensus_queue.cc:260] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.902261 26916 tablet_bootstrap.cc:492] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:04.902773 26916 ts_tablet_manager.cc:1449] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.003s
I20260928 20:03:04.905696 26739 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:04.906867 28428 consensus_queue.cc:1048] T 2d1c8e5a49db49f39e90c3737c33e8fc P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:04.907714 28506 raft_consensus.cc:2749] T d3e2de7890874892be6ae5a2008d8a12 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:03:04.907821 26739 leader_election.cc:304] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:04.908705 26916 raft_consensus.cc:359] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.909359 26916 raft_consensus.cc:385] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:04.913784 26916 raft_consensus.cc:740] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:04.914510 26916 consensus_queue.cc:260] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.910179 28506 raft_consensus.cc:2804] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:04.916719 26913 ts_tablet_manager.cc:1480] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.111s user 0.003s sys 0.005s
I20260928 20:03:04.916769 28506 raft_consensus.cc:493] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:04.917095 28506 raft_consensus.cc:3060] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:04.917630 26913 tablet_bootstrap.cc:492] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:04.918560 28552 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:04.921308 27922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:04.922437 28551 raft_consensus.cc:2804] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:04.922886 28551 raft_consensus.cc:697] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:04.923668 28551 consensus_queue.cc:237] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:04.924489 26916 ts_tablet_manager.cc:1480] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.021s user 0.004s sys 0.001s
I20260928 20:03:04.952420 26913 tablet_bootstrap.cc:654] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:04.954396 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 44530.6us
I20260928 20:03:04.987298 26740 leader_election.cc:304] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:04.993319 27857 ts_tablet_manager.cc:1975] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:04.995222 27857 log.cc:1199] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/91b11022fc774d18b92e0c694f834375
I20260928 20:03:04.958092 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:04.958812 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 49669.9us
I20260928 20:03:04.970048 26912 tablet_bootstrap.cc:492] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:04.996464 26916 tablet_bootstrap.cc:492] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:05.005684 26912 tablet_bootstrap.cc:654] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:04.959653 28506 raft_consensus.cc:515] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.006480 26916 tablet_bootstrap.cc:654] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.007822 28506 leader_election.cc:290] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:04.957182 28030 ts_tablet_manager.cc:1975] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:03:05.010437 28030 log.cc:1199] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/ba87a379ae6a4feabfbc9fd6ba2d488e
I20260928 20:03:05.011265 28030 ts_tablet_manager.cc:1996] T ba87a379ae6a4feabfbc9fd6ba2d488e P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:05.013484 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 382) took 11622 ms. Trace:
I20260928 20:03:05.013849 28030 rpcz_store.cc:276] 0928 20:02:53.391105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.391456 (+ 351us) service_pool.cc:224] Handling call
0928 20:03:04.754033 (+11362577us) ts_tablet_manager.cc:1197] Deleting tablet ba87a379ae6a4feabfbc9fd6ba2d488e
0928 20:03:04.754090 (+ 57us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.883456 (+129366us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.957045 (+ 73589us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.013411 (+ 56366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1038,"tablet-delete.queue_time_us":11362023}
I20260928 20:03:05.015290 27857 ts_tablet_manager.cc:1996] T 91b11022fc774d18b92e0c694f834375 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:05.015327 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 384) took 11622 ms. Trace:
I20260928 20:03:05.012917 28059 ts_tablet_manager.cc:1975] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260928 20:03:05.020216 26450 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.018239 28059 log.cc:1199] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/0de800a9344d4507b7903d08fcf8e988
I20260928 20:03:05.020622 26450 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.021548 28357 raft_consensus.cc:2749] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:05.022274 28030 rpcz_store.cc:276] 0928 20:02:53.393235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.393853 (+ 618us) service_pool.cc:224] Handling call
0928 20:03:05.015009 (+11621156us) ts_tablet_manager.cc:1197] Deleting tablet 0e0a362efb68408d8dce96dce0130035
0928 20:03:05.015068 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.015279 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11620613}
I20260928 20:03:05.023720 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 385) took 11552 ms. Trace:
I20260928 20:03:05.024073 28030 rpcz_store.cc:276] 0928 20:02:53.471266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:53.472265 (+ 999us) service_pool.cc:224] Handling call
0928 20:03:05.023326 (+11551061us) ts_tablet_manager.cc:1197] Deleting tablet b97ad3f841f54aa38bbb312c50db384e
0928 20:03:05.023385 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.023672 (+ 287us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11546415}
I20260928 20:03:05.025157 28030 tablet_replica.cc:333] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:05.026209 28030 raft_consensus.cc:2243] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:05.028082 26913 tablet_bootstrap.cc:492] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:05.028582 26913 ts_tablet_manager.cc:1449] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.111s user 0.010s sys 0.000s
I20260928 20:03:05.031056 26913 raft_consensus.cc:359] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.028949 28059 ts_tablet_manager.cc:1996] T 0de800a9344d4507b7903d08fcf8e988 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:05.033697 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 443) took 6583 ms. Trace:
I20260928 20:03:05.034058 27857 rpcz_store.cc:276] 0928 20:02:58.450640 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.510538 (+ 59898us) service_pool.cc:224] Handling call
0928 20:03:04.845516 (+6334978us) ts_tablet_manager.cc:1197] Deleting tablet 91b11022fc774d18b92e0c694f834375
0928 20:03:04.845555 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.912498 (+ 66943us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:04.993191 (+ 80693us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.033637 (+ 40446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6585,"tablet-delete.queue_time_us":6334157}
I20260928 20:03:05.043560 27857 tablet_replica.cc:333] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:05.031777 26913 raft_consensus.cc:385] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.046687 26913 raft_consensus.cc:740] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.047462 26913 consensus_queue.cc:260] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:05.051569 27822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.535s (SENT)
I20260928 20:03:05.061370 26916 tablet_bootstrap.cc:492] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:05.058439 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 414) took 7686 ms. Trace:
I20260928 20:03:05.062345 26916 ts_tablet_manager.cc:1449] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.066s user 0.010s sys 0.000s
I20260928 20:03:05.065271 26916 raft_consensus.cc:359] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.063486 28059 rpcz_store.cc:276] 0928 20:02:57.371339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.391697 (+ 20358us) service_pool.cc:224] Handling call
0928 20:03:04.729214 (+7337517us) ts_tablet_manager.cc:1197] Deleting tablet 0de800a9344d4507b7903d08fcf8e988
0928 20:03:04.729262 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:04.892941 (+163679us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.011433 (+118492us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.057537 (+ 46104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7336992}
I20260928 20:03:05.083474 26913 ts_tablet_manager.cc:1480] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.055s user 0.005s sys 0.000s
W20260928 20:03:05.044101 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 56870.7us
I20260928 20:03:05.085457 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:05.095065 26504 raft_consensus.cc:2393] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:05.044566 28551 raft_consensus.cc:2804] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:05.095832 28551 raft_consensus.cc:493] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:05.095969 26916 raft_consensus.cc:385] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.096287 26916 raft_consensus.cc:740] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.096328 28551 raft_consensus.cc:3060] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.097036 26916 consensus_queue.cc:260] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.098505 26916 ts_tablet_manager.cc:1480] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.035s user 0.004s sys 0.001s
I20260928 20:03:05.105410 28551 raft_consensus.cc:515] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:05.110637 27857 raft_consensus.cc:2243] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:05.111215 27857 raft_consensus.cc:2272] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.113056 27857 ts_tablet_manager.cc:1962] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.131261 28483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "5308dad1e3384995a990de7c4866f1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:05.133953 28483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [sys.catalog]: This master's current role is: LEADER
I20260928 20:03:05.135566 26913 tablet_bootstrap.cc:492] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:05.136735 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 422) took 7734 ms. Trace:
I20260928 20:03:05.137595 28059 rpcz_store.cc:276] 0928 20:02:57.402125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.402335 (+ 210us) service_pool.cc:224] Handling call
0928 20:03:05.090477 (+7688142us) ts_tablet_manager.cc:1197] Deleting tablet fe680423497941578a5dfff2507e3334
0928 20:03:05.136346 (+ 45869us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.136677 (+ 331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7371044}
I20260928 20:03:05.139230 28059 tablet_replica.cc:333] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:05.139971 28059 raft_consensus.cc:2243] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:05.140453 28059 raft_consensus.cc:2272] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.143908 28059 ts_tablet_manager.cc:1962] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.168045 26916 tablet_bootstrap.cc:492] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:05.072063 26912 tablet_bootstrap.cc:492] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:05.172443 26912 ts_tablet_manager.cc:1449] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.203s user 0.006s sys 0.006s
I20260928 20:03:05.174969 26912 raft_consensus.cc:359] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.175617 26912 raft_consensus.cc:385] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.175868 26912 raft_consensus.cc:740] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.176487 26912 consensus_queue.cc:260] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.177699 26916 tablet_bootstrap.cc:654] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.059144 26739 leader_election.cc:304] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:05.178772 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 119738us
I20260928 20:03:05.180377 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:05.182313 26594 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:05.182690 26594 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.183298 28534 consensus_queue.cc:1048] T d3e2de7890874892be6ae5a2008d8a12 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 20:03:05.184441 28535 raft_consensus.cc:2749] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:05.132952 28030 raft_consensus.cc:2272] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.192623 28030 ts_tablet_manager.cc:1962] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.193255 27857 ts_tablet_manager.cc:1975] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260928 20:03:05.177968 26912 ts_tablet_manager.cc:1480] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 20:03:05.195521 26912 tablet_bootstrap.cc:492] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:05.202304 28428 raft_consensus.cc:2804] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:05.202785 28428 raft_consensus.cc:493] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:05.203229 28428 raft_consensus.cc:3060] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.199028 26916 tablet_bootstrap.cc:492] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:05.209394 26916 ts_tablet_manager.cc:1449] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.042s user 0.009s sys 0.002s
W20260928 20:03:05.134475 26740 consensus_peers.cc:597] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7242f71b93914dbeadb60617b3f2be3b. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:05.210393 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 76038.1us
W20260928 20:03:05.211129 26740 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542
I20260928 20:03:05.212863 26916 raft_consensus.cc:359] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.213569 26916 raft_consensus.cc:385] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.214207 26916 raft_consensus.cc:740] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.213953 27857 log.cc:1199] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/2d9ca77e114c4d06bde1bcd862c8eccf
I20260928 20:03:05.216280 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.217545 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:05.218349 26790 raft_consensus.cc:2393] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:05.227355 26916 consensus_queue.cc:260] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.215582 27857 ts_tablet_manager.cc:1996] T 2d9ca77e114c4d06bde1bcd862c8eccf P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:05.237910 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 466) took 6210 ms. Trace:
I20260928 20:03:05.238356 27857 rpcz_store.cc:276] 0928 20:02:59.028015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.357421 (+329406us) service_pool.cc:224] Handling call
0928 20:03:05.035862 (+5678441us) ts_tablet_manager.cc:1197] Deleting tablet 2d9ca77e114c4d06bde1bcd862c8eccf
0928 20:03:05.043441 (+ 7579us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.131231 (+ 87790us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.193133 (+ 61902us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.237846 (+ 44713us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66120,"tablet-delete.queue_time_us":5626471}
I20260928 20:03:05.240319 28551 leader_election.cc:290] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:05.241991 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:05.242552 26504 raft_consensus.cc:3060] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.241025 26916 ts_tablet_manager.cc:1480] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20260928 20:03:05.255527 26916 tablet_bootstrap.cc:492] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:05.258478 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 73321.3us
I20260928 20:03:05.249778 26504 raft_consensus.cc:2468] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:05.259876 26594 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:05.264492 26740 leader_election.cc:304] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:05.267057 28551 raft_consensus.cc:2804] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:05.255910 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 467) took 6153 ms. Trace:
I20260928 20:03:05.270678 27857 rpcz_store.cc:276] 0928 20:02:59.100466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.418894 (+318428us) service_pool.cc:224] Handling call
0928 20:03:05.243150 (+5824256us) ts_tablet_manager.cc:1197] Deleting tablet 3657e36a6d2844c28852db1a4f2ed191
0928 20:03:05.253768 (+ 10618us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.254068 (+ 300us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5803592}
I20260928 20:03:05.270978 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87024e1a4f184c669ff78efc918a9eef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:05.277209 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 470) took 6078 ms. Trace:
I20260928 20:03:05.277138 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:05.277757 26653 raft_consensus.cc:3060] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.282239 27857 rpcz_store.cc:276] 0928 20:02:59.198934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.526790 (+327856us) service_pool.cc:224] Handling call
0928 20:03:05.276866 (+5750076us) ts_tablet_manager.cc:1197] Deleting tablet 7775ad91c86840c49a902b059a0ff74d
0928 20:03:05.276919 (+ 53us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.277151 (+ 232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5688586}
I20260928 20:03:05.274243 28535 raft_consensus.cc:2804] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:05.284916 28535 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:05.285336 28535 raft_consensus.cc:3060] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.288106 26916 tablet_bootstrap.cc:654] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.274058 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.290716 26656 raft_consensus.cc:2468] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:05.290917 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 473) took 6091 ms. Trace:
I20260928 20:03:05.291252 27857 rpcz_store.cc:276] 0928 20:02:59.199695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.887555 (+687860us) service_pool.cc:224] Handling call
0928 20:03:05.290547 (+5402992us) ts_tablet_manager.cc:1197] Deleting tablet 6a31001f85b44bfcb35a29675f177b9e
0928 20:03:05.290590 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.290857 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5386309}
I20260928 20:03:05.297950 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.298918 27857 tablet_replica.cc:333] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:05.299687 27857 raft_consensus.cc:2243] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:05.300120 27857 raft_consensus.cc:2272] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.319620 27857 ts_tablet_manager.cc:1962] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.325567 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb8477c5cb74205b4b55eb38d7f9542" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:05.326433 26646 raft_consensus.cc:3060] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.340941 28551 raft_consensus.cc:697] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:05.341820 28551 consensus_queue.cc:237] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:05.351533 28357 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.352026 28357 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.353968 28357 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:05.354431 28357 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.354797 28357 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:05.356760 28357 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:05.359241 26740 consensus_peers.cc:597] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d9ca77e114c4d06bde1bcd862c8eccf. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:05.361546 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.361778 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:05.363186 26450 leader_election.cc:343] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:05.363740 26450 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.366066 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.366389 26653 raft_consensus.cc:2468] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:03:05.368384 26450 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.368746 26450 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.369690 28572 raft_consensus.cc:2749] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:05.370074 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f7017fddff974abda74574e39fd4e37c consensus state has no leader
I20260928 20:03:05.372687 26646 raft_consensus.cc:2468] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:05.375716 28535 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:05.377140 26222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:05.379419 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.384342 26916 tablet_bootstrap.cc:492] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:05.384850 26916 ts_tablet_manager.cc:1449] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.130s user 0.007s sys 0.003s
I20260928 20:03:05.394367 28448 raft_consensus.cc:493] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.394894 28448 raft_consensus.cc:515] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.397063 28448 leader_election.cc:290] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:05.398319 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d945be7bea449ba8c5541b60eb18334" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:05.398885 26654 raft_consensus.cc:3060] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.399299 26913 tablet_bootstrap.cc:654] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:05.402424 26450 leader_election.cc:343] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.402848 26450 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.403509 28573 raft_consensus.cc:2749] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:05.404070 26595 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:05.407618 26916 raft_consensus.cc:359] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.408293 26916 raft_consensus.cc:385] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.408567 26916 raft_consensus.cc:740] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.409149 26916 consensus_queue.cc:260] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:05.413161 26595 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:05.201993 26912 tablet_bootstrap.cc:654] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.420574 26916 ts_tablet_manager.cc:1480] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.035s user 0.003s sys 0.003s
I20260928 20:03:05.418062 28428 raft_consensus.cc:515] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.448196 26916 tablet_bootstrap.cc:492] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:05.433706 26739 leader_election.cc:304] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:05.455933 28506 raft_consensus.cc:2749] T 87024e1a4f184c669ff78efc918a9eef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:05.465750 28535 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:05.480295 26654 raft_consensus.cc:2468] T 1d945be7bea449ba8c5541b60eb18334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:03:05.490478 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 230670us
I20260928 20:03:05.491097 28059 ts_tablet_manager.cc:1975] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:05.491443 28059 log.cc:1199] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/7242f71b93914dbeadb60617b3f2be3b
I20260928 20:03:05.492146 28059 ts_tablet_manager.cc:1996] T 7242f71b93914dbeadb60617b3f2be3b P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:05.494930 27857 ts_tablet_manager.cc:1975] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:05.497372 27857 log.cc:1199] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:05.499888 27857 ts_tablet_manager.cc:1996] T 23d262c7a15b434d8caea0a818323dd1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:05.517166 26912 tablet_bootstrap.cc:492] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:05.517601 26912 ts_tablet_manager.cc:1449] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.322s user 0.011s sys 0.000s
I20260928 20:03:05.528625 26916 tablet_bootstrap.cc:654] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.528855 28428 leader_election.cc:290] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:05.539696 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 426) took 7799 ms. Trace:
I20260928 20:03:05.545588 26912 raft_consensus.cc:359] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.549391 26912 raft_consensus.cc:385] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.550225 26912 raft_consensus.cc:740] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.551295 26912 consensus_queue.cc:260] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.564126 26913 tablet_bootstrap.cc:492] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
W20260928 20:03:05.492168 26594 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.564796 28573 raft_consensus.cc:493] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.570062 28573 raft_consensus.cc:515] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.570892 26594 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.541064 28059 rpcz_store.cc:276] 0928 20:02:57.730935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.731776 (+ 841us) service_pool.cc:224] Handling call
0928 20:03:05.138515 (+7406739us) ts_tablet_manager.cc:1197] Deleting tablet 7242f71b93914dbeadb60617b3f2be3b
0928 20:03:05.139117 (+ 602us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.341107 (+201990us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.490971 (+149864us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.529964 (+ 38993us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7222976}
I20260928 20:03:05.572180 28573 leader_election.cc:290] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:05.574555 26740 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:03:05.577045 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.578122 26912 ts_tablet_manager.cc:1480] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.060s user 0.007s sys 0.000s
W20260928 20:03:05.578944 26450 leader_election.cc:343] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.579120 28566 raft_consensus.cc:2749] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:05.580735 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 88585.4us
W20260928 20:03:05.588105 26148 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.732s (SENT)
W20260928 20:03:05.582954 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 51698.3us
I20260928 20:03:05.590400 26739 leader_election.cc:304] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:05.602885 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 480) took 6401 ms. Trace:
I20260928 20:03:05.603394 27857 rpcz_store.cc:276] 0928 20:02:59.201828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.170190 (+968362us) service_pool.cc:224] Handling call
0928 20:03:05.298764 (+5128574us) ts_tablet_manager.cc:1197] Deleting tablet 23d262c7a15b434d8caea0a818323dd1
0928 20:03:05.298807 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.418406 (+119599us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.494775 (+ 76369us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.602794 (+108019us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5078581}
I20260928 20:03:05.604739 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 481) took 6402 ms. Trace:
I20260928 20:03:05.604770 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:05.605111 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.535s (SENT)
I20260928 20:03:05.605020 27857 rpcz_store.cc:276] 0928 20:02:59.202051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.220277 (+1018226us) service_pool.cc:224] Handling call
0928 20:03:05.604409 (+5384132us) ts_tablet_manager.cc:1197] Deleting tablet de40520ccd9b4a52a45c4085afd45b2d
0928 20:03:05.604450 (+ 41us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.604688 (+ 238us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5349563}
I20260928 20:03:05.605540 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:05.606129 28428 raft_consensus.cc:2804] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:05.606596 28428 raft_consensus.cc:697] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:05.607432 27857 tablet_replica.cc:333] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:05.607383 28428 consensus_queue.cc:237] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.608642 27857 raft_consensus.cc:2243] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:05.609269 27857 raft_consensus.cc:2272] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.611526 27857 ts_tablet_manager.cc:1962] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.613417 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a86cd5167c43a4beb51cd3138cdef8" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:05.613958 26655 raft_consensus.cc:3060] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.615566 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3fa371924149fb814c8458488aea61" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:05.616155 26797 raft_consensus.cc:3060] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.618497 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5de4a82bd41c1a8b2af2ba7417c46" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.626909 26655 raft_consensus.cc:2468] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:05.624312 28573 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.629613 28357 raft_consensus.cc:493] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.630545 28357 raft_consensus.cc:515] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.632556 28357 leader_election.cc:290] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:05.630545 28573 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.634568 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:05.635591 26450 leader_election.cc:343] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.635991 26450 leader_election.cc:304] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:05.637030 26450 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.637579 28357 raft_consensus.cc:2749] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:05.639293 28573 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:05.642980 26916 tablet_bootstrap.cc:492] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:05.643580 26916 ts_tablet_manager.cc:1449] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.196s user 0.007s sys 0.006s
I20260928 20:03:05.644942 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.646072 26913 ts_tablet_manager.cc:1449] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.511s user 0.007s sys 0.008s
W20260928 20:03:05.646350 26450 leader_election.cc:343] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.646263 26916 raft_consensus.cc:359] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:05.647207 26916 raft_consensus.cc:385] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.647951 26916 raft_consensus.cc:740] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.648774 26916 consensus_queue.cc:260] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:05.649259 28582 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 20:03:05.649881 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 44831.8us
W20260928 20:03:05.667315 26148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 79244.8us
I20260928 20:03:05.684502 26916 ts_tablet_manager.cc:1480] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
I20260928 20:03:05.685667 26916 tablet_bootstrap.cc:492] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:04.580139 27924 rpcz_store.cc:276] 0928 20:03:01.486684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.486796 (+ 112us) service_pool.cc:224] Handling call
0928 20:03:01.539446 (+ 52650us) raft_consensus.cc:1471] Updating replica for 188 ops
0928 20:03:01.608456 (+ 69010us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 20:03:01.608484 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 188 ops
0928 20:03:01.608782 (+ 298us) write_op.cc:270] Start()
0928 20:03:01.608886 (+ 104us) write_op.cc:276] Timestamp: P: 1790625770841540 usec, L: 0
0928 20:03:01.609391 (+ 505us) write_op.cc:270] Start()
0928 20:03:01.609466 (+ 75us) write_op.cc:276] Timestamp: P: 1790625770882320 usec, L: 0
0928 20:03:01.609891 (+ 425us) write_op.cc:270] Start()
0928 20:03:01.609958 (+ 67us) write_op.cc:276] Timestamp: P: 1790625770887105 usec, L: 0
0928 20:03:01.619388 (+ 9430us) write_op.cc:270] Start()
0928 20:03:01.619468 (+ 80us) write_op.cc:276] Timestamp: P: 1790625771132953 usec, L: 0
0928 20:03:01.619918 (+ 450us) write_op.cc:270] Start()
0928 20:03:01.619992 (+ 74us) write_op.cc:276] Timestamp: P: 1790625771379146 usec, L: 0
0928 20:03:01.620389 (+ 397us) write_op.cc:270] Start()
0928 20:03:01.620452 (+ 63us) write_op.cc:276] Timestamp: P: 1790625771461338 usec, L: 0
0928 20:03:01.620844 (+ 392us) write_op.cc:270] Start()
0928 20:03:01.620988 (+ 144us) write_op.cc:276] Timestamp: P: 1790625771475378 usec, L: 0
0928 20:03:01.621362 (+ 374us) write_op.cc:270] Start()
0928 20:03:01.621428 (+ 66us) write_op.cc:276] Timestamp: P: 1790625771499899 usec, L: 0
0928 20:03:01.621853 (+ 425us) write_op.cc:270] Start()
0928 20:03:01.621920 (+ 67us) write_op.cc:276] Timestamp: P: 1790625771501878 usec, L: 0
0928 20:03:01.644347 (+ 22427us) write_op.cc:270] Start()
0928 20:03:01.644446 (+ 99us) write_op.cc:276] Timestamp: P: 1790625771506851 usec, L: 0
0928 20:03:01.644996 (+ 550us) write_op.cc:270] Start()
0928 20:03:01.645069 (+ 73us) write_op.cc:276] Timestamp: P: 1790625771612060 usec, L: 0
0928 20:03:01.645606 (+ 537us) write_op.cc:270] Start()
0928 20:03:01.645679 (+ 73us) write_op.cc:276] Timestamp: P: 1790625771678647 usec, L: 0
0928 20:03:01.656295 (+ 10616us) write_op.cc:270] Start()
0928 20:03:01.656399 (+ 104us) write_op.cc:276] Timestamp: P: 1790625771845750 usec, L: 0
0928 20:03:01.656936 (+ 537us) write_op.cc:270] Start()
0928 20:03:01.675986 (+ 19050us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b60000601c8. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab7592d651 00007fab75a9e013 00007fab75aa0bac 00007fab7592f383 00007fab7590c366 00007fab75a0ef6a 00007fab759f7e32 00007fab759bbb17 00007fab759bb5ef 00007fab75563510 00007fab7556cc76
0928 20:03:01.676062 (+ 76us) write_op.cc:276] Timestamp: P: 1790625771878879 usec, L: 0
0928 20:03:01.676619 (+ 557us) write_op.cc:270] Start()
0928 20:03:01.676706 (+ 87us) write_op.cc:276] Timestamp: P: 1790625771955694 usec, L: 0
0928 20:03:01.677111 (+ 405us) write_op.cc:270] Start()
0928 20:03:01.677175 (+ 64us) write_op.cc:276] Timestamp: P: 1790625771958788 usec, L: 0
0928 20:03:01.677618 (+ 443us) write_op.cc:270] Start()
0928 20:03:01.677686 (+ 68us) write_op.cc:276] Timestamp: P: 1790625772013667 usec, L: 0
0928 20:03:01.678059 (+ 373us) write_op.cc:270] Start()
0928 20:03:01.706128 (+ 28069us) write_op.cc:276] Timestamp: P: 1790625772087530 usec, L: 0
0928 20:03:01.706775 (+ 647us) write_op.cc:270] Start()
0928 20:03:01.706858 (+ 83us) write_op.cc:276] Timestamp: P: 1790625772118303 usec, L: 0
0928 20:03:01.707319 (+ 461us) write_op.cc:270] Start()
0928 20:03:01.707388 (+ 69us) write_op.cc:276] Timestamp: P: 1790625772125914 usec, L: 0
0928 20:03:01.707800 (+ 412us) write_op.cc:270] Start()
0928 20:03:01.707887 (+ 87us) write_op.cc:276] Timestamp: P: 1790625772161747 usec, L: 0
0928 20:03:01.708374 (+ 487us) write_op.cc:270] Start()
0928 20:03:01.708448 (+ 74us) write_op.cc:276] Timestamp: P: 1790625772163856 usec, L: 0
0928 20:03:01.709297 (+ 849us) write_op.cc:270] Start()
0928 20:03:01.709379 (+ 82us) write_op.cc:276] Timestamp: P: 1790625772166233 usec, L: 0
0928 20:03:01.709823 (+ 444us) write_op.cc:270] Start()
0928 20:03:01.709897 (+ 74us) write_op.cc:276] Timestamp: P: 1790625772182617 usec, L: 0
0928 20:03:01.710356 (+ 459us) write_op.cc:270] Start()
0928 20:03:01.710427 (+ 71us) write_op.cc:276] Timestamp: P: 1790625772259188 usec, L: 0
0928 20:03:01.710845 (+ 418us) write_op.cc:270] Start()
0928 20:03:01.710941 (+ 96us) write_op.cc:276] Timestamp: P: 1790625772263253 usec, L: 0
0928 20:03:01.711349 (+ 408us) write_op.cc:270] Start()
0928 20:03:01.711418 (+ 69us) write_op.cc:276] Timestamp: P: 1790625772265426 usec, L: 0
0928 20:03:01.711819 (+ 401us) write_op.cc:270] Start()
0928 20:03:01.711891 (+ 72us) write_op.cc:276] Timestamp: P: 1790625772308897 usec, L: 0
0928 20:03:01.712304 (+ 413us) write_op.cc:270] Start()
0928 20:03:01.712375 (+ 71us) write_op.cc:276] Timestamp: P: 1790625772426282 usec, L: 0
0928 20:03:01.712786 (+ 411us) write_op.cc:270] Start()
0928 20:03:01.712854 (+ 68us) write_op.cc:276] Timestamp: P: 1790625772431342 usec, L: 0
0928 20:03:01.713243 (+ 389us) write_op.cc:270] Start()
0928 20:03:01.765406 (+ 52163us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b60000601c8. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab7592d651 00007fab75a9e013 00007fab75aa0bac 00007fab7592f383 00007fab7590c366 00007fab75a0ef6a 00007fab759f7e32 00007fab759bbb17 00007fab759bb5ef 00007fab75563510 00007fab7556cc76
0928 20:03:01.765490 (+ 84us) write_op.cc:276] Timestamp: P: 1790625772436462 usec, L: 0
0928 20:03:01.766168 (+ 678us) write_op.cc:270] Start()
0928 20:03:01.766271 (+ 103us) write_op.cc:276] Timestamp: P: 1790625772529411 usec, L: 0
0928 20:03:01.787345 (+ 21074us) write_op.cc:270] Start()
0928 20:03:01.787984 (+ 639us) write_op.cc:276] Timestamp: P: 1790625772560832 usec, L: 0
0928 20:03:01.791894 (+ 3910us) write_op.cc:270] Start()
0928 20:03:01.791987 (+ 93us) write_op.cc:276] Timestamp: P: 1790625772711539 usec, L: 0
0928 20:03:01.792485 (+ 498us) write_op.cc:270] Start()
0928 20:03:01.792555 (+ 70us) write_op.cc:276] Timestamp: P: 1790625772713415 usec, L: 0
0928 20:03:01.792947 (+ 392us) write_op.cc:270] Start()
0928 20:03:01.793015 (+ 68us) write_op.cc:276] Timestamp: P: 1790625772724102 usec, L: 0
0928 20:03:01.793416 (+ 401us) write_op.cc:270] Start()
0928 20:03:01.793482 (+ 66us) write_op.cc:276] Timestamp: P: 1790625772733233 usec, L: 0
0928 20:03:01.793876 (+ 394us) write_op.cc:270] Start()
0928 20:03:01.793948 (+ 72us) write_op.cc:276] Timestamp: P: 1790625772789272 usec, L: 0
0928 20:03:01.799606 (+ 5658us) write_op.cc:270] Start()
0928 20:03:01.799687 (+ 81us) write_op.cc:276] Timestamp: P: 1790625772825393 usec, L: 0
0928 20:03:01.800143 (+ 456us) write_op.cc:270] Start()
0928 20:03:01.800210 (+ 67us) write_op.cc:276] Timestamp: P: 1790625772904813 usec, L: 0
0928 20:03:01.800651 (+ 441us) write_op.cc:270] Start()
0928 20:03:01.800717 (+ 66us) write_op.cc:276] Timestamp: P: 1790625772959042 usec, L: 0
0928 20:03:01.808233 (+ 7516us) write_op.cc:270] Start()
0928 20:03:01.808881 (+ 648us) write_op.cc:276] Timestamp: P: 1790625773004773 usec, L: 0
0928 20:03:01.809809 (+ 928us) write_op.cc:270] Start()
0928 20:03:01.809879 (+ 70us) write_op.cc:276] Timestamp: P: 1790625773044518 usec, L: 0
0928 20:03:01.831069 (+ 21190us) write_op.cc:270] Start()
0928 20:03:01.831175 (+ 106us) write_op.cc:276] Timestamp: P: 1790625773047205 usec, L: 0
0928 20:03:01.831747 (+ 572us) write_op.cc:270] Start()
0928 20:03:01.831824 (+ 77us) write_op.cc:276] Timestamp: P: 1790625773083486 usec, L: 0
0928 20:03:01.832246 (+ 422us) write_op.cc:270] Start()
0928 20:03:01.832344 (+ 98us) write_op.cc:276] Timestamp: P: 1790625773086183 usec, L: 0
0928 20:03:01.846814 (+ 14470us) write_op.cc:270] Start()
0928 20:03:01.846902 (+ 88us) write_op.cc:276] Timestamp: P: 1790625773183215 usec, L: 0
0928 20:03:01.847393 (+ 491us) write_op.cc:270] Start()
0928 20:03:01.847465 (+ 72us) write_op.cc:276] Timestamp: P: 1790625773186525 usec, L: 0
0928 20:03:01.847880 (+ 415us) write_op.cc:270] Start()
0928 20:03:01.847953 (+ 73us) write_op.cc:276] Timestamp: P: 1790625773336739 usec, L: 0
0928 20:03:01.848402 (+ 449us) write_op.cc:270] Start()
0928 20:03:01.848477 (+ 75us) write_op.cc:276] Timestamp: P: 1790625773417427 usec, L: 0
0928 20:03:01.848912 (+ 435us) write_op.cc:270] Start()
0928 20:03:01.848987 (+ 75us) write_op.cc:276] Timestamp: P: 1790625773420099 usec, L: 0
0928 20:03:01.849418 (+ 431us) write_op.cc:270] Start()
0928 20:03:01.849489 (+ 71us) write_op.cc:276] Timestamp: P: 1790625773522929 usec, L: 0
0928 20:03:01.849889 (+ 400us) write_op.cc:270] Start()
0928 20:03:01.849959 (+ 70us) write_op.cc:276] Timestamp: P: 1790625773564540 usec, L: 0
0928 20:03:01.850426 (+ 467us) write_op.cc:270] Start()
0928 20:03:01.850611 (+ 185us) write_op.cc:276] Timestamp: P: 1790625773634649 usec, L: 0
0928 20:03:01.851024 (+ 413us) write_op.cc:270] Start()
0928 20:03:01.851090 (+ 66us) write_op.cc:276] Timestamp: P: 1790625773679660 usec, L: 0
0928 20:03:01.851499 (+ 409us) write_op.cc:270] Start()
0928 20:03:01.851567 (+ 68us) write_op.cc:276] Timestamp: P: 1790625773758739 usec, L: 0
0928 20:03:01.852005 (+ 438us) write_op.cc:270] Start()
0928 20:03:01.852071 (+ 66us) write_op.cc:276] Timestamp: P: 1790625773877486 usec, L: 0
0928 20:03:01.852489 (+ 418us) write_op.cc:270] Start()
0928 20:03:01.852563 (+ 74us) write_op.cc:276] Timestamp: P: 1790625773975305 usec, L: 0
0928 20:03:01.852962 (+ 399us) write_op.cc:270] Start()
0928 20:03:01.853034 (+ 72us) write_op.cc:276] Timestamp: P: 1790625774093578 usec, L: 0
0928 20:03:01.853467 (+ 433us) write_op.cc:270] Start()
0928 20:03:01.853536 (+ 69us) write_op.cc:276] Timestamp: P: 1790625774158587 usec, L: 0
0928 20:03:01.875780 (+ 22244us) write_op.cc:270] Start()
0928 20:03:01.876015 (+ 235us) write_op.cc:276] Timestamp: P: 1790625774194247 usec, L: 0
0928 20:03:01.876827 (+ 812us) write_op.cc:270] Start()
0928 20:03:01.876924 (+ 97us) write_op.cc:276] Timestamp: P: 1790625774242546 usec, L: 0
0928 20:03:01.877452 (+ 528us) write_op.cc:270] Start()
0928 20:03:01.877535 (+ 83us) write_op.cc:276] Timestamp: P: 1790625774277098 usec, L: 0
0928 20:03:01.878002 (+ 467us) write_op.cc:270] Start()
0928 20:03:01.878090 (+ 88us) write_op.cc:276] Timestamp: P: 1790625774385419 usec, L: 0
0928 20:03:01.920298 (+ 42208us) write_op.cc:270] Start()
0928 20:03:01.920392 (+ 94us) write_op.cc:276] Timestamp: P: 1790625774397866 usec, L: 0
0928 20:03:01.921391 (+ 999us) write_op.cc:270] Start()
0928 20:03:01.921470 (+ 79us) write_op.cc:276] Timestamp: P: 1790625774647479 usec, L: 0
0928 20:03:01.921917 (+ 447us) write_op.cc:270] Start()
0928 20:03:01.921986 (+ 69us) write_op.cc:276] Timestamp: P: 1790625774668749 usec, L: 0
0928 20:03:01.999600 (+ 77614us) write_op.cc:270] Start()
0928 20:03:01.999682 (+ 82us) write_op.cc:276] Timestamp: P: 1790625774893078 usec, L: 0
0928 20:03:02.000525 (+ 843us) write_op.cc:270] Start()
0928 20:03:02.000591 (+ 66us) write_op.cc:276] Timestamp: P: 1790625775000383 usec, L: 0
0928 20:03:02.000984 (+ 393us) write_op.cc:270] Start()
0928 20:03:02.001045 (+ 61us) write_op.cc:276] Timestamp: P: 1790625775034420 usec, L: 0
0928 20:03:02.001412 (+ 367us) write_op.cc:270] Start()
0928 20:03:02.001479 (+ 67us) write_op.cc:276] Timestamp: P: 1790625775112847 usec, L: 0
0928 20:03:02.001837 (+ 358us) write_op.cc:270] Start()
0928 20:03:02.001902 (+ 65us) write_op.cc:276] Timestamp: P: 1790625775183202 usec, L: 0
0928 20:03:02.002381 (+ 479us) write_op.cc:270] Start()
0928 20:03:02.015255 (+ 12874us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b60000601c8. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab7592d651 00007fab75a9e013 00007fab75aa0bac 00007fab7592f383 00007fab7590c366 00007fab75a0ef6a 00007fab759f7e32 00007fab759bbb17 00007fab759bb5ef 00007fab75563510 00007fab7556cc76
0928 20:03:02.015323 (+ 68us) write_op.cc:276] Timestamp: P: 1790625775185073 usec, L: 0
0928 20:03:02.015815 (+ 492us) write_op.cc:270] Start()
0928 20:03:02.015893 (+ 78us) write_op.cc:276] Timestamp: P: 1790625775212883 usec, L: 0
0928 20:03:02.022637 (+ 6744us) write_op.cc:270] Start()
0928 20:03:02.022714 (+ 77us) write_op.cc:276] Timestamp: P: 1790625775240707 usec, L: 0
0928 20:03:02.023286 (+ 572us) write_op.cc:270] Start()
0928 20:03:02.023379 (+ 93us) write_op.cc:276] Timestamp: P: 1790625775257277 usec, L: 0
0928 20:03:02.023797 (+ 418us) write_op.cc:270] Start()
0928 20:03:02.023864 (+ 67us) write_op.cc:276] Timestamp: P: 1790625775351394 usec, L: 0
0928 20:03:02.024295 (+ 431us) write_op.cc:270] Start()
0928 20:03:02.024387 (+ 92us) write_op.cc:276] Timestamp: P: 1790625775359862 usec, L: 0
0928 20:03:02.024862 (+ 475us) write_op.cc:270] Start()
0928 20:03:02.024941 (+ 79us) write_op.cc:276] Timestamp: P: 1790625775395165 usec, L: 0
0928 20:03:02.025359 (+ 418us) write_op.cc:270] Start()
0928 20:03:02.025426 (+ 67us) write_op.cc:276] Timestamp: P: 1790625775455980 usec, L: 0
0928 20:03:02.025840 (+ 414us) write_op.cc:270] Start()
0928 20:03:02.025909 (+ 69us) write_op.cc:276] Timestamp: P: 1790625775506656 usec, L: 0
0928 20:03:02.033836 (+ 7927us) write_op.cc:270] Start()
0928 20:03:02.033914 (+ 78us) write_op.cc:276] Timestamp: P: 1790625775536558 usec, L: 0
0928 20:03:02.034429 (+ 515us) write_op.cc:270] Start()
0928 20:03:02.034507 (+ 78us) write_op.cc:276] Timestamp: P: 1790625775542695 usec, L: 0
0928 20:03:02.067803 (+ 33296us) write_op.cc:270] Start()
0928 20:03:02.067894 (+ 91us) write_op.cc:276] Timestamp: P: 1790625775629579 usec, L: 0
0928 20:03:02.068410 (+ 516us) write_op.cc:270] Start()
0928 20:03:02.068483 (+ 73us) write_op.cc:276] Timestamp: P: 1790625775662773 usec, L: 0
0928 20:03:02.068909 (+ 426us) write_op.cc:270] Start()
0928 20:03:02.068975 (+ 66us) write_op.cc:276] Timestamp: P: 1790625775705409 usec, L: 0
0928 20:03:02.069489 (+ 514us) write_op.cc:270] Start()
0928 20:03:02.069576 (+ 87us) write_op.cc:276] Timestamp: P: 1790625775735691 usec, L: 0
0928 20:03:02.069975 (+ 399us) write_op.cc:270] Start()
0928 20:03:02.070042 (+ 67us) write_op.cc:276] Timestamp: P: 1790625775801720 usec, L: 0
0928 20:03:02.117015 (+ 46973us) write_op.cc:270] Start()
0928 20:03:02.117101 (+ 86us) write_op.cc:276] Timestamp: P: 1790625775829504 usec, L: 0
0928 20:03:02.117585 (+ 484us) write_op.cc:270] Start()
0928 20:03:02.117658 (+ 73us) write_op.cc:276] Timestamp: P: 1790625775923274 usec, L: 0
0928 20:03:02.122728 (+ 5070us) write_op.cc:270] Start()
0928 20:03:02.123135 (+ 407us) write_op.cc:276] Timestamp: P: 1790625776034289 usec, L: 0
0928 20:03:02.128757 (+ 5622us) write_op.cc:270] Start()
0928 20:03:02.129723 (+ 966us) write_op.cc:276] Timestamp: P: 1790625776054003 usec, L: 0
0928 20:03:02.135794 (+ 6071us) write_op.cc:270] Start()
0928 20:03:02.136594 (+ 800us) write_op.cc:276] Timestamp: P: 1790625776074730 usec, L: 0
0928 20:03:02.147213 (+ 10619us) write_op.cc:270] Start()
0928 20:03:02.147312 (+ 99us) write_op.cc:276] Timestamp: P: 1790625776083806 usec, L: 0
0928 20:03:02.154542 (+ 7230us) write_op.cc:270] Start()
0928 20:03:02.154641 (+ 99us) write_op.cc:276] Timestamp: P: 1790625776204826 usec, L: 0
0928 20:03:02.155644 (+ 1003us) write_op.cc:270] Start()
0928 20:03:02.155752 (+ 108us) write_op.cc:276] Timestamp: P: 1790625776209321 usec, L: 0
0928 20:03:02.156628 (+ 876us) write_op.cc:270] Start()
0928 20:03:02.156717 (+ 89us) write_op.cc:276] Timestamp: P: 1790625776212066 usec, L: 0
0928 20:03:02.157116 (+ 399us) write_op.cc:270] Start()
0928 20:03:02.157189 (+ 73us) write_op.cc:276] Timestamp: P: 1790625776214672 usec, L: 0
0928 20:03:02.157606 (+ 417us) write_op.cc:270] Start()
0928 20:03:02.157670 (+ 64us) write_op.cc:276] Timestamp: P: 1790625776275333 usec, L: 0
0928 20:03:02.158066 (+ 396us) write_op.cc:270] Start()
0928 20:03:02.158155 (+ 89us) write_op.cc:276] Timestamp: P: 1790625776364710 usec, L: 0
0928 20:03:02.158564 (+ 409us) write_op.cc:270] Start()
0928 20:03:02.158629 (+ 65us) write_op.cc:276] Timestamp: P: 1790625776379362 usec, L: 0
0928 20:03:02.159017 (+ 388us) write_op.cc:270] Start()
0928 20:03:02.159082 (+ 65us) write_op.cc:276] Timestamp: P: 1790625776383741 usec, L: 0
0928 20:03:02.159479 (+ 397us) write_op.cc:270] Start()
0928 20:03:02.159544 (+ 65us) write_op.cc:276] Timestamp: P: 1790625776483369 usec, L: 0
0928 20:03:02.159918 (+ 374us) write_op.cc:270] Start()
0928 20:03:02.159990 (+ 72us) write_op.cc:276] Timestamp: P: 1790625776513747 usec, L: 0
0928 20:03:02.160418 (+ 428us) write_op.cc:270] Start()
0928 20:03:02.160485 (+ 67us) write_op.cc:276] Timestamp: P: 1790625776521423 usec, L: 0
0928 20:03:02.160868 (+ 383us) write_op.cc:270] Start()
0928 20:03:02.160940 (+ 72us) write_op.cc:276] Timestamp: P: 1790625776568268 usec, L: 0
0928 20:03:02.161389 (+ 449us) write_op.cc:270] Start()
0928 20:03:02.161462 (+ 73us) write_op.cc:276] Timestamp: P: 1790625776615357 usec, L: 0
0928 20:03:02.182575 (+ 21113us) write_op.cc:270] Start()
0928 20:03:02.182689 (+ 114us) write_op.cc:276] Timestamp: P: 1790625776652357 usec, L: 0
0928 20:03:02.183491 (+ 802us) write_op.cc:270] Start()
0928 20:03:02.183566 (+ 75us) write_op.cc:276] Timestamp: P: 1790625776655413 usec, L: 0
0928 20:03:02.184085 (+ 519us) write_op.cc:270] Start()
0928 20:03:02.184153 (+ 68us) write_op.cc:276] Timestamp: P: 1790625776746496 usec, L: 0
0928 20:03:02.184680 (+ 527us) write_op.cc:270] Start()
0928 20:03:02.184753 (+ 73us) write_op.cc:276] Timestamp: P: 1790625776763787 usec, L: 0
0928 20:03:02.190852 (+ 6099us) write_op.cc:270] Start()
0928 20:03:02.190956 (+ 104us) write_op.cc:276] Timestamp: P: 1790625776787760 usec, L: 0
0928 20:03:02.191819 (+ 863us) write_op.cc:270] Start()
0928 20:03:02.191913 (+ 94us) write_op.cc:276] Timestamp: P: 1790625776801868 usec, L: 0
0928 20:03:02.192560 (+ 647us) write_op.cc:270] Start()
0928 20:03:02.192634 (+ 74us) write_op.cc:276] Timestamp: P: 1790625776809504 usec, L: 0
0928 20:03:02.193047 (+ 413us) write_op.cc:270] Start()
0928 20:03:02.193109 (+ 62us) write_op.cc:276] Timestamp: P: 1790625776856619 usec, L: 0
0928 20:03:02.194739 (+ 1630us) write_op.cc:270] Start()
0928 20:03:02.194830 (+ 91us) write_op.cc:276] Timestamp: P: 1790625776903495 usec, L: 0
0928 20:03:02.195266 (+ 436us) write_op.cc:270] Start()
0928 20:03:02.195342 (+ 76us) write_op.cc:276] Timestamp: P: 1790625776967359 usec, L: 0
0928 20:03:02.195732 (+ 390us) write_op.cc:270] Start()
0928 20:03:02.195820 (+ 88us) write_op.cc:276] Timestamp: P: 1790625777075396 usec, L: 0
0928 20:03:02.196243 (+ 423us) write_op.cc:270] Start()
0928 20:03:02.196329 (+ 86us) write_op.cc:276] Timestamp: P: 1790625777121618 usec, L: 0
0928 20:03:02.206075 (+ 9746us) write_op.cc:270] Start()
0928 20:03:02.206368 (+ 293us) write_op.cc:276] Timestamp: P: 1790625777128528 usec, L: 0
0928 20:03:02.210502 (+ 4134us) write_op.cc:270] Start()
0928 20:03:02.210607 (+ 105us) write_op.cc:276] Timestamp: P: 1790625777137842 usec, L: 0
0928 20:03:02.211107 (+ 500us) write_op.cc:270] Start()
0928 20:03:02.211265 (+ 158us) write_op.cc:276] Timestamp: P: 1790625777175185 usec, L: 0
0928 20:03:02.211861 (+ 596us) write_op.cc:270] Start()
0928 20:03:02.211931 (+ 70us) write_op.cc:276] Timestamp: P: 1790625777188423 usec, L: 0
0928 20:03:02.212379 (+ 448us) write_op.cc:270] Start()
0928 20:03:02.212446 (+ 67us) write_op.cc:276] Timestamp: P: 1790625777199501 usec, L: 0
0928 20:03:02.212859 (+ 413us) write_op.cc:270] Start()
0928 20:03:02.212933 (+ 74us) write_op.cc:276] Timestamp: P: 1790625777245148 usec, L: 0
0928 20:03:02.213493 (+ 560us) write_op.cc:270] Start()
0928 20:03:02.213590 (+ 97us) write_op.cc:276] Timestamp: P: 1790625777305282 usec, L: 0
0928 20:03:02.214157 (+ 567us) write_op.cc:270] Start()
0928 20:03:02.225699 (+ 11542us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b60000601c8. stack: 00007fab6e3d6373 00007fab6e3d6270 00007fab6df79574 0000000000516a24 00000000005169b9 00007fab7592d651 00007fab75a9e013 00007fab75aa0bac 00007fab7592f383 00007fab7590c366 00007fab75a0ef6a 00007fab759f7e32 00007fab759bbb17 00007fab759bb5ef 00007fab75563510 00007fab7556cc76
0928 20:03:02.225842 (+ 143us) write_op.cc:276] Timestamp: P: 1790625777356732 usec, L: 0
0928 20:03:02.226548 (+ 706us) write_op.cc:270] Start()
0928 20:03:02.226639 (+ 91us) write_op.cc:276] Timestamp: P: 1790625777367129 usec, L: 0
0928 20:03:02.231978 (+ 5339us) write_op.cc:270] Start()
0928 20:03:02.232086 (+ 108us) write_op.cc:276] Timestamp: P: 1790625777389690 usec, L: 0
0928 20:03:02.232689 (+ 603us) write_op.cc:270] Start()
0928 20:03:02.232777 (+ 88us) write_op.cc:276] Timestamp: P: 1790625777411949 usec, L: 0
0928 20:03:02.233264 (+ 487us) write_op.cc:270] Start()
0928 20:03:02.233367 (+ 103us) write_op.cc:276] Timestamp: P: 1790625777421643 usec, L: 0
0928 20:03:02.233834 (+ 467us) write_op.cc:270] Start()
0928 20:03:02.233917 (+ 83us) write_op.cc:276] Timestamp: P: 1790625777459920 usec, L: 0
0928 20:03:02.234439 (+ 522us) write_op.cc:270] Start()
0928 20:03:02.234524 (+ 85us) write_op.cc:276] Timestamp: P: 1790625777479951 usec, L: 0
0928 20:03:02.235014 (+ 490us) write_op.cc:270] Start()
0928 20:03:02.235100 (+ 86us) write_op.cc:276] Timestamp: P: 1790625777483588 usec, L: 0
0928 20:03:02.235659 (+ 559us) write_op.cc:270] Start()
0928 20:03:02.235749 (+ 90us) write_op.cc:276] Timestamp: P: 1790625777528945 usec, L: 0
0928 20:03:02.236241 (+ 492us) write_op.cc:270] Start()
0928 20:03:02.236340 (+ 99us) write_op.cc:276] Timestamp: P: 1790625777582904 usec, L: 0
0928 20:03:02.236871 (+ 531us) write_op.cc:270] Start()
0928 20:03:02.236964 (+ 93us) write_op.cc:276] Timestamp: P: 1790625777600745 usec, L: 0
0928 20:03:02.237489 (+ 525us) write_op.cc:270] Start()
0928 20:03:02.237590 (+ 101us) write_op.cc:276] Timestamp: P: 1790625777641665 usec, L: 0
0928 20:03:02.254438 (+ 16848us) write_op.cc:270] Start()
0928 20:03:02.254554 (+ 116us) write_op.cc:276] Timestamp: P: 1790625777670383 usec, L: 0
0928 20:03:02.255144 (+ 590us) write_op.cc:270] Start()
0928 20:03:02.255220 (+ 76us) write_op.cc:276] Timestamp: P: 1790625777717197 usec, L: 0
0928 20:03:02.341638 (+ 86418us) write_op.cc:270] Start()
0928 20:03:02.341760 (+ 122us) write_op.cc:276] Timestamp: P: 1790625777741357 usec, L: 0
0928 20:03:02.533245 (+191485us) write_op.cc:270] Start()
0928 20:03:02.533464 (+ 219us) write_op.cc:276] Timestamp: P: 1790625777754690 usec, L: 0
0928 20:03:02.534578 (+ 1114us) write_op.cc:270] Start()
0928 20:03:02.534716 (+ 138us) write_op.cc:276] Timestamp: P: 1790625777775630 usec, L: 0
0928 20:03:02.535595 (+ 879us) write_op.cc:270] Start()
0928 20:03:02.597318 (+ 61723us) write_op.cc:276] Timestamp: P: 1790625777805531 usec, L: 0
0928 20:03:02.610649 (+ 13331us) write_op.cc:270] Start()
0928 20:03:02.610762 (+ 113us) write_op.cc:276] Timestamp: P: 1790625777869025 usec, L: 0
0928 20:03:02.611306 (+ 544us) write_op.cc:270] Start()
0928 20:03:02.611374 (+ 68us) write_op.cc:276] Timestamp: P: 1790625778048737 usec, L: 0
0928 20:03:02.611797 (+ 423us) write_op.cc:270] Start()
0928 20:03:02.611861 (+ 64us) write_op.cc:276] Timestamp: P: 1790625778062676 usec, L: 0
0928 20:03:02.612233 (+ 372us) write_op.cc:270] Start()
0928 20:03:02.612301 (+ 68us) write_op.cc:276] Timestamp: P: 1790625778064639 usec, L: 0
0928 20:03:02.612684 (+ 383us) write_op.cc:270] Start()
0928 20:03:02.612745 (+ 61us) write_op.cc:276] Timestamp: P: 1790625778077050 usec, L: 0
0928 20:03:02.613124 (+ 379us) write_op.cc:270] Start()
0928 20:03:02.613201 (+ 77us) write_op.cc:276] Timestamp: P: 1790625778080715 usec, L: 0
0928 20:03:02.613616 (+ 415us) write_op.cc:270] Start()
0928 20:03:02.613681 (+ 65us) write_op.cc:276] Timestamp: P: 1790625778121643 usec, L: 0
0928 20:03:02.614071 (+ 390us) write_op.cc:270] Start()
0928 20:03:02.735464 (+121393us) write_op.cc:276] Timestamp: P: 1790625778136243 usec, L: 0
0928 20:03:02.782015 (+ 46551us) write_op.cc:270] Start()
0928 20:03:02.787436 (+ 5421us) write_op.cc:276] Timestamp: P: 1790625778254922 usec, L: 0
0928 20:03:02.828635 (+ 41199us) write_op.cc:270] Start()
0928 20:03:02.828738 (+ 103us) write_op.cc:276] Timestamp: P: 1790625778275524 usec, L: 0
0928 20:03:02.882479 (+ 53741us) write_op.cc:270] Start()
0928 20:03:02.882577 (+ 98us) write_op.cc:276] Timestamp: P: 1790625778291189 usec, L: 0
0928 20:03:02.913250 (+ 30673us) write_op.cc:270] Start()
0928 20:03:02.913359 (+ 109us) write_op.cc:276] Timestamp: P: 1790625778332974 usec, L: 0
0928 20:03:02.913921 (+ 562us) write_op.cc:270] Start()
0928 20:03:02.914019 (+ 98us) write_op.cc:276] Timestamp: P: 1790625778334915 usec, L: 0
0928 20:03:02.927048 (+ 13029us) write_op.cc:270] Start()
0928 20:03:02.927182 (+ 134us) write_op.cc:276] Timestamp: P: 1790625778367939 usec, L: 0
0928 20:03:02.931307 (+ 4125us) write_op.cc:270] Start()
0928 20:03:02.931421 (+ 114us) write_op.cc:276] Timestamp: P: 1790625778378445 usec, L: 0
0928 20:03:02.969834 (+ 38413us) write_op.cc:270] Start()
0928 20:03:02.969934 (+ 100us) write_op.cc:276] Timestamp: P: 1790625778380352 usec, L: 0
0928 20:03:02.973048 (+ 3114us) write_op.cc:270] Start()
0928 20:03:03.023253 (+ 50205us) write_op.cc:276] Timestamp: P: 1790625778468356 usec, L: 0
0928 20:03:03.023836 (+ 583us) write_op.cc:270] Start()
0928 20:03:03.023938 (+ 102us) write_op.cc:276] Timestamp: P: 1790625778487314 usec, L: 0
0928 20:03:03.040067 (+ 16129us) write_op.cc:270] Start()
0928 20:03:03.040156 (+ 89us) write_op.cc:276] Timestamp: P: 1790625778515403 usec, L: 0
0928 20:03:03.043408 (+ 3252us) write_op.cc:270] Start()
0928 20:03:03.043517 (+ 109us) write_op.cc:276] Timestamp: P: 1790625778522853 usec, L: 0
0928 20:03:03.043999 (+ 482us) write_op.cc:270] Start()
0928 20:03:03.044073 (+ 74us) write_op.cc:276] Timestamp: P: 1790625778563746 usec, L: 0
0928 20:03:03.044510 (+ 437us) write_op.cc:270] Start()
0928 20:03:03.044573 (+ 63us) write_op.cc:276] Timestamp: P: 1790625778569795 usec, L: 0
0928 20:03:03.044969 (+ 396us) write_op.cc:270] Start()
0928 20:03:03.045048 (+ 79us) write_op.cc:276] Timestamp: P: 1790625778612022 usec, L: 0
0928 20:03:03.045494 (+ 446us) write_op.cc:270] Start()
0928 20:03:03.045589 (+ 95us) write_op.cc:276] Timestamp: P: 1790625778672330 usec, L: 0
0928 20:03:03.046047 (+ 458us) write_op.cc:270] Start()
0928 20:03:03.104211 (+ 58164us) write_op.cc:276] Timestamp: P: 1790625778695172 usec, L: 0
0928 20:03:03.104847 (+ 636us) write_op.cc:270] Start()
0928 20:03:03.104943 (+ 96us) write_op.cc:276] Timestamp: P: 1790625778720697 usec, L: 0
0928 20:03:03.105486 (+ 543us) write_op.cc:270] Start()
0928 20:03:03.105567 (+ 81us) write_op.cc:276] Timestamp: P: 1790625778750185 usec, L: 0
0928 20:03:03.105989 (+ 422us) write_op.cc:270] Start()
0928 20:03:03.106064 (+ 75us) write_op.cc:276] Timestamp: P: 1790625778789348 usec, L: 0
0928 20:03:03.106531 (+ 467us) write_op.cc:270] Start()
0928 20:03:03.106611 (+ 80us) write_op.cc:276] Timestamp: P: 1790625778796340 usec, L: 0
0928 20:03:03.228996 (+122385us) write_op.cc:270] Start()
0928 20:03:03.229245 (+ 249us) write_op.cc:276] Timestamp: P: 1790625778815717 usec, L: 0
0928 20:03:03.229885 (+ 640us) write_op.cc:270] Start()
0928 20:03:03.229970 (+ 85us) write_op.cc:276] Timestamp: P: 1790625778904421 usec, L: 0
0928 20:03:03.230598 (+ 628us) write_op.cc:270] Start()
0928 20:03:03.230691 (+ 93us) write_op.cc:276] Timestamp: P: 1790625778923995 usec, L: 0
0928 20:03:03.231216 (+ 525us) write_op.cc:270] Start()
0928 20:03:03.231304 (+ 88us) write_op.cc:276] Timestamp: P: 1790625778961563 usec, L: 0
0928 20:03:03.231794 (+ 490us) write_op.cc:270] Start()
0928 20:03:03.231881 (+ 87us) write_op.cc:276] Timestamp: P: 1790625778986393 usec, L: 0
0928 20:03:03.232375 (+ 494us) write_op.cc:270] Start()
0928 20:03:03.232480 (+ 105us) write_op.cc:276] Timestamp: P: 1790625779007358 usec, L: 0
0928 20:03:03.232958 (+ 478us) write_op.cc:270] Start()
0928 20:03:03.233043 (+ 85us) write_op.cc:276] Timestamp: P: 1790625779040368 usec, L: 0
0928 20:03:03.233532 (+ 489us) write_op.cc:270] Start()
0928 20:03:03.233616 (+ 84us) write_op.cc:276] Timestamp: P: 1790625779069827 usec, L: 0
0928 20:03:03.323867 (+ 90251us) write_op.cc:270] Start()
0928 20:03:03.324077 (+ 210us) write_op.cc:276] Timestamp: P: 1790625779103993 usec, L: 0
0928 20:03:03.327429 (+ 3352us) write_op.cc:270] Start()
0928 20:03:03.327557 (+ 128us) write_op.cc:276] Timestamp: P: 1790625779151674 usec, L: 0
0928 20:03:03.354758 (+ 27201us) write_op.cc:270] Start()
0928 20:03:03.354843 (+ 85us) write_op.cc:276] Timestamp: P: 1790625779177214 usec, L: 0
0928 20:03:03.355301 (+ 458us) write_op.cc:270] Start()
0928 20:03:03.355368 (+ 67us) write_op.cc:276] Timestamp: P: 1790625779201766 usec, L: 0
0928 20:03:03.355766 (+ 398us) write_op.cc:270] Start()
0928 20:03:03.355838 (+ 72us) write_op.cc:276] Timestamp: P: 1790625779224703 usec, L: 0
0928 20:03:03.434200 (+ 78362us) write_op.cc:270] Start()
0928 20:03:03.434319 (+ 119us) write_op.cc:276] Timestamp: P
I20260928 20:03:05.700131 26913 raft_consensus.cc:359] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.701738 26913 raft_consensus.cc:385] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.702149 26913 raft_consensus.cc:740] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.703493 26913 consensus_queue.cc:260] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.708492 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 433) took 7681 ms. Trace:
I20260928 20:03:05.708882 28059 rpcz_store.cc:276] 0928 20:02:58.027441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.027616 (+ 175us) service_pool.cc:224] Handling call
0928 20:03:05.584088 (+7556472us) ts_tablet_manager.cc:1197] Deleting tablet 46c39c6915964116ac14ea2781c7a52b
0928 20:03:05.708077 (+123989us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.708428 (+ 351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816,"tablet-delete.queue_time_us":7545582}
I20260928 20:03:05.712813 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 435) took 7679 ms. Trace:
I20260928 20:03:05.713167 28059 rpcz_store.cc:276] 0928 20:02:58.033518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.034187 (+ 669us) service_pool.cc:224] Handling call
0928 20:03:05.709856 (+7675669us) ts_tablet_manager.cc:1197] Deleting tablet 91b11022fc774d18b92e0c694f834375
0928 20:03:05.712447 (+ 2591us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.712756 (+ 309us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7675178}
I20260928 20:03:05.714375 28059 tablet_replica.cc:333] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:05.718804 26913 ts_tablet_manager.cc:1480] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.072s user 0.005s sys 0.000s
I20260928 20:03:05.719992 26913 tablet_bootstrap.cc:492] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:05.734094 26594 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.640026 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.645269 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.627655 26912 tablet_bootstrap.cc:492] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:05.741824 26450 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.757776 26450 leader_election.cc:304] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.758863 28357 raft_consensus.cc:2749] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:05.758944 26450 leader_election.cc:343] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.759385 26450 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.759511 28357 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.760231 28572 raft_consensus.cc:2749] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:05.759928 28357 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:05.760418 28059 raft_consensus.cc:2243] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:05.760998 28059 raft_consensus.cc:2272] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.761951 28357 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:05.763409 28059 ts_tablet_manager.cc:1962] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.763860 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.769550 28535 consensus_queue.cc:1048] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:05.770444 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.771458 28573 raft_consensus.cc:493] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.771924 28573 raft_consensus.cc:515] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.774407 28573 leader_election.cc:290] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:05.775733 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:05.777238 26450 leader_election.cc:343] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.778172 26594 leader_election.cc:304] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.778973 28566 raft_consensus.cc:2749] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:05.779906 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 46297.8us
I20260928 20:03:05.750090 26912 tablet_bootstrap.cc:654] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.766232 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.776593 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.798591 28428 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.799045 28428 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.800961 28428 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:05.782580 26739 consensus_peers.cc:597] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0de800a9344d4507b7903d08fcf8e988. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:05.626724 26797 raft_consensus.cc:2468] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:05.803143 26740 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:05.803088 26739 leader_election.cc:304] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:05.804538 28551 raft_consensus.cc:2804] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:05.805243 28551 raft_consensus.cc:697] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:05.806111 28551 consensus_queue.cc:237] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.626075 28030 ts_tablet_manager.cc:1975] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:05.813817 28030 log.cc:1199] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:05.814767 28030 ts_tablet_manager.cc:1996] T f478cce587a548e1aab620721c3bb1c1 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:05.816748 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 388) took 11385 ms. Trace:
W20260928 20:03:05.817322 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.817777 26450 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.818542 28573 raft_consensus.cc:2749] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:05.822676 26450 leader_election.cc:343] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.826061 26450 leader_election.cc:304] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:05.826710 28030 rpcz_store.cc:276] 0928 20:02:54.431466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.431585 (+ 119us) service_pool.cc:224] Handling call
0928 20:03:05.025001 (+10593416us) ts_tablet_manager.cc:1197] Deleting tablet f478cce587a548e1aab620721c3bb1c1
0928 20:03:05.025060 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.425662 (+400602us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.625935 (+200273us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.816687 (+190752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5981,"tablet-delete.queue_time_us":10592739}
I20260928 20:03:05.838647 28573 raft_consensus.cc:2749] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:05.850548 28030 tablet_replica.cc:333] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:05.853389 26913 tablet_bootstrap.cc:654] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.854836 28030 raft_consensus.cc:2243] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Raft consensus shutting down.
I20260928 20:03:05.857710 26916 tablet_bootstrap.cc:654] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:05.862823 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aad5c72e4c64b9e91082860477c78fa" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:05.879236 26655 raft_consensus.cc:2468] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:05.870935 26594 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:05.886986 28566 raft_consensus.cc:2804] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:05.887494 28566 raft_consensus.cc:697] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:05.888347 28566 consensus_queue.cc:237] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.864202 28578 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:05.895280 28578 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.897293 28578 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:05.750236 27857 ts_tablet_manager.cc:1975] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:05.907455 27857 log.cc:1199] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:05.908283 27857 ts_tablet_manager.cc:1996] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:05.903004 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:05.908860 26505 raft_consensus.cc:2468] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:05.911805 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 489) took 6601 ms. Trace:
I20260928 20:03:05.914709 26740 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:05.928256 28578 raft_consensus.cc:2804] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:05.928673 28578 raft_consensus.cc:493] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:05.929050 28578 raft_consensus.cc:3060] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:05.934798 28030 pending_rounds.cc:70] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Trying to abort 1 pending ops.
I20260928 20:03:05.935158 28030 pending_rounds.cc:77] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7334403203941949440 op_type: NO_OP noop_request { }
I20260928 20:03:05.935607 28030 raft_consensus.cc:2889] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:05.936010 28030 raft_consensus.cc:2272] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:05.938122 28030 ts_tablet_manager.cc:1962] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:05.946801 28573 raft_consensus.cc:493] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.963263 28573 raft_consensus.cc:515] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.965108 28573 leader_election.cc:290] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:05.965694 27857 rpcz_store.cc:276] 0928 20:02:59.310070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.862861 (+1552791us) service_pool.cc:224] Handling call
0928 20:03:05.605842 (+4742981us) ts_tablet_manager.cc:1197] Deleting tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
0928 20:03:05.605880 (+ 38us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.702435 (+ 96555us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.750089 (+ 47654us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:05.911747 (+161658us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4742393}
I20260928 20:03:05.967430 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:05.970329 26450 leader_election.cc:343] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.939774 26912 tablet_bootstrap.cc:492] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:05.974834 26912 ts_tablet_manager.cc:1449] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.347s user 0.011s sys 0.000s
I20260928 20:03:05.977334 26912 raft_consensus.cc:359] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.980520 26912 raft_consensus.cc:385] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:05.980858 26912 raft_consensus.cc:740] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:05.982661 26912 consensus_queue.cc:260] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.991057 26916 tablet_bootstrap.cc:492] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:06.002341 26916 ts_tablet_manager.cc:1449] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.317s user 0.009s sys 0.002s
I20260928 20:03:06.004696 26916 raft_consensus.cc:359] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:05.999538 28573 raft_consensus.cc:493] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:05.998943 27857 tablet_replica.cc:333] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:06.014578 28573 raft_consensus.cc:515] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.015509 27857 raft_consensus.cc:2243] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:06.015951 27857 raft_consensus.cc:2272] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:06.016551 28573 leader_election.cc:290] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:06.018384 26916 raft_consensus.cc:385] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.018497 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed48087b59c744f9a928c8d529b69211" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.018705 26916 raft_consensus.cc:740] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:06.022993 26916 consensus_queue.cc:260] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:06.022282 26450 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:05.969511 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:05.971099 26739 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:05.998265 28428 consensus_queue.cc:1048] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:06.035296 28428 raft_consensus.cc:2804] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:06.035652 28428 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:06.035943 28428 raft_consensus.cc:3060] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:05.953315 28578 raft_consensus.cc:515] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.020218 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed48087b59c744f9a928c8d529b69211" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:06.037739 27857 ts_tablet_manager.cc:1962] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:06.039055 28578 leader_election.cc:290] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.040712 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:06.053438 26510 raft_consensus.cc:2468] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:06.058954 26740 leader_election.cc:304] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:06.059793 28579 raft_consensus.cc:2804] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:06.060232 28579 raft_consensus.cc:697] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:06.061002 26912 ts_tablet_manager.cc:1480] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.060s user 0.004s sys 0.001s
I20260928 20:03:06.060961 28579 consensus_queue.cc:237] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:06.062367 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 91932.8us
W20260928 20:03:06.065616 26739 consensus_peers.cc:597] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7242f71b93914dbeadb60617b3f2be3b. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:06.057844 26913 tablet_bootstrap.cc:492] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:06.070163 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.070922 26648 raft_consensus.cc:2393] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:06.072139 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bd74bc45d14e789567df6019f6d99b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:06.072743 26912 tablet_bootstrap.cc:492] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:06.072852 26646 raft_consensus.cc:2393] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
W20260928 20:03:06.082023 26450 leader_election.cc:343] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:06.082442 26450 leader_election.cc:304] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:06.083065 28573 raft_consensus.cc:2749] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:06.084137 26450 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:06.084481 26450 leader_election.cc:304] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:06.085352 28573 raft_consensus.cc:2749] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:06.088505 28533 consensus_queue.cc:1048] T 87024e1a4f184c669ff78efc918a9eef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:06.091956 28428 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:06.096081 26740 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:06.097985 26913 ts_tablet_manager.cc:1449] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.378s user 0.012s sys 0.002s
I20260928 20:03:06.098253 26916 ts_tablet_manager.cc:1480] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.096s user 0.006s sys 0.000s
I20260928 20:03:06.100349 26913 raft_consensus.cc:359] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.100966 26913 raft_consensus.cc:385] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.101209 26913 raft_consensus.cc:740] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:06.104161 28579 consensus_queue.cc:1048] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:06.115998 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aad5c72e4c64b9e91082860477c78fa" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:06.116562 26654 raft_consensus.cc:3060] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:06.120949 28551 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:06.121418 28551 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:06.123855 28551 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:06.124677 26654 raft_consensus.cc:2468] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:06.126026 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:06.126991 26508 raft_consensus.cc:2393] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:06.140018 26739 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:06.140440 28551 consensus_queue.cc:1048] T aec2497f4eac4408a37eb2a40122a672 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:06.141176 28506 raft_consensus.cc:2804] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:06.142928 28506 raft_consensus.cc:697] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:06.143695 28506 consensus_queue.cc:237] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.093992 28428 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.089980 26912 tablet_bootstrap.cc:654] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:06.166854 26916 tablet_bootstrap.cc:492] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:06.169056 28059 ts_tablet_manager.cc:1975] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260928 20:03:06.172941 26916 tablet_bootstrap.cc:654] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:06.101794 26913 consensus_queue.cc:260] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.205399 28030 ts_tablet_manager.cc:1975] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 20:03:06.205833 28030 log.cc:1199] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/01533b61bad74ddb9056aeacef13a126
I20260928 20:03:06.208231 28573 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.208916 28573 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:06.211171 28573 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:06.213164 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:06.213214 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.213804 26793 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:06.213807 26654 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 2.
I20260928 20:03:06.215598 26450 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:06.216882 28573 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:03:06.217255 28573 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:06.217572 28573 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:06.219198 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.220208 28357 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.220629 28357 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.222553 28357 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:06.225601 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.219823 26654 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:06.227401 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:06.227891 26450 leader_election.cc:343] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:06.228717 26450 leader_election.cc:343] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:06.228771 28573 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:06.229106 26450 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:06.230119 28357 raft_consensus.cc:2749] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:06.232764 26916 tablet_bootstrap.cc:492] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:06.233296 26916 ts_tablet_manager.cc:1449] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.067s user 0.010s sys 0.000s
I20260928 20:03:06.235199 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:06.235869 26793 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 3
I20260928 20:03:06.238257 28573 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:06.238613 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:06.239274 26654 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:06.178514 28059 log.cc:1199] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/2d9ca77e114c4d06bde1bcd862c8eccf
I20260928 20:03:06.245064 28579 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.245651 28579 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.246321 26793 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
I20260928 20:03:06.251209 26916 raft_consensus.cc:359] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.255550 28059 ts_tablet_manager.cc:1996] T 2d9ca77e114c4d06bde1bcd862c8eccf P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:06.266798 26916 raft_consensus.cc:385] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.248624 26912 tablet_bootstrap.cc:492] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:06.271361 26912 ts_tablet_manager.cc:1449] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.209s user 0.014s sys 0.000s
I20260928 20:03:06.271287 26916 raft_consensus.cc:740] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:06.248946 28579 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:06.250389 26740 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
I20260928 20:03:06.272150 26916 consensus_queue.cc:260] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.260624 28030 ts_tablet_manager.cc:1996] T 01533b61bad74ddb9056aeacef13a126 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:06.274346 26916 ts_tablet_manager.cc:1480] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260928 20:03:06.274199 26450 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:06.276322 28573 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 20:03:06.276753 28573 raft_consensus.cc:697] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 3 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:06.276841 27857 ts_tablet_manager.cc:1975] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:06.277176 27857 log.cc:1199] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:06.277808 27857 ts_tablet_manager.cc:1996] T fa49943f465f47778ac985cb5f4e6c0f P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:06.277567 28573 consensus_queue.cc:237] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:06.279759 26912 raft_consensus.cc:359] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.280472 26912 raft_consensus.cc:385] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.280702 26912 raft_consensus.cc:740] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:06.285753 26913 ts_tablet_manager.cc:1480] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.187s user 0.009s sys 0.000s
I20260928 20:03:06.291706 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 458) took 7600 ms. Trace:
I20260928 20:03:06.292029 28059 rpcz_store.cc:276] 0928 20:02:58.691185 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.488384 (+797199us) service_pool.cc:224] Handling call
0928 20:03:05.714070 (+6225686us) ts_tablet_manager.cc:1197] Deleting tablet 2d9ca77e114c4d06bde1bcd862c8eccf
0928 20:03:05.714265 (+ 195us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:05.888660 (+174395us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.167850 (+279190us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.291648 (+123798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45239,"tablet-delete.queue_time_us":6203182}
I20260928 20:03:06.293514 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 463) took 7601 ms. Trace:
I20260928 20:03:06.310946 26912 consensus_queue.cc:260] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.314268 26912 ts_tablet_manager.cc:1480] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.043s user 0.005s sys 0.002s
I20260928 20:03:06.316507 26654 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
I20260928 20:03:06.348091 26739 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:06.348347 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.348958 26654 raft_consensus.cc:2468] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:06.349469 28428 raft_consensus.cc:2764] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260928 20:03:06.364189 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 398) took 11682 ms. Trace:
I20260928 20:03:06.364533 28030 rpcz_store.cc:276] 0928 20:02:54.682062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:54.682198 (+ 136us) service_pool.cc:224] Handling call
0928 20:03:05.850378 (+11168180us) ts_tablet_manager.cc:1197] Deleting tablet 01533b61bad74ddb9056aeacef13a126
0928 20:03:05.850432 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.079058 (+228626us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.205270 (+126212us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.364107 (+158837us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11167525}
I20260928 20:03:06.366374 28030 tablet_replica.cc:333] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:06.367035 26912 tablet_bootstrap.cc:492] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:06.367218 28030 raft_consensus.cc:2243] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:06.368299 28030 pending_rounds.cc:70] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Trying to abort 1 pending ops.
I20260928 20:03:06.368600 28030 pending_rounds.cc:77] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403220253839360 op_type: NO_OP noop_request { }
I20260928 20:03:06.369010 28030 raft_consensus.cc:2889] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:06.369402 28030 raft_consensus.cc:2272] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:06.372406 28030 ts_tablet_manager.cc:1962] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:06.293802 28059 rpcz_store.cc:276] 0928 20:02:58.692350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.729572 (+1037222us) service_pool.cc:224] Handling call
0928 20:03:06.293118 (+6563546us) ts_tablet_manager.cc:1197] Deleting tablet 7775ad91c86840c49a902b059a0ff74d
0928 20:03:06.293181 (+ 63us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.293464 (+ 283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6563068}
W20260928 20:03:06.402503 26148 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.732s (SENT)
I20260928 20:03:06.402961 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:03:06.406862 26913 tablet_bootstrap.cc:492] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:06.423502 26916 tablet_bootstrap.cc:492] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:06.419170 28428 consensus_queue.cc:1048] T 1d945be7bea449ba8c5541b60eb18334 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:06.419953 26739 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:06.431526 28428 raft_consensus.cc:2804] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:06.431900 28428 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:06.432221 28428 raft_consensus.cc:3060] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:06.440461 28428 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.447270 26916 tablet_bootstrap.cc:654] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:06.422230 26912 tablet_bootstrap.cc:654] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:06.453711 28605 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 20:03:06.457767 26913 tablet_bootstrap.cc:654] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:06.456501 26148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 53605.8us
I20260928 20:03:06.477280 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 492) took 7166 ms. Trace:
I20260928 20:03:06.477605 27857 rpcz_store.cc:276] 0928 20:02:59.310822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.982835 (+1672013us) service_pool.cc:224] Handling call
0928 20:03:05.971680 (+4988845us) ts_tablet_manager.cc:1197] Deleting tablet fa49943f465f47778ac985cb5f4e6c0f
0928 20:03:05.994006 (+ 22326us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.198672 (+204666us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.276718 (+ 78046us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.477218 (+200500us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4988196}
I20260928 20:03:06.479995 27857 tablet_replica.cc:333] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:06.480782 27857 raft_consensus.cc:2243] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:06.480998 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 467) took 7787 ms. Trace:
I20260928 20:03:06.481348 28059 rpcz_store.cc:276] 0928 20:02:58.693315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.731543 (+1038228us) service_pool.cc:224] Handling call
0928 20:03:06.395074 (+6663531us) ts_tablet_manager.cc:1197] Deleting tablet 6a31001f85b44bfcb35a29675f177b9e
0928 20:03:06.480629 (+ 85555us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.480940 (+ 311us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6663099}
I20260928 20:03:06.482600 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 459) took 7791 ms. Trace:
I20260928 20:03:06.483037 28059 rpcz_store.cc:276] 0928 20:02:58.691414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.560650 (+869236us) service_pool.cc:224] Handling call
0928 20:03:06.482243 (+6921593us) ts_tablet_manager.cc:1197] Deleting tablet 3657e36a6d2844c28852db1a4f2ed191
0928 20:03:06.482301 (+ 58us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.482551 (+ 250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6704011}
I20260928 20:03:06.486248 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 473) took 7524 ms. Trace:
I20260928 20:03:06.491793 27857 raft_consensus.cc:2272] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:06.494686 27857 ts_tablet_manager.cc:1962] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:06.511402 26912 tablet_bootstrap.cc:492] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:06.511824 26912 ts_tablet_manager.cc:1449] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.145s user 0.004s sys 0.006s
W20260928 20:03:06.517946 26740 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
I20260928 20:03:06.517027 28428 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.525930 28573 raft_consensus.cc:493] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.526474 28573 raft_consensus.cc:515] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.528721 28573 leader_election.cc:290] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:06.530166 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:06.534929 26450 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:06.488858 28059 rpcz_store.cc:276] 0928 20:02:58.961523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.985807 (+1024284us) service_pool.cc:224] Handling call
0928 20:03:06.485098 (+6499291us) ts_tablet_manager.cc:1197] Deleting tablet 23d262c7a15b434d8caea0a818323dd1
0928 20:03:06.485173 (+ 75us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.485954 (+ 781us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6498706}
I20260928 20:03:06.545179 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.546700 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 474) took 7585 ms. Trace:
W20260928 20:03:06.549081 26450 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:06.549497 26450 leader_election.cc:304] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:06.554293 28573 raft_consensus.cc:2749] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:06.558223 26913 tablet_bootstrap.cc:492] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:06.558657 26913 ts_tablet_manager.cc:1449] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.152s user 0.011s sys 0.000s
W20260928 20:03:06.565256 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 046ed3ac8b6b46afbc1e1bde4b2365ef consensus state has no leader
I20260928 20:03:06.547035 28059 rpcz_store.cc:276] 0928 20:02:58.961753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.986438 (+1024685us) service_pool.cc:224] Handling call
0928 20:03:06.546309 (+6559871us) ts_tablet_manager.cc:1197] Deleting tablet de40520ccd9b4a52a45c4085afd45b2d
0928 20:03:06.546379 (+ 70us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.546644 (+ 265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6207079}
I20260928 20:03:06.576642 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 484) took 7612 ms. Trace:
I20260928 20:03:06.576963 28059 rpcz_store.cc:276] 0928 20:02:58.964327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.934569 (+1970242us) service_pool.cc:224] Handling call
0928 20:03:06.576252 (+5641683us) ts_tablet_manager.cc:1197] Deleting tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
0928 20:03:06.576315 (+ 63us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.576579 (+ 264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5641172}
I20260928 20:03:06.585559 28579 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:06.586073 28579 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:06.587962 28579 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:06.588874 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:06.589498 26507 raft_consensus.cc:2468] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:06.591087 26740 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:06.591944 28579 raft_consensus.cc:2804] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:06.592280 28579 raft_consensus.cc:493] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:06.592617 28579 raft_consensus.cc:3060] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:06.599603 26916 tablet_bootstrap.cc:492] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:06.600064 26916 ts_tablet_manager.cc:1449] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.177s user 0.022s sys 0.012s
I20260928 20:03:06.603091 26913 raft_consensus.cc:359] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.553479 26912 raft_consensus.cc:359] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:06.619349 26912 raft_consensus.cc:385] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.619652 26912 raft_consensus.cc:740] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:06.620291 26912 consensus_queue.cc:260] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:06.621804 26912 ts_tablet_manager.cc:1480] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.110s user 0.007s sys 0.000s
I20260928 20:03:06.623558 28030 ts_tablet_manager.cc:1975] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:06.624011 28030 log.cc:1199] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:06.624814 28030 ts_tablet_manager.cc:1996] T 0aad5c72e4c64b9e91082860477c78fa P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:03:06.646667 26740 consensus_peers.cc:597] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:06.649557 28448 raft_consensus.cc:493] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.650091 28448 raft_consensus.cc:515] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.650699 27857 ts_tablet_manager.cc:1975] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:06.651079 27857 log.cc:1199] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:03:06.653913 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:06.654668 26507 raft_consensus.cc:2468] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:06.658164 26595 leader_election.cc:304] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:06.659065 28533 raft_consensus.cc:2804] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:06.659406 28533 raft_consensus.cc:493] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:06.659678 28533 raft_consensus.cc:3060] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:06.663555 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b667a45712c1449384e1a288f55fd062" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:06.663727 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 485) took 7699 ms. Trace:
I20260928 20:03:06.664096 26653 raft_consensus.cc:3060] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:06.664048 28059 rpcz_store.cc:276] 0928 20:02:58.964565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.934863 (+1970298us) service_pool.cc:224] Handling call
0928 20:03:06.577949 (+5643086us) ts_tablet_manager.cc:1197] Deleting tablet 292eef7bab904a7ea5ef6dbdaba1d37d
0928 20:03:06.578012 (+ 63us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.663668 (+ 85656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5642536}
I20260928 20:03:06.662250 27857 ts_tablet_manager.cc:1996] T 292eef7bab904a7ea5ef6dbdaba1d37d P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:06.668290 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.668968 26655 raft_consensus.cc:2393] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:06.669607 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 491) took 7359 ms. Trace:
I20260928 20:03:06.669907 27857 rpcz_store.cc:276] 0928 20:02:59.310583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.953585 (+1643002us) service_pool.cc:224] Handling call
0928 20:03:06.479857 (+5526272us) ts_tablet_manager.cc:1197] Deleting tablet 292eef7bab904a7ea5ef6dbdaba1d37d
0928 20:03:06.479896 (+ 39us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.531243 (+ 51347us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.650568 (+119325us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.669548 (+ 18980us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5493125}
I20260928 20:03:06.677495 26653 raft_consensus.cc:2468] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:06.678007 28448 leader_election.cc:290] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.682709 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 497) took 6772 ms. Trace:
I20260928 20:03:06.608469 26913 raft_consensus.cc:385] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.683032 27857 rpcz_store.cc:276] 0928 20:02:59.910097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.894438 (+1984341us) service_pool.cc:224] Handling call
0928 20:03:06.682321 (+4787883us) ts_tablet_manager.cc:1197] Deleting tablet 62114712f2c040e6b1ae831911d68896
0928 20:03:06.682369 (+ 48us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.682648 (+ 279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4787312}
I20260928 20:03:06.683555 26913 raft_consensus.cc:740] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:06.684173 26913 consensus_queue.cc:260] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.690979 27857 tablet_replica.cc:333] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:06.694592 26912 tablet_bootstrap.cc:492] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:06.695259 28533 raft_consensus.cc:515] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.703255 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:06.703917 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 407) took 11245 ms. Trace:
I20260928 20:03:06.703943 26507 raft_consensus.cc:3060] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:06.704241 28030 rpcz_store.cc:276] 0928 20:02:55.458396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.461119 (+ 2723us) service_pool.cc:224] Handling call
0928 20:03:06.365473 (+10904354us) ts_tablet_manager.cc:1197] Deleting tablet 0aad5c72e4c64b9e91082860477c78fa
0928 20:03:06.366244 (+ 771us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.545650 (+179406us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.623428 (+ 77778us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.703853 (+ 80425us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10730992}
I20260928 20:03:06.706542 28428 raft_consensus.cc:493] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.707001 28030 tablet_replica.cc:333] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:06.707818 28030 raft_consensus.cc:2243] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:06.707001 28428 raft_consensus.cc:515] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.708683 28030 raft_consensus.cc:2272] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:06.709561 28428 leader_election.cc:290] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.683036 26916 raft_consensus.cc:359] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.711480 28030 ts_tablet_manager.cc:1962] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:06.711495 26916 raft_consensus.cc:385] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.711735 26916 raft_consensus.cc:740] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:06.711634 26740 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:06.712323 26916 consensus_queue.cc:260] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.720760 26507 raft_consensus.cc:2468] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:06.722216 28533 leader_election.cc:290] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.727089 26595 leader_election.cc:304] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:06.728494 28533 raft_consensus.cc:2804] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:06.729451 28533 raft_consensus.cc:697] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:06.730310 28533 consensus_queue.cc:237] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:06.742384 26739 consensus_peers.cc:597] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d9ca77e114c4d06bde1bcd862c8eccf. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:06.755970 28579 raft_consensus.cc:515] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:06.765494 26912 tablet_bootstrap.cc:654] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:06.767042 26913 ts_tablet_manager.cc:1480] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.208s user 0.006s sys 0.003s
I20260928 20:03:06.779851 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 486) took 7815 ms. Trace:
I20260928 20:03:06.780212 28059 rpcz_store.cc:276] 0928 20:02:58.964800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.935130 (+1970330us) service_pool.cc:224] Handling call
0928 20:03:06.664972 (+5729842us) ts_tablet_manager.cc:1197] Deleting tablet fa49943f465f47778ac985cb5f4e6c0f
0928 20:03:06.779451 (+114479us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.779785 (+ 334us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5707469}
I20260928 20:03:06.782550 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 492) took 6101 ms. Trace:
I20260928 20:03:06.782862 28059 rpcz_store.cc:276] 0928 20:03:00.681299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.112135 (+430836us) service_pool.cc:224] Handling call
0928 20:03:06.781154 (+5669019us) ts_tablet_manager.cc:1197] Deleting tablet 62114712f2c040e6b1ae831911d68896
0928 20:03:06.782148 (+ 994us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.782495 (+ 347us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5668475}
I20260928 20:03:06.790289 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 495) took 6108 ms. Trace:
I20260928 20:03:06.790599 28059 rpcz_store.cc:276] 0928 20:03:00.682329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.634875 (+952546us) service_pool.cc:224] Handling call
0928 20:03:06.783704 (+5148829us) ts_tablet_manager.cc:1197] Deleting tablet ed48087b59c744f9a928c8d529b69211
0928 20:03:06.789980 (+ 6276us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.790239 (+ 259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5147305}
I20260928 20:03:06.791637 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 496) took 6105 ms. Trace:
I20260928 20:03:06.791919 28059 rpcz_store.cc:276] 0928 20:03:00.691861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.636692 (+944831us) service_pool.cc:224] Handling call
0928 20:03:06.791410 (+5154718us) ts_tablet_manager.cc:1197] Deleting tablet a86e8a782b3e46d09a45bbb7025546af
0928 20:03:06.791445 (+ 35us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.791591 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5153936}
I20260928 20:03:06.792817 28059 tablet_replica.cc:333] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:06.793535 28059 raft_consensus.cc:2243] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:06.796860 26913 tablet_bootstrap.cc:492] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:06.758720 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:06.772749 28573 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.814682 28573 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.816601 28573 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:06.818434 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:06.819700 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:06.819855 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:06.822306 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:06.822672 26450 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:06.823684 28573 raft_consensus.cc:2749] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:06.824832 26507 raft_consensus.cc:2468] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:06.826128 26740 leader_election.cc:304] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:06.754172 26916 ts_tablet_manager.cc:1480] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.154s user 0.007s sys 0.001s
I20260928 20:03:06.757875 28579 leader_election.cc:290] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:06.833662 26916 tablet_bootstrap.cc:492] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:06.835424 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 58546.7us
I20260928 20:03:06.855947 28578 raft_consensus.cc:2804] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:06.856917 28578 raft_consensus.cc:697] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:06.857774 28578 consensus_queue.cc:237] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:06.869340 26916 tablet_bootstrap.cc:654] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:06.876295 28059 pending_rounds.cc:70] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:03:06.876569 28059 pending_rounds.cc:77] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403202674298880 op_type: NO_OP noop_request { }
I20260928 20:03:06.876904 28059 raft_consensus.cc:2889] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:06.878073 28059 raft_consensus.cc:2272] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:06.889943 26912 tablet_bootstrap.cc:492] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:06.890410 26912 ts_tablet_manager.cc:1449] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.196s user 0.006s sys 0.004s
I20260928 20:03:06.892768 26912 raft_consensus.cc:359] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.893393 26912 raft_consensus.cc:385] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:06.893633 26912 raft_consensus.cc:740] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:03:06.902377 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 58511.7us
I20260928 20:03:06.903426 28557 consensus_queue.cc:1048] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:06.905427 28030 ts_tablet_manager.cc:1975] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:06.906800 28030 log.cc:1199] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b94aed8337bb4b20b7977e91640c6710
I20260928 20:03:06.916934 26912 consensus_queue.cc:260] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.918875 26912 ts_tablet_manager.cc:1480] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260928 20:03:06.903235 26739 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:06.919708 28578 raft_consensus.cc:2804] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:06.920147 28578 raft_consensus.cc:697] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:06.920912 28578 consensus_queue.cc:237] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.924811 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5de4a82bd41c1a8b2af2ba7417c46" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:06.927779 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8db8da5c3a42679d26c22396938fd2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:06.937956 26654 raft_consensus.cc:2393] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:06.925415 26659 raft_consensus.cc:2468] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:06.957613 26912 tablet_bootstrap.cc:492] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:06.962570 28573 raft_consensus.cc:493] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.963989 28573 raft_consensus.cc:515] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.962658 27857 raft_consensus.cc:2243] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:06.964895 27857 raft_consensus.cc:2272] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:06.966820 27857 ts_tablet_manager.cc:1962] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:06.969786 28573 leader_election.cc:290] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:06.976858 28506 raft_consensus.cc:493] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:06.977330 28506 raft_consensus.cc:515] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:06.977945 28030 ts_tablet_manager.cc:1996] T b94aed8337bb4b20b7977e91640c6710 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:06.979382 28506 leader_election.cc:290] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:06.980512 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 408) took 11516 ms. Trace:
I20260928 20:03:06.980825 28030 rpcz_store.cc:276] 0928 20:02:55.463857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.464306 (+ 449us) service_pool.cc:224] Handling call
0928 20:03:06.706830 (+11242524us) ts_tablet_manager.cc:1197] Deleting tablet b94aed8337bb4b20b7977e91640c6710
0928 20:03:06.706898 (+ 68us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.755297 (+ 48399us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.905280 (+149983us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:06.980444 (+ 75164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11072064}
I20260928 20:03:06.996335 26913 tablet_bootstrap.cc:654] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.002434 28059 ts_tablet_manager.cc:1962] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:07.027267 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:07.027935 26505 raft_consensus.cc:2468] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:07.032617 26740 leader_election.cc:304] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:07.034039 28428 raft_consensus.cc:2804] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:07.034380 28428 raft_consensus.cc:493] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:07.034669 28428 raft_consensus.cc:3060] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.038527 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.044623 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 411) took 11525 ms. Trace:
I20260928 20:03:07.044947 28030 rpcz_store.cc:276] 0928 20:02:55.519774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:55.526729 (+ 6955us) service_pool.cc:224] Handling call
0928 20:03:07.033075 (+11506346us) ts_tablet_manager.cc:1197] Deleting tablet c6544b7b405c4831900f37e052892409
0928 20:03:07.033134 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.044567 (+ 11433us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11391395}
I20260928 20:03:07.047317 26655 raft_consensus.cc:1275] T 09bd74bc45d14e789567df6019f6d99b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260928 20:03:07.050995 28428 raft_consensus.cc:515] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.051753 27857 ts_tablet_manager.cc:1975] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:07.061255 27857 log.cc:1199] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/ed48087b59c744f9a928c8d529b69211
I20260928 20:03:07.064872 27857 ts_tablet_manager.cc:1996] T ed48087b59c744f9a928c8d529b69211 P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:07.069733 27857 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36268 (request call id 500) took 7117 ms. Trace:
I20260928 20:03:07.072952 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.090018 28428 leader_election.cc:290] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:07.091022 28428 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.091410 28428 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:07.093088 26913 tablet_bootstrap.cc:492] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:07.093500 26913 ts_tablet_manager.cc:1449] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.297s user 0.014s sys 0.000s
I20260928 20:03:07.093528 28428 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:07.044094 28579 consensus_queue.cc:1048] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260928 20:03:07.095860 26913 raft_consensus.cc:359] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.096298 26912 tablet_bootstrap.cc:654] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.096486 26913 raft_consensus.cc:385] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.096722 26913 raft_consensus.cc:740] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.097251 26913 consensus_queue.cc:260] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.071880 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:07.105293 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:07.105834 26508 raft_consensus.cc:3060] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.103333 27857 rpcz_store.cc:276] 0928 20:02:59.952109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.909015 (+1956906us) service_pool.cc:224] Handling call
0928 20:03:06.690823 (+4781808us) ts_tablet_manager.cc:1197] Deleting tablet ed48087b59c744f9a928c8d529b69211
0928 20:03:06.690874 (+ 51us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:06.977854 (+286980us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.051628 (+ 73774us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.069665 (+ 18037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270820,"tablet-delete.queue_time_us":4781226}
I20260928 20:03:07.111312 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:07.111894 26510 raft_consensus.cc:2468] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:07.115434 26740 leader_election.cc:304] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:07.121969 28573 raft_consensus.cc:493] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.122596 28573 raft_consensus.cc:515] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.124845 28573 leader_election.cc:290] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.073614 28613 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.101948 26797 raft_consensus.cc:3060] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.127571 28613 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:07.129940 28613 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:07.078927 26450 leader_election.cc:343] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.062947 26916 tablet_bootstrap.cc:492] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:03:07.131868 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 52981.4us
I20260928 20:03:07.132035 26916 ts_tablet_manager.cc:1449] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.299s user 0.010s sys 0.015s
I20260928 20:03:07.134220 28618 raft_consensus.cc:2804] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:07.134562 28618 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:07.134507 26916 raft_consensus.cc:359] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.135133 26916 raft_consensus.cc:385] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.135695 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.135993 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.136817 28618 raft_consensus.cc:3060] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.139602 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16796100116a4fe4a64893f49fb1cad4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.135366 26916 raft_consensus.cc:740] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.144842 26916 consensus_queue.cc:260] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.147773 26916 ts_tablet_manager.cc:1480] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20260928 20:03:07.171582 28573 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.172245 26508 raft_consensus.cc:2468] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:07.172138 28573 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.174147 28573 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.175639 26740 leader_election.cc:304] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:07.176878 26916 tablet_bootstrap.cc:492] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:07.178792 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.179970 28622 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:07.180516 28622 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:03:07.182809 26450 leader_election.cc:343] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.183408 28622 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
W20260928 20:03:07.183396 26450 leader_election.cc:343] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.183938 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:07.184106 26450 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.185111 26913 ts_tablet_manager.cc:1480] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.091s user 0.004s sys 0.002s
I20260928 20:03:07.189680 28613 raft_consensus.cc:493] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.144542 28618 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:07.194223 28613 raft_consensus.cc:515] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.195581 28618 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:07.203415 26797 raft_consensus.cc:2468] T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:07.204355 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 413) took 10511 ms. Trace:
I20260928 20:03:07.204746 28030 rpcz_store.cc:276] 0928 20:02:56.692913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.870277 (+177364us) service_pool.cc:224] Handling call
0928 20:03:07.137040 (+10266763us) ts_tablet_manager.cc:1197] Deleting tablet 762cb728cc574a36a68fbe9033544b04
0928 20:03:07.158665 (+ 21625us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.204292 (+ 45627us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10195787}
I20260928 20:03:07.206986 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 414) took 10336 ms. Trace:
I20260928 20:03:07.207355 28030 rpcz_store.cc:276] 0928 20:02:56.870532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:56.870633 (+ 101us) service_pool.cc:224] Handling call
0928 20:03:07.205834 (+10335201us) ts_tablet_manager.cc:1197] Deleting tablet 03509d3602b345f69f059ae11c461920
0928 20:03:07.205893 (+ 59us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.206211 (+ 318us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10308412}
I20260928 20:03:07.207953 28573 raft_consensus.cc:493] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.209035 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 425) took 10162 ms. Trace:
I20260928 20:03:07.208809 28573 raft_consensus.cc:515] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.209391 28030 rpcz_store.cc:276] 0928 20:02:57.046591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.046711 (+ 120us) service_pool.cc:224] Handling call
0928 20:03:07.208611 (+10161900us) ts_tablet_manager.cc:1197] Deleting tablet 030f48d0d716450aaa4248d9fb1397ba
0928 20:03:07.208723 (+ 112us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.208986 (+ 263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10124422}
I20260928 20:03:07.211721 28573 leader_election.cc:290] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:07.214025 26595 consensus_peers.cc:597] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd3fa371924149fb814c8458488aea61. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:07.223557 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.227725 26913 tablet_bootstrap.cc:492] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:07.198740 28613 leader_election.cc:290] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.230078 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.234313 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:07.234965 26508 raft_consensus.cc:3060] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.242434 26913 tablet_bootstrap.cc:654] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:07.253947 26450 leader_election.cc:343] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:07.265448 26450 leader_election.cc:343] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.268355 26648 raft_consensus.cc:1275] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Refusing update from remote peer 9b44798af33f4733ba9cde0a1b541f54: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 20:03:07.269939 28613 consensus_queue.cc:1048] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 20:03:07.272318 28620 raft_consensus.cc:493] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.272765 28620 raft_consensus.cc:515] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.278142 28620 leader_election.cc:290] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:07.281418 26916 tablet_bootstrap.cc:654] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.299538 26913 tablet_bootstrap.cc:492] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:07.300007 26913 ts_tablet_manager.cc:1449] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.072s user 0.007s sys 0.002s
I20260928 20:03:07.303233 26913 raft_consensus.cc:359] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.305429 26913 raft_consensus.cc:385] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.305716 26913 raft_consensus.cc:740] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.306383 26913 consensus_queue.cc:260] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.312372 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:07.313508 26507 raft_consensus.cc:2393] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:07.233275 28578 raft_consensus.cc:2804] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:07.293491 28030 tablet_replica.cc:333] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:07.319151 28030 raft_consensus.cc:2243] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:07.318578 28578 raft_consensus.cc:697] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:07.323011 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.324975 28030 raft_consensus.cc:2272] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:07.325083 26793 raft_consensus.cc:1275] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Refusing update from remote peer 9b44798af33f4733ba9cde0a1b541f54: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 20:03:07.321578 28578 consensus_queue.cc:237] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.328012 26913 ts_tablet_manager.cc:1480] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.028s user 0.006s sys 0.001s
I20260928 20:03:07.328770 28030 ts_tablet_manager.cc:1962] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:03:07.330981 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 215275us
I20260928 20:03:07.333799 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.335039 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.337107 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.348414 26912 tablet_bootstrap.cc:492] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:07.348845 26912 ts_tablet_manager.cc:1449] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.391s user 0.012s sys 0.010s
I20260928 20:03:07.353544 26916 tablet_bootstrap.cc:492] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:07.354003 26916 ts_tablet_manager.cc:1449] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.177s user 0.009s sys 0.000s
I20260928 20:03:07.358398 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.362270 28620 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:07.362784 28620 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.365433 28620 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:07.358465 26739 leader_election.cc:304] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:07.359331 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.371066 28428 raft_consensus.cc:2804] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:07.371397 28428 raft_consensus.cc:493] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:07.371678 28428 raft_consensus.cc:3060] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.264724 26508 raft_consensus.cc:2468] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:07.373696 26740 leader_election.cc:304] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:07.374568 28628 raft_consensus.cc:2804] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:07.375612 28628 raft_consensus.cc:697] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:07.376362 28628 consensus_queue.cc:237] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:07.378585 28428 raft_consensus.cc:515] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.380721 28428 leader_election.cc:290] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:07.381428 26739 leader_election.cc:343] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:07.383679 26740 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:07.386652 28557 consensus_queue.cc:1048] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 20:03:07.392130 26508 raft_consensus.cc:1275] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260928 20:03:07.399899 28627 consensus_queue.cc:1048] T 09bd74bc45d14e789567df6019f6d99b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260928 20:03:07.414536 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:07.415144 26646 raft_consensus.cc:3060] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.418840 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.424125 26646 raft_consensus.cc:2468] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:03:07.429107 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 53949.7us
I20260928 20:03:07.434959 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:07.448418 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d5de4a82bd41c1a8b2af2ba7417c46" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:07.448915 26655 raft_consensus.cc:3060] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.458144 28059 ts_tablet_manager.cc:1975] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:07.458611 28059 log.cc:1199] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/4cd2204d99e14a07af962295b152d60f
I20260928 20:03:07.460389 28059 ts_tablet_manager.cc:1996] T 4cd2204d99e14a07af962295b152d60f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:03:07.473062 26740 consensus_peers.cc:597] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:07.475838 28631 log.cc:927] Time spent T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.156s user 0.000s sys 0.000s
I20260928 20:03:07.478020 26916 raft_consensus.cc:359] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:07.481783 26595 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:07.482003 26913 tablet_bootstrap.cc:492] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:07.484023 26655 raft_consensus.cc:2468] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:07.501101 26913 tablet_bootstrap.cc:654] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.523504 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647a383938f947108890ae2042e3edc3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.385497 26912 raft_consensus.cc:359] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.527184 26912 raft_consensus.cc:385] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.527554 26912 raft_consensus.cc:740] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.546398 26913 tablet_bootstrap.cc:492] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:07.546835 26913 ts_tablet_manager.cc:1449] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.003s
I20260928 20:03:07.555626 26912 consensus_queue.cc:260] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.483425 28613 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.560698 28613 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.562615 28613 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.484491 28573 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.563424 28573 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.565191 28573 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.566202 26916 raft_consensus.cc:385] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.566550 26916 raft_consensus.cc:740] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.567200 26916 consensus_queue.cc:260] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.568557 28566 consensus_queue.cc:1048] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:07.549787 26913 raft_consensus.cc:359] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:07.573637 26913 raft_consensus.cc:385] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.573933 26913 raft_consensus.cc:740] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.584573 26912 ts_tablet_manager.cc:1480] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.235s user 0.007s sys 0.001s
W20260928 20:03:07.567953 26739 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.582897 26913 consensus_queue.cc:260] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:07.587654 26913 ts_tablet_manager.cc:1480] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
W20260928 20:03:07.588565 26739 leader_election.cc:343] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.591034 26739 leader_election.cc:304] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:07.591704 28628 raft_consensus.cc:2804] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:07.592149 28628 raft_consensus.cc:697] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:07.592895 28628 consensus_queue.cc:237] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:07.602126 26594 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:07.602720 26594 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.604234 28623 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:07.608857 26594 leader_election.cc:304] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.611508 28566 raft_consensus.cc:2749] T 647a383938f947108890ae2042e3edc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:07.638432 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 497) took 6939 ms. Trace:
I20260928 20:03:07.638800 28059 rpcz_store.cc:276] 0928 20:03:00.698843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.637615 (+938772us) service_pool.cc:224] Handling call
0928 20:03:06.792693 (+5155078us) ts_tablet_manager.cc:1197] Deleting tablet 4cd2204d99e14a07af962295b152d60f
0928 20:03:06.792726 (+ 33us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.156033 (+363307us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.417984 (+261951us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.638359 (+220375us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5154298}
I20260928 20:03:07.641938 28059 tablet_replica.cc:333] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
W20260928 20:03:07.485183 26450 leader_election.cc:343] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.642298 26450 leader_election.cc:304] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.642803 28059 raft_consensus.cc:2243] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
W20260928 20:03:07.643097 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 157953us
I20260928 20:03:07.643987 28573 raft_consensus.cc:2749] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:07.644088 26913 tablet_bootstrap.cc:492] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:07.644546 28573 consensus_queue.cc:1048] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260928 20:03:07.647047 26450 leader_election.cc:343] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.647416 26450 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.648023 28644 raft_consensus.cc:2749] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:07.649781 26913 tablet_bootstrap.cc:654] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.637557 26510 raft_consensus.cc:1275] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260928 20:03:07.656015 28627 consensus_queue.cc:1048] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 20:03:07.672150 26916 ts_tablet_manager.cc:1480] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.318s user 0.006s sys 0.000s
I20260928 20:03:07.672843 28059 pending_rounds.cc:70] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Trying to abort 1 pending ops.
I20260928 20:03:07.673126 28059 pending_rounds.cc:77] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403203170426880 op_type: NO_OP noop_request { }
I20260928 20:03:07.673472 28059 raft_consensus.cc:2889] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260928 20:03:07.673794 28059 raft_consensus.cc:2272] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:07.675979 28059 ts_tablet_manager.cc:1962] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:03:07.677950 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e1d6dcd913394d4ca2e4b9f5be5ea069 consensus state has no leader
I20260928 20:03:07.679368 26913 tablet_bootstrap.cc:492] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:07.679772 26913 ts_tablet_manager.cc:1449] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.000s
I20260928 20:03:07.681843 28645 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.682305 28645 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.687081 28628 raft_consensus.cc:493] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.687575 28628 raft_consensus.cc:515] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.689630 28628 leader_election.cc:290] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:07.692482 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:07.693938 26594 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:07.694703 26740 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c
W20260928 20:03:07.649107 26450 leader_election.cc:343] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.681326 28644 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.698617 28644 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.700773 28644 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.701318 28645 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:07.701361 26450 leader_election.cc:304] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.702185 28644 raft_consensus.cc:2749] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:07.703261 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 54167.5us
W20260928 20:03:07.704084 26450 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.682040 26913 raft_consensus.cc:359] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.718824 26913 raft_consensus.cc:385] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.719123 26913 raft_consensus.cc:740] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.719816 26913 consensus_queue.cc:260] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.722453 26913 ts_tablet_manager.cc:1480] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.042s user 0.008s sys 0.000s
I20260928 20:03:07.723388 26913 tablet_bootstrap.cc:492] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:07.724128 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2d13d16d9946c6b09f9197c165033c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.724949 26659 raft_consensus.cc:2468] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:07.726393 26654 raft_consensus.cc:1275] T ee8db8da5c3a42679d26c22396938fd2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260928 20:03:07.744947 26450 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.745752 28644 raft_consensus.cc:2749] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:07.766492 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 62425.7us
W20260928 20:03:07.767411 26450 leader_election.cc:343] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.767905 26450 leader_election.cc:304] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.768724 28644 raft_consensus.cc:2749] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:07.769869 28648 log.cc:927] Time spent T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
W20260928 20:03:07.777275 26450 leader_election.cc:343] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.793056 26912 tablet_bootstrap.cc:492] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:07.800285 26912 tablet_bootstrap.cc:654] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.779588 26916 tablet_bootstrap.cc:492] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:07.810576 26450 leader_election.cc:304] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:07.818069 26913 tablet_bootstrap.cc:654] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.825527 26739 leader_election.cc:304] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:07.826412 28557 raft_consensus.cc:2804] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:07.826777 28557 raft_consensus.cc:493] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:07.827142 28557 raft_consensus.cc:3060] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.827068 28624 consensus_queue.cc:1048] T ee8db8da5c3a42679d26c22396938fd2 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260928 20:03:07.839645 28030 ts_tablet_manager.cc:1975] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:03:07.840121 28030 log.cc:1199] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/0de800a9344d4507b7903d08fcf8e988
I20260928 20:03:07.840920 28030 ts_tablet_manager.cc:1996] T 0de800a9344d4507b7903d08fcf8e988 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:07.855649 28644 raft_consensus.cc:2749] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:07.856758 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 79547.3us
I20260928 20:03:07.859069 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.860009 26913 tablet_bootstrap.cc:492] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:07.860424 26913 ts_tablet_manager.cc:1449] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.137s user 0.006s sys 0.004s
I20260928 20:03:07.863304 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.864861 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.865944 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:07.867365 26913 raft_consensus.cc:359] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.867558 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.868050 26913 raft_consensus.cc:385] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:07.868331 26913 raft_consensus.cc:740] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:07.868994 26913 consensus_queue.cc:260] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.878790 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:07.837461 28557 raft_consensus.cc:515] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.887856 26916 tablet_bootstrap.cc:654] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:07.892046 26913 ts_tablet_manager.cc:1480] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
W20260928 20:03:07.893033 26740 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c
I20260928 20:03:07.899307 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2d13d16d9946c6b09f9197c165033c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:07.899818 26659 raft_consensus.cc:3060] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:07.911096 26659 raft_consensus.cc:2468] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:03:07.912618 26700 debug-util.cc:398] Leaking SignalData structure 0x7b080015ea80 after lost signal to thread 26571
W20260928 20:03:07.913770 26700 debug-util.cc:398] Leaking SignalData structure 0x7b08001637c0 after lost signal to thread 26703
I20260928 20:03:07.920044 28566 consensus_queue.cc:1048] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:07.925141 28644 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:07.926048 28644 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:07.928587 28644 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:07.929538 28557 leader_election.cc:290] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:07.932294 26740 consensus_peers.cc:597] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b667a45712c1449384e1a288f55fd062. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:07.960429 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 427) took 10910 ms. Trace:
I20260928 20:03:07.960984 28030 rpcz_store.cc:276] 0928 20:02:57.049806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.049914 (+ 108us) service_pool.cc:224] Handling call
0928 20:03:07.251644 (+10201730us) ts_tablet_manager.cc:1197] Deleting tablet 0de800a9344d4507b7903d08fcf8e988
0928 20:03:07.293375 (+ 41731us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.403448 (+110073us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.839527 (+436079us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.960366 (+120839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4975,"spinlock_wait_cycles":15616,"tablet-delete.queue_time_us":10167066}
I20260928 20:03:07.962604 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 423) took 10919 ms. Trace:
W20260928 20:03:07.973877 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 50069.2us
I20260928 20:03:07.977072 28059 ts_tablet_manager.cc:1975] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:07.977442 28059 log.cc:1199] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/ad0cbde5f5dc4ff6a046b16b1e2b9786
W20260928 20:03:07.978549 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:07.984576 26450 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:07.987602 26450 leader_election.cc:343] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:07.999244 26913 tablet_bootstrap.cc:492] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:08.006290 26913 tablet_bootstrap.cc:654] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.006984 28059 ts_tablet_manager.cc:1996] T ad0cbde5f5dc4ff6a046b16b1e2b9786 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:08.012082 26916 tablet_bootstrap.cc:492] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:08.012562 26916 ts_tablet_manager.cc:1449] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.233s user 0.012s sys 0.000s
I20260928 20:03:07.975526 26739 leader_election.cc:304] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:08.021298 28030 rpcz_store.cc:276] 0928 20:02:57.043674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.276704 (+233030us) service_pool.cc:224] Handling call
0928 20:03:07.962202 (+10685498us) ts_tablet_manager.cc:1197] Deleting tablet e868e5a3ebd2494ca20e1e08a146850e
0928 20:03:07.962258 (+ 56us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.962540 (+ 282us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10684739}
W20260928 20:03:08.021684 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46248.6us
I20260928 20:03:08.022219 28557 raft_consensus.cc:2804] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:08.026077 28557 raft_consensus.cc:697] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:08.026917 28557 consensus_queue.cc:237] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:08.028836 28658 log.cc:927] Time spent T 16796100116a4fe4a64893f49fb1cad4 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260928 20:03:08.036029 26912 tablet_bootstrap.cc:492] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:08.043131 26912 ts_tablet_manager.cc:1449] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.250s user 0.013s sys 0.000s
I20260928 20:03:08.063447 26912 raft_consensus.cc:359] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.064834 26912 raft_consensus.cc:385] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.066092 26916 raft_consensus.cc:359] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.065834 26912 raft_consensus.cc:740] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.066738 26916 raft_consensus.cc:385] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.067013 26916 raft_consensus.cc:740] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.067646 26916 consensus_queue.cc:260] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.072034 26913 tablet_bootstrap.cc:492] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:08.072471 26913 ts_tablet_manager.cc:1449] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.005s
I20260928 20:03:08.068668 26912 consensus_queue.cc:260] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.056757 28059 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53864 (request call id 498) took 7349 ms. Trace:
I20260928 20:03:08.088143 26912 ts_tablet_manager.cc:1480] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.045s user 0.003s sys 0.004s
I20260928 20:03:08.075762 26913 raft_consensus.cc:359] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.094722 26913 raft_consensus.cc:385] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.095048 26913 raft_consensus.cc:740] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.130585 26913 consensus_queue.cc:260] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.136200 28557 consensus_queue.cc:1048] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:08.132881 26913 ts_tablet_manager.cc:1480] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.060s user 0.005s sys 0.000s
I20260928 20:03:08.152441 26913 tablet_bootstrap.cc:492] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:08.170323 26913 tablet_bootstrap.cc:654] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.085423 28059 rpcz_store.cc:276] 0928 20:03:00.705909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:01.638496 (+932587us) service_pool.cc:224] Handling call
0928 20:03:07.639865 (+6001369us) ts_tablet_manager.cc:1197] Deleting tablet ad0cbde5f5dc4ff6a046b16b1e2b9786
0928 20:03:07.641805 (+ 1940us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:07.737220 (+ 95415us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:07.976948 (+239728us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:08.055161 (+ 78213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28913,"tablet-delete.queue_time_us":6000737}
I20260928 20:03:08.210749 26913 tablet_bootstrap.cc:492] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:08.211202 26913 ts_tablet_manager.cc:1449] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.004s
I20260928 20:03:08.214622 26913 raft_consensus.cc:359] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.215338 26913 raft_consensus.cc:385] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.216138 26913 raft_consensus.cc:740] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.216825 26913 consensus_queue.cc:260] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.243738 26913 ts_tablet_manager.cc:1480] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260928 20:03:08.249286 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 435) took 10887 ms. Trace:
I20260928 20:03:08.249629 28030 rpcz_store.cc:276] 0928 20:02:57.362217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.377459 (+ 15242us) service_pool.cc:224] Handling call
0928 20:03:08.057759 (+10680300us) ts_tablet_manager.cc:1197] Deleting tablet fe680423497941578a5dfff2507e3334
0928 20:03:08.248903 (+191144us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.249228 (+ 325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10354431}
I20260928 20:03:08.250677 28030 tablet_replica.cc:333] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:08.251430 28030 raft_consensus.cc:2243] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:08.252252 28030 raft_consensus.cc:2272] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:08.253321 26912 tablet_bootstrap.cc:492] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:08.261319 26913 tablet_bootstrap.cc:492] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:08.273435 26912 tablet_bootstrap.cc:654] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.278746 26916 ts_tablet_manager.cc:1480] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.266s user 0.005s sys 0.001s
I20260928 20:03:08.281664 26916 tablet_bootstrap.cc:492] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:08.287842 28644 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.288885 28644 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.294467 28573 raft_consensus.cc:493] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.295368 28573 raft_consensus.cc:515] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.302819 26913 tablet_bootstrap.cc:654] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.318060 28644 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.318250 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.319339 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.333743 28573 leader_election.cc:290] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.275518 28030 ts_tablet_manager.cc:1962] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:08.343019 28618 consensus_queue.cc:1048] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:08.343247 28624 consensus_queue.cc:1048] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:08.346644 28557 consensus_queue.cc:1048] T 647a383938f947108890ae2042e3edc3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:08.348991 28645 raft_consensus.cc:493] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.349506 28645 raft_consensus.cc:515] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.351621 28573 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.352159 28573 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.353085 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:08.354765 26594 leader_election.cc:343] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.356215 28645 leader_election.cc:290] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:08.357800 28573 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.368149 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:08.368299 26450 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.368762 26450 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.369684 28573 raft_consensus.cc:493] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.370401 28613 raft_consensus.cc:2749] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:08.386914 28573 raft_consensus.cc:515] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.370783 28644 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.391304 26912 tablet_bootstrap.cc:492] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:08.391785 26912 ts_tablet_manager.cc:1449] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.139s user 0.010s sys 0.000s
I20260928 20:03:08.391927 26913 tablet_bootstrap.cc:492] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:08.392364 26913 ts_tablet_manager.cc:1449] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.131s user 0.009s sys 0.000s
I20260928 20:03:08.398962 26913 raft_consensus.cc:359] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.399636 26913 raft_consensus.cc:385] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.399917 26913 raft_consensus.cc:740] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.400569 26913 consensus_queue.cc:260] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.410841 28644 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.411525 26916 tablet_bootstrap.cc:654] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:08.414131 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 88489.3us
W20260928 20:03:08.417054 26595 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:08.417637 26595 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.418579 28566 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:08.425766 26913 ts_tablet_manager.cc:1480] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20260928 20:03:08.426725 26913 tablet_bootstrap.cc:492] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:08.427428 26912 raft_consensus.cc:359] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.428267 26912 raft_consensus.cc:385] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.428568 26912 raft_consensus.cc:740] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.429245 26912 consensus_queue.cc:260] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.431478 26912 ts_tablet_manager.cc:1480] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20260928 20:03:08.437460 28644 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.450784 28669 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.451272 28669 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.453037 26654 raft_consensus.cc:3060] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.460693 26913 tablet_bootstrap.cc:654] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.483419 28573 leader_election.cc:290] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:08.488238 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 120100us
I20260928 20:03:08.496033 28669 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:08.489363 26450 leader_election.cc:343] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.498580 26450 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:08.499796 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.500342 26450 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.501291 28674 raft_consensus.cc:2749] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:08.436489 28557 raft_consensus.cc:493] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.510087 28557 raft_consensus.cc:515] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.512153 28557 leader_election.cc:290] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:08.445230 28627 consensus_queue.cc:1048] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:08.469760 28579 consensus_queue.cc:1048] T d479a8eabc624569968515684e8acb0c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:08.478128 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:08.516939 26594 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.519016 26912 tablet_bootstrap.cc:492] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:08.526582 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:08.493381 28030 ts_tablet_manager.cc:1975] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:08.527621 28030 log.cc:1199] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/7242f71b93914dbeadb60617b3f2be3b
I20260928 20:03:08.530668 26912 tablet_bootstrap.cc:654] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.527366 26506 raft_consensus.cc:2468] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:08.557989 28645 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.558508 28645 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:08.562602 28645 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.564296 28573 raft_consensus.cc:2749] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:08.564728 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 63979.2us
W20260928 20:03:08.582319 26450 leader_election.cc:343] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.538555 26740 leader_election.cc:304] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:08.587183 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48712.9us
I20260928 20:03:08.542729 28030 ts_tablet_manager.cc:1996] T 7242f71b93914dbeadb60617b3f2be3b P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:08.589866 28627 raft_consensus.cc:2804] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:08.590207 28627 raft_consensus.cc:493] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:08.590508 28627 raft_consensus.cc:3060] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.564137 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.603209 28627 raft_consensus.cc:515] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.607085 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:08.607620 26655 raft_consensus.cc:3060] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.608502 28627 leader_election.cc:290] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:08.610412 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:08.610922 26506 raft_consensus.cc:3060] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.622054 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.622735 26506 raft_consensus.cc:2468] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:08.623772 26740 leader_election.cc:304] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:08.623859 26655 raft_consensus.cc:2468] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:08.624738 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.626791 28579 raft_consensus.cc:2804] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:08.628546 28579 raft_consensus.cc:697] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:08.629463 28579 consensus_queue.cc:237] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.634922 26916 tablet_bootstrap.cc:492] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:08.635418 26916 ts_tablet_manager.cc:1449] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.354s user 0.010s sys 0.007s
W20260928 20:03:08.642385 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 59095.7us
I20260928 20:03:08.570036 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d6dcd913394d4ca2e4b9f5be5ea069" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.653294 26654 raft_consensus.cc:2376] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1. Re-sending same reply.
I20260928 20:03:08.653439 28623 consensus_queue.cc:1048] T 16796100116a4fe4a64893f49fb1cad4 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 20:03:08.668136 28674 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.671386 28674 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.678632 28674 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.691021 26912 tablet_bootstrap.cc:492] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:08.697374 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.698485 26916 raft_consensus.cc:359] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.699189 26916 raft_consensus.cc:385] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.699451 26916 raft_consensus.cc:740] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.702593 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.703395 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.705683 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:08.706481 26506 raft_consensus.cc:2468] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:08.711058 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.713240 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.714725 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:08.716140 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.740s (SENT)
W20260928 20:03:08.716686 26740 consensus_peers.cc:597] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:08.716588 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:08.717657 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.720979 28688 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 20:03:08.721473 26912 ts_tablet_manager.cc:1449] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.203s user 0.010s sys 0.000s
I20260928 20:03:08.730849 28674 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.731436 28674 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.733647 28674 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:08.739595 26913 tablet_bootstrap.cc:492] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:08.739989 26913 ts_tablet_manager.cc:1449] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.313s user 0.011s sys 0.010s
I20260928 20:03:08.745781 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 440) took 10877 ms. Trace:
I20260928 20:03:08.746120 28030 rpcz_store.cc:276] 0928 20:02:57.868705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.868811 (+ 106us) service_pool.cc:224] Handling call
0928 20:03:08.250526 (+10381715us) ts_tablet_manager.cc:1197] Deleting tablet 7242f71b93914dbeadb60617b3f2be3b
0928 20:03:08.250580 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.433042 (+182462us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:08.493262 (+ 60220us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:08.745708 (+252446us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10381196}
I20260928 20:03:08.747354 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 446) took 10835 ms. Trace:
I20260928 20:03:08.747624 28030 rpcz_store.cc:276] 0928 20:02:57.911885 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:57.918616 (+ 6731us) service_pool.cc:224] Handling call
0928 20:03:08.747010 (+10828394us) ts_tablet_manager.cc:1197] Deleting tablet 46c39c6915964116ac14ea2781c7a52b
0928 20:03:08.747057 (+ 47us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.747308 (+ 251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10827726}
I20260928 20:03:08.748683 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 448) took 10755 ms. Trace:
I20260928 20:03:08.748950 28030 rpcz_store.cc:276] 0928 20:02:57.992842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:58.167777 (+174935us) service_pool.cc:224] Handling call
0928 20:03:08.748355 (+10580578us) ts_tablet_manager.cc:1197] Deleting tablet 91b11022fc774d18b92e0c694f834375
0928 20:03:08.748402 (+ 47us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.748639 (+ 237us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10525280}
I20260928 20:03:08.749832 28030 tablet_replica.cc:333] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:08.753788 28030 raft_consensus.cc:2243] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:08.754968 28030 raft_consensus.cc:2272] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:08.759078 28030 ts_tablet_manager.cc:1962] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:08.700079 26916 consensus_queue.cc:260] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.764300 26916 ts_tablet_manager.cc:1480] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.129s user 0.003s sys 0.002s
I20260928 20:03:08.771723 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:08.778195 26912 raft_consensus.cc:359] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.779531 26912 raft_consensus.cc:385] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.779873 26912 raft_consensus.cc:740] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.780745 28686 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.780895 26912 consensus_queue.cc:260] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.781184 28686 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.783685 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.784066 28686 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:08.784607 26912 ts_tablet_manager.cc:1480] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
W20260928 20:03:08.784802 26594 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.786525 26913 raft_consensus.cc:359] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.787194 26913 raft_consensus.cc:385] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.787459 26913 raft_consensus.cc:740] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.788077 26913 consensus_queue.cc:260] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:08.799340 26450 leader_election.cc:343] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.801520 26450 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.807374 28674 raft_consensus.cc:2749] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:08.817116 26450 leader_election.cc:343] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:08.817878 26450 leader_election.cc:343] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.835438 28579 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.836011 28579 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.838908 28579 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:08.839742 26740 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:08.841590 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.842185 26646 raft_consensus.cc:2468] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:08.843809 26739 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:08.845309 28628 raft_consensus.cc:2804] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:08.845634 28628 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:08.845940 28628 raft_consensus.cc:3060] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.846654 26912 tablet_bootstrap.cc:492] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:08.852300 26912 tablet_bootstrap.cc:654] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.857359 28628 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.871476 26913 ts_tablet_manager.cc:1480] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.131s user 0.009s sys 0.002s
I20260928 20:03:08.880793 28030 ts_tablet_manager.cc:1975] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260928 20:03:08.881243 28030 log.cc:1199] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/2d9ca77e114c4d06bde1bcd862c8eccf
I20260928 20:03:08.883438 28030 ts_tablet_manager.cc:1996] T 2d9ca77e114c4d06bde1bcd862c8eccf P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:03:08.818518 26450 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:08.895334 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 76833.7us
W20260928 20:03:08.895996 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:08.896651 26450 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:08.898206 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.904738 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d262c7a15b434d8caea0a818323dd1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:08.905440 26646 raft_consensus.cc:3060] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.907586 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 471) took 10568 ms. Trace:
I20260928 20:03:08.907966 28628 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:08.909833 26740 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:08.910730 28686 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:08.910524 28030 rpcz_store.cc:276] 0928 20:02:58.339496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.368845 (+1029349us) service_pool.cc:224] Handling call
0928 20:03:08.749678 (+9380833us) ts_tablet_manager.cc:1197] Deleting tablet 2d9ca77e114c4d06bde1bcd862c8eccf
0928 20:03:08.749724 (+ 46us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.820673 (+ 70949us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:08.880641 (+ 59968us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:08.907525 (+ 26884us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9380343}
I20260928 20:03:08.911226 28686 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.913195 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 472) took 10573 ms. Trace:
I20260928 20:03:08.913507 28030 rpcz_store.cc:276] 0928 20:02:58.339753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.369375 (+1029622us) service_pool.cc:224] Handling call
0928 20:03:08.912786 (+9543411us) ts_tablet_manager.cc:1197] Deleting tablet 3657e36a6d2844c28852db1a4f2ed191
0928 20:03:08.912838 (+ 52us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.913134 (+ 296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9542968}
W20260928 20:03:08.915369 26594 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:08.915966 28686 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:08.920042 26646 raft_consensus.cc:2468] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:08.921998 26739 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:08.922758 28579 raft_consensus.cc:2804] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:08.923388 28579 raft_consensus.cc:697] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:08.924463 28579 consensus_queue.cc:237] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.934278 26912 tablet_bootstrap.cc:492] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:08.934656 26912 ts_tablet_manager.cc:1449] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.088s user 0.010s sys 0.005s
I20260928 20:03:08.937897 26916 tablet_bootstrap.cc:492] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:08.940775 26912 raft_consensus.cc:359] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.941401 26912 raft_consensus.cc:385] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:08.941675 26912 raft_consensus.cc:740] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:08.942360 26912 consensus_queue.cc:260] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:08.944321 26912 ts_tablet_manager.cc:1480] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260928 20:03:08.945160 26912 tablet_bootstrap.cc:492] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:08.945916 26916 tablet_bootstrap.cc:654] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:08.946823 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 475) took 10404 ms. Trace:
I20260928 20:03:08.947192 28030 rpcz_store.cc:276] 0928 20:02:58.542631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.434188 (+891557us) service_pool.cc:224] Handling call
0928 20:03:08.946386 (+9512198us) ts_tablet_manager.cc:1197] Deleting tablet 7775ad91c86840c49a902b059a0ff74d
0928 20:03:08.946460 (+ 74us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.946767 (+ 307us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9457511}
I20260928 20:03:08.959257 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 479) took 10415 ms. Trace:
I20260928 20:03:08.959594 28030 rpcz_store.cc:276] 0928 20:02:58.543711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.561771 (+1018060us) service_pool.cc:224] Handling call
0928 20:03:08.958896 (+9397125us) ts_tablet_manager.cc:1197] Deleting tablet 6a31001f85b44bfcb35a29675f177b9e
0928 20:03:08.958956 (+ 60us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:08.959203 (+ 247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9396555}
W20260928 20:03:08.963331 26740 consensus_peers.cc:597] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:08.969200 28030 tablet_replica.cc:333] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:08.970404 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:08.972636 26595 leader_election.cc:304] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.973315 28686 raft_consensus.cc:2804] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:08.973678 28686 raft_consensus.cc:493] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:08.974174 28686 raft_consensus.cc:3060] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:08.975085 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:08.976527 26595 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a
I20260928 20:03:08.976908 26595 leader_election.cc:304] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.977552 28566 raft_consensus.cc:2749] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:08.979211 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:08.994199 26595 leader_election.cc:304] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:08.995231 28566 raft_consensus.cc:2749] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:09.006234 26912 tablet_bootstrap.cc:654] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.008888 28686 raft_consensus.cc:515] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.010993 28686 leader_election.cc:290] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:09.012473 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:09.013025 26797 raft_consensus.cc:3060] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:09.018270 28566 raft_consensus.cc:493] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.018882 28566 raft_consensus.cc:515] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.021798 28566 leader_election.cc:290] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:09.022002 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:09.022687 26790 raft_consensus.cc:2468] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:09.023725 26594 leader_election.cc:304] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:09.027917 28566 raft_consensus.cc:2804] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:09.028399 28566 raft_consensus.cc:493] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:09.028796 28566 raft_consensus.cc:3060] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:09.052349 26595 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:09.053150 26595 leader_election.cc:304] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.054222 28686 raft_consensus.cc:2749] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.059687 28030 raft_consensus.cc:2243] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:09.061643 28674 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.062177 28674 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.064324 28674 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:09.065053 26450 leader_election.cc:343] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.065434 26450 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.066037 28674 raft_consensus.cc:2749] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.066568 28030 pending_rounds.cc:70] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Trying to abort 1 pending ops.
I20260928 20:03:09.066784 28030 pending_rounds.cc:77] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334403231444910080 op_type: NO_OP noop_request { }
I20260928 20:03:09.067107 28030 raft_consensus.cc:2889] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260928 20:03:09.067097 26450 leader_election.cc:343] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.067404 28030 raft_consensus.cc:2272] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:09.067409 26450 leader_election.cc:304] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.069939 26913 tablet_bootstrap.cc:492] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:09.069840 26797 raft_consensus.cc:2468] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:09.070796 26594 leader_election.cc:304] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:09.071873 28686 raft_consensus.cc:2804] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:09.072503 28686 raft_consensus.cc:697] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:09.073225 28686 consensus_queue.cc:237] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.077356 26913 tablet_bootstrap.cc:654] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.083156 26916 tablet_bootstrap.cc:492] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:09.083693 26916 ts_tablet_manager.cc:1449] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.146s user 0.010s sys 0.001s
I20260928 20:03:09.108345 28674 raft_consensus.cc:2749] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:09.110733 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.111217 26450 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.112241 28674 raft_consensus.cc:2749] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.120903 26916 raft_consensus.cc:359] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:09.133843 26916 raft_consensus.cc:385] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.134167 26916 raft_consensus.cc:740] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.134764 26916 consensus_queue.cc:260] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:09.137279 26916 ts_tablet_manager.cc:1480] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.053s user 0.003s sys 0.000s
I20260928 20:03:09.139277 26912 tablet_bootstrap.cc:492] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:09.139722 26912 ts_tablet_manager.cc:1449] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.195s user 0.019s sys 0.021s
W20260928 20:03:09.142287 26450 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.142686 26450 leader_election.cc:304] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:09.143587 26450 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.143894 26450 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.145748 28696 raft_consensus.cc:2749] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.146397 28696 raft_consensus.cc:2749] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.150990 28566 raft_consensus.cc:515] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.153987 28030 ts_tablet_manager.cc:1962] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:09.164513 28628 consensus_queue.cc:1048] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:09.164575 26912 raft_consensus.cc:359] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.165846 26912 raft_consensus.cc:385] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.168256 26912 raft_consensus.cc:740] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.169149 26912 consensus_queue.cc:260] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.172672 26912 ts_tablet_manager.cc:1480] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260928 20:03:09.180563 26913 tablet_bootstrap.cc:492] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:09.180998 26913 ts_tablet_manager.cc:1449] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.111s user 0.010s sys 0.001s
I20260928 20:03:09.187772 26913 raft_consensus.cc:359] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:09.188393 26913 raft_consensus.cc:385] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.188632 26913 raft_consensus.cc:740] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.189196 26913 consensus_queue.cc:260] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:09.202958 26912 tablet_bootstrap.cc:492] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:09.215562 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 71989.3us
W20260928 20:03:09.216251 26450 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:09.216799 26450 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.227707 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:09.228469 26507 raft_consensus.cc:3060] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:09.237593 26507 raft_consensus.cc:2468] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:09.242727 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f478cce587a548e1aab620721c3bb1c1 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f478cce587a548e1aab620721c3bb1c1 consensus state has no leader
I20260928 20:03:09.245414 28030 ts_tablet_manager.cc:1975] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:09.245807 28030 log.cc:1199] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:09.246773 28566 leader_election.cc:290] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:09.249432 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:09.250051 26797 raft_consensus.cc:3060] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:09.261858 26797 raft_consensus.cc:2468] T a8b15d2c55d94e64b75da8089a68b6e1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:09.276990 26594 leader_election.cc:304] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:09.277842 28623 raft_consensus.cc:2804] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:09.278450 28623 raft_consensus.cc:697] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:09.279400 28702 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:09.279309 28623 consensus_queue.cc:237] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.280007 28702 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:09.287930 28698 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.288458 28698 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.289705 26913 ts_tablet_manager.cc:1480] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.108s user 0.007s sys 0.004s
I20260928 20:03:09.290761 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:09.291329 26506 raft_consensus.cc:2468] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:09.292299 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:09.292770 26504 raft_consensus.cc:3060] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:09.300313 28698 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:09.306964 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:09.308226 26504 raft_consensus.cc:2468] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:09.308470 28030 ts_tablet_manager.cc:1996] T 23d262c7a15b434d8caea0a818323dd1 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:09.319597 28702 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:09.319736 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:09.322814 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:09.325387 26913 tablet_bootstrap.cc:492] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:09.333809 26595 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:09.334245 26595 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.335219 28686 raft_consensus.cc:2749] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.343948 26912 tablet_bootstrap.cc:654] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.348295 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 486) took 10802 ms. Trace:
I20260928 20:03:09.361821 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:09.385757 28698 raft_consensus.cc:493] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.386291 28698 raft_consensus.cc:515] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:09.386968 26450 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.387410 26450 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.388276 28674 raft_consensus.cc:2749] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.388798 28698 leader_election.cc:290] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:09.400405 26916 tablet_bootstrap.cc:492] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:09.402400 26912 tablet_bootstrap.cc:492] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:09.402840 26912 ts_tablet_manager.cc:1449] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.200s user 0.015s sys 0.000s
I20260928 20:03:09.406704 26916 tablet_bootstrap.cc:654] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.349792 28030 rpcz_store.cc:276] 0928 20:02:58.545385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.622525 (+1077140us) service_pool.cc:224] Handling call
0928 20:03:08.969029 (+9346504us) ts_tablet_manager.cc:1197] Deleting tablet 23d262c7a15b434d8caea0a818323dd1
0928 20:03:08.969092 (+ 63us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.061347 (+ 92255us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b5400063954. stack: 00007f0cf9836373 00007f0cf9836270 00007f0cf93d9574 0000000000516a24 00000000005169b9 00007f0d00935b01 00007f0d009d4bf2 00007f0d00e16c7c 00007f0d01a8206a 00007f0d01ab4080 00007f0d01a9a4ad 00007f0d01a9a459 00007f0d01a9a3e9 00007f0d01a9a3b1 00007f0d01a995dd 00000000005bd5a4
0928 20:03:09.161746 (+100399us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:09.245287 (+ 83541us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:09.348138 (+102851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206145280,"tablet-delete.queue_time_us":9293803}
I20260928 20:03:09.471215 26916 tablet_bootstrap.cc:492] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:09.471812 26916 ts_tablet_manager.cc:1449] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.072s user 0.011s sys 0.000s
W20260928 20:03:09.429318 26450 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.474553 26450 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.475765 28698 raft_consensus.cc:2749] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.482314 26912 raft_consensus.cc:359] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.482954 26912 raft_consensus.cc:385] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.483196 26912 raft_consensus.cc:740] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.483788 26912 consensus_queue.cc:260] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.485249 26912 ts_tablet_manager.cc:1480] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.082s user 0.004s sys 0.000s
I20260928 20:03:09.394040 26913 tablet_bootstrap.cc:654] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.490863 26916 raft_consensus.cc:359] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.498766 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 487) took 10953 ms. Trace:
I20260928 20:03:09.499096 28030 rpcz_store.cc:276] 0928 20:02:58.545725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.646405 (+1100680us) service_pool.cc:224] Handling call
0928 20:03:09.440121 (+9793716us) ts_tablet_manager.cc:1197] Deleting tablet de40520ccd9b4a52a45c4085afd45b2d
0928 20:03:09.498427 (+ 58306us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.498711 (+ 284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9758102}
I20260928 20:03:09.508332 28718 tablet.cc:1751] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:09.498471 26916 raft_consensus.cc:385] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.513923 26916 raft_consensus.cc:740] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:09.502949 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 74113.3us
W20260928 20:03:09.515213 26450 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:09.517549 26450 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.519037 26916 consensus_queue.cc:260] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.524471 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 495) took 10716 ms. Trace:
I20260928 20:03:09.524816 28030 rpcz_store.cc:276] 0928 20:02:58.808258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.685494 (+877236us) service_pool.cc:224] Handling call
0928 20:03:09.499935 (+9814441us) ts_tablet_manager.cc:1197] Deleting tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
0928 20:03:09.524078 (+ 24143us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.524411 (+ 333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9607204}
I20260928 20:03:09.524845 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:09.526027 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 497) took 10717 ms. Trace:
I20260928 20:03:09.530519 28030 rpcz_store.cc:276] 0928 20:02:58.808831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:59.892947 (+1084116us) service_pool.cc:224] Handling call
0928 20:03:09.525655 (+9632708us) ts_tablet_manager.cc:1197] Deleting tablet 292eef7bab904a7ea5ef6dbdaba1d37d
0928 20:03:09.525702 (+ 47us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.525975 (+ 273us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9546422}
I20260928 20:03:09.532135 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 498) took 9953 ms. Trace:
I20260928 20:03:09.532460 28030 rpcz_store.cc:276] 0928 20:02:59.579286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.010865 (+431579us) service_pool.cc:224] Handling call
0928 20:03:09.531660 (+9520795us) ts_tablet_manager.cc:1197] Deleting tablet fa49943f465f47778ac985cb5f4e6c0f
0928 20:03:09.531739 (+ 79us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.532074 (+ 335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9520170}
I20260928 20:03:09.534580 26916 ts_tablet_manager.cc:1480] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.062s user 0.006s sys 0.001s
W20260928 20:03:09.550444 26450 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.550863 26450 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.551612 28698 raft_consensus.cc:2749] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.552578 28623 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.553056 28623 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.557377 28623 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:09.552618 26913 tablet_bootstrap.cc:492] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:09.559500 26913 ts_tablet_manager.cc:1449] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.235s user 0.011s sys 0.000s
W20260928 20:03:09.563189 26450 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.577834 26913 raft_consensus.cc:359] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.578540 26913 raft_consensus.cc:385] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.578804 26913 raft_consensus.cc:740] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.579404 26913 consensus_queue.cc:260] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:09.580864 26595 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:09.581197 28715 tablet.cc:1751] T bba200d6ef33438187dd643fe3ded009 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:03:09.590066 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 93824.8us
I20260928 20:03:09.593245 26913 ts_tablet_manager.cc:1480] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20260928 20:03:09.597433 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:09.597613 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:09.601101 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:09.604563 26450 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.604931 26450 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.605580 28698 raft_consensus.cc:2749] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.607337 26913 tablet_bootstrap.cc:492] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:09.609853 26450 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.608043 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 503) took 9869 ms. Trace:
I20260928 20:03:09.610333 26450 leader_election.cc:304] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.613036 28698 raft_consensus.cc:2749] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.630431 26912 tablet_bootstrap.cc:492] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:09.635586 26916 tablet_bootstrap.cc:492] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:09.610912 28030 rpcz_store.cc:276] 0928 20:02:59.664859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.100585 (+435726us) service_pool.cc:224] Handling call
0928 20:03:09.533476 (+9432891us) ts_tablet_manager.cc:1197] Deleting tablet 62114712f2c040e6b1ae831911d68896
0928 20:03:09.533527 (+ 51us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.534044 (+ 517us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9432339}
I20260928 20:03:09.641440 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 506) took 9963 ms. Trace:
W20260928 20:03:09.643939 26594 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.644352 26594 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.650270 28623 raft_consensus.cc:2749] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.643432 28030 rpcz_store.cc:276] 0928 20:02:59.674679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:00.262079 (+587400us) service_pool.cc:224] Handling call
0928 20:03:09.637841 (+9375762us) ts_tablet_manager.cc:1197] Deleting tablet ed48087b59c744f9a928c8d529b69211
0928 20:03:09.637914 (+ 73us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.638233 (+ 319us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9374522}
I20260928 20:03:09.663081 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 518) took 5535 ms. Trace:
I20260928 20:03:09.663395 28030 rpcz_store.cc:276] 0928 20:03:04.127565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:04.141054 (+ 13489us) service_pool.cc:224] Handling call
0928 20:03:09.656806 (+5515752us) ts_tablet_manager.cc:1197] Deleting tablet 775b9a076bf048bea39423d3554babf7
0928 20:03:09.657075 (+ 269us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.661608 (+ 4533us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5474014}
I20260928 20:03:09.668442 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 519) took 5525 ms. Trace:
I20260928 20:03:09.673784 26913 tablet_bootstrap.cc:654] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.670064 28030 rpcz_store.cc:276] 0928 20:03:04.143338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:04.163609 (+ 20271us) service_pool.cc:224] Handling call
0928 20:03:09.664101 (+5500492us) ts_tablet_manager.cc:1197] Deleting tablet 80d7ab92a37c4f9b865fa9fe49d46916
0928 20:03:09.667012 (+ 2911us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.668272 (+ 1260us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5481514}
I20260928 20:03:09.686508 28579 consensus_queue.cc:1048] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:09.690560 26916 tablet_bootstrap.cc:654] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.695303 26912 tablet_bootstrap.cc:654] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:09.718006 28030 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41770 (request call id 521) took 5538 ms. Trace:
I20260928 20:03:09.718403 28030 rpcz_store.cc:276] 0928 20:03:04.182811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:04.182925 (+ 114us) service_pool.cc:224] Handling call
0928 20:03:09.678742 (+5495817us) ts_tablet_manager.cc:1197] Deleting tablet 385278bf2df34f4f960a0cfdebd79be5
0928 20:03:09.717772 (+ 39030us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:09.717948 (+ 176us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5494855}
I20260928 20:03:09.720214 28719 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.720781 28719 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.723839 28719 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:09.724324 28623 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.724818 28623 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.727592 28623 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:09.730122 26594 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:09.730937 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:09.731627 26646 raft_consensus.cc:2468] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:09.732703 28623 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.733246 28623 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:09.736672 26595 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:09.737080 26595 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.737732 28686 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:09.736340 28723 tablet.cc:1751] T bba200d6ef33438187dd643fe3ded009 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:03:09.739143 26595 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375
I20260928 20:03:09.740327 28623 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:09.742269 26739 leader_election.cc:304] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:09.742339 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:09.755951 28579 raft_consensus.cc:2804] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:09.756403 28579 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:09.756822 28579 raft_consensus.cc:3060] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:09.765277 28579 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:09.767132 26594 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.767575 26594 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.769995 28579 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:09.770503 28623 raft_consensus.cc:2749] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.772017 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:09.772562 26648 raft_consensus.cc:3060] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:09.781394 26648 raft_consensus.cc:2468] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:09.796185 26916 tablet_bootstrap.cc:492] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:09.796675 26916 ts_tablet_manager.cc:1449] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.161s user 0.006s sys 0.006s
I20260928 20:03:09.799724 26916 raft_consensus.cc:359] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:09.766193 26740 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a
W20260928 20:03:09.802739 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 51430.7us
I20260928 20:03:09.774456 26912 tablet_bootstrap.cc:492] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:09.809681 26912 ts_tablet_manager.cc:1449] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.179s user 0.011s sys 0.000s
I20260928 20:03:09.812332 26912 raft_consensus.cc:359] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:09.813086 26912 raft_consensus.cc:385] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.813387 26912 raft_consensus.cc:740] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.800355 26916 raft_consensus.cc:385] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.783310 28719 consensus_queue.cc:1048] T e1d6dcd913394d4ca2e4b9f5be5ea069 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:09.829344 26913 tablet_bootstrap.cc:492] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:09.831528 26913 ts_tablet_manager.cc:1449] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.225s user 0.016s sys 0.018s
I20260928 20:03:09.782769 26739 leader_election.cc:304] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:09.835222 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 52533.4us
I20260928 20:03:09.836511 28628 raft_consensus.cc:2804] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:09.837047 28628 raft_consensus.cc:697] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:09.837910 28628 consensus_queue.cc:237] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:09.842011 26740 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a
I20260928 20:03:09.851511 26912 consensus_queue.cc:260] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:09.853082 26916 raft_consensus.cc:740] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.880390 26916 consensus_queue.cc:260] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.878587 26913 raft_consensus.cc:359] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.895191 26913 raft_consensus.cc:385] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:09.896999 26913 raft_consensus.cc:740] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:09.899936 26912 ts_tablet_manager.cc:1480] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.090s user 0.005s sys 0.000s
I20260928 20:03:09.916443 26916 ts_tablet_manager.cc:1480] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.119s user 0.005s sys 0.000s
I20260928 20:03:09.904556 26913 consensus_queue.cc:260] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.949569 28698 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:09.950112 28698 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:09.952509 28698 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:09.953475 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:09.953696 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:09.954835 26450 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:09.956214 26450 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:09.956568 26450 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:09.957226 28698 raft_consensus.cc:2749] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:09.970866 26913 ts_tablet_manager.cc:1480] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.134s user 0.013s sys 0.002s
I20260928 20:03:09.978163 26916 tablet_bootstrap.cc:492] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:09.987893 26913 tablet_bootstrap.cc:492] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:10.003062 28698 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.003552 28698 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.005609 28698 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.006503 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.007706 26450 leader_election.cc:343] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.010998 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:10.012015 26916 tablet_bootstrap.cc:654] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:10.013573 26450 leader_election.cc:343] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.013942 26450 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.014591 28698 raft_consensus.cc:2749] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.015987 28698 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.016434 28698 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.018440 28698 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.019583 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.020768 26450 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.025014 26912 tablet_bootstrap.cc:492] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:10.025560 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:10.027499 26450 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.027954 26450 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.029560 28698 raft_consensus.cc:2749] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.032049 26912 tablet_bootstrap.cc:654] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.068008 26912 tablet_bootstrap.cc:492] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:10.068409 28698 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.068615 26913 tablet_bootstrap.cc:654] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.068881 28698 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.070923 28698 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.071810 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.076359 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.081931 26912 ts_tablet_manager.cc:1449] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.057s user 0.012s sys 0.000s
I20260928 20:03:10.082185 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:10.083657 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.084175 26450 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.084978 28698 raft_consensus.cc:2749] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.087615 26916 tablet_bootstrap.cc:492] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:10.088088 26916 ts_tablet_manager.cc:1449] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.110s user 0.007s sys 0.004s
I20260928 20:03:10.101380 28698 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.101846 28698 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.103969 28698 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.105389 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:10.106087 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:10.106740 26450 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.108831 26916 raft_consensus.cc:359] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.109562 26916 raft_consensus.cc:385] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.095044 26912 raft_consensus.cc:359] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:10.111263 26450 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.111754 26450 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.112650 28698 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.111492 26912 raft_consensus.cc:385] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.114377 26912 raft_consensus.cc:740] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.134337 26912 consensus_queue.cc:260] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.109827 26916 raft_consensus.cc:740] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.137008 26916 consensus_queue.cc:260] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.141508 28579 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.141947 28579 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.144079 28579 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:10.145622 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:10.146314 26646 raft_consensus.cc:2468] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:03:10.147022 26740 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375
I20260928 20:03:10.148031 26739 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:10.150249 28628 raft_consensus.cc:2804] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:10.150600 28628 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:10.150938 28628 raft_consensus.cc:3060] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.167536 26912 ts_tablet_manager.cc:1480] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.085s user 0.005s sys 0.000s
I20260928 20:03:10.168624 26912 tablet_bootstrap.cc:492] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:10.173592 26916 ts_tablet_manager.cc:1480] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.085s user 0.007s sys 0.001s
I20260928 20:03:10.177583 28738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:10.179065 26916 tablet_bootstrap.cc:492] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:10.190266 28686 consensus_queue.cc:1048] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:10.166038 28628 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.214298 28738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:10.217394 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:10.225741 26740 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375
I20260928 20:03:10.226635 28628 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:10.231956 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b11022fc774d18b92e0c694f834375" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:10.232465 26646 raft_consensus.cc:3060] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.234192 28738 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:10.239809 28623 consensus_queue.cc:1048] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:10.256320 28698 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.256860 28698 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.259793 28698 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.260413 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:10.263227 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.263654 26450 leader_election.cc:343] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:10.264506 26450 leader_election.cc:343] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.264876 26450 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.265782 28698 raft_consensus.cc:2749] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.269462 26646 raft_consensus.cc:2468] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:10.272621 26739 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:10.273718 28579 raft_consensus.cc:2804] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:10.274468 28579 raft_consensus.cc:697] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:10.275692 26912 tablet_bootstrap.cc:654] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.275336 28579 consensus_queue.cc:237] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.281508 26913 tablet_bootstrap.cc:492] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:10.282403 26913 ts_tablet_manager.cc:1449] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.298s user 0.014s sys 0.004s
I20260928 20:03:10.282665 28698 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.283190 28698 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:10.289695 26913 raft_consensus.cc:359] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.290416 26913 raft_consensus.cc:385] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.290696 26913 raft_consensus.cc:740] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.303344 28698 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.304502 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:10.304626 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.305894 26450 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:10.307130 26450 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.307469 26450 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.319921 28623 consensus_queue.cc:1048] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:10.321312 28698 raft_consensus.cc:2749] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.291363 26913 consensus_queue.cc:260] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.332784 26913 ts_tablet_manager.cc:1480] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.050s user 0.004s sys 0.003s
I20260928 20:03:10.185108 26916 tablet_bootstrap.cc:654] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.366886 28579 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.367450 28579 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.374792 28623 consensus_queue.cc:1048] T a8b15d2c55d94e64b75da8089a68b6e1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:10.381728 26912 tablet_bootstrap.cc:492] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:10.382177 26912 ts_tablet_manager.cc:1449] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.214s user 0.012s sys 0.000s
I20260928 20:03:10.384666 26912 raft_consensus.cc:359] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.385311 26912 raft_consensus.cc:385] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.385574 26912 raft_consensus.cc:740] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.388731 26913 tablet_bootstrap.cc:492] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:10.393502 26740 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:10.401124 28579 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:10.435784 26916 tablet_bootstrap.cc:492] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:10.439471 28566 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.440112 28566 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.442848 26912 consensus_queue.cc:260] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.444984 26912 ts_tablet_manager.cc:1480] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.063s user 0.004s sys 0.000s
I20260928 20:03:10.445897 26912 tablet_bootstrap.cc:492] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:10.447793 26916 ts_tablet_manager.cc:1449] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.269s user 0.008s sys 0.005s
I20260928 20:03:10.457844 26916 raft_consensus.cc:359] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.458640 26916 raft_consensus.cc:385] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.458936 26916 raft_consensus.cc:740] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.472177 26916 consensus_queue.cc:260] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.473104 26913 tablet_bootstrap.cc:654] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.477113 26916 ts_tablet_manager.cc:1480] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260928 20:03:10.480734 28749 raft_consensus.cc:493] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.481284 28749 raft_consensus.cc:515] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.487169 28749 leader_election.cc:290] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.487325 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.488653 26450 leader_election.cc:343] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.490785 28566 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:10.496091 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 95094.6us
I20260928 20:03:10.503907 28628 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.504560 28628 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.506623 28628 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:10.509006 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:10.530093 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:10.537271 26740 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:10.538548 26916 tablet_bootstrap.cc:492] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:10.539214 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:10.539915 26646 raft_consensus.cc:2468] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:10.544273 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:10.544889 26646 raft_consensus.cc:2468] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:03:10.546775 26594 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:10.551316 26450 leader_election.cc:343] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.551716 26450 leader_election.cc:304] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.552443 28751 raft_consensus.cc:2749] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.551935 26739 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:10.553809 28579 raft_consensus.cc:2804] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:10.554239 28579 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:10.554647 28579 raft_consensus.cc:3060] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.556479 26739 leader_election.cc:304] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:10.558070 26912 tablet_bootstrap.cc:654] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.572549 26913 tablet_bootstrap.cc:492] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:10.573001 26913 ts_tablet_manager.cc:1449] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.184s user 0.007s sys 0.003s
W20260928 20:03:10.574096 26595 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:03:10.574610 26595 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.575626 26913 raft_consensus.cc:359] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.576231 26913 raft_consensus.cc:385] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.576504 26913 raft_consensus.cc:740] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.577111 26913 consensus_queue.cc:260] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.581849 26916 tablet_bootstrap.cc:654] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.586069 28753 raft_consensus.cc:2749] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.588133 28752 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.588678 28752 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.590891 28752 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:10.593863 28628 raft_consensus.cc:2804] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:10.594798 28628 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:10.595197 28628 raft_consensus.cc:3060] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:10.601445 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45040.8us
I20260928 20:03:10.607080 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:10.607731 26507 raft_consensus.cc:2468] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:10.608811 26912 tablet_bootstrap.cc:492] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:10.609239 26912 ts_tablet_manager.cc:1449] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.164s user 0.010s sys 0.000s
I20260928 20:03:10.609105 26595 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:10.613399 28752 raft_consensus.cc:2804] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:10.613914 28752 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:10.614385 28752 raft_consensus.cc:3060] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.619282 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:10.626259 28628 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.575270 28579 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:10.639067 26740 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:10.645349 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa49943f465f47778ac985cb5f4e6c0f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:10.646011 26646 raft_consensus.cc:3060] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.654398 26646 raft_consensus.cc:2468] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:10.654654 28579 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:10.660089 26148 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.674s (SENT)
I20260928 20:03:10.660590 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:03:10.672955 28751 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.673588 28751 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.675915 28751 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.677224 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.679319 26450 leader_election.cc:343] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.682658 26913 ts_tablet_manager.cc:1480] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.109s user 0.008s sys 0.000s
I20260928 20:03:10.693171 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:10.694722 26450 leader_election.cc:343] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.695170 26450 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.696807 28751 raft_consensus.cc:2749] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:10.698258 26913 tablet_bootstrap.cc:492] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:10.707171 28753 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
W20260928 20:03:10.708030 26740 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:10.707845 28753 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.708575 26739 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:10.710165 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e8ff2ad1f745f88df6e471ed935f2f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:10.710140 28756 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 20:03:10.710446 26148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 50493us
I20260928 20:03:10.710615 28753 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:10.710758 26648 raft_consensus.cc:3060] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.718791 26648 raft_consensus.cc:2468] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:03:10.726413 26595 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:10.734236 28628 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:10.735463 28719 raft_consensus.cc:2804] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:10.735944 28719 raft_consensus.cc:697] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:10.736694 28719 consensus_queue.cc:237] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.740125 26916 tablet_bootstrap.cc:492] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:10.740629 26916 ts_tablet_manager.cc:1449] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.202s user 0.012s sys 0.002s
W20260928 20:03:10.742831 26594 leader_election.cc:343] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:10.743310 26916 raft_consensus.cc:359] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.744202 26916 raft_consensus.cc:385] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.749275 26912 raft_consensus.cc:359] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.749949 26912 raft_consensus.cc:385] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.750217 26912 raft_consensus.cc:740] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.750854 26912 consensus_queue.cc:260] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.752959 26912 ts_tablet_manager.cc:1480] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.143s user 0.008s sys 0.009s
I20260928 20:03:10.753836 26912 tablet_bootstrap.cc:492] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:10.756201 26916 raft_consensus.cc:740] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.759500 26913 tablet_bootstrap.cc:654] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.761298 26916 consensus_queue.cc:260] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.794327 26916 ts_tablet_manager.cc:1480] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20260928 20:03:10.795511 26916 tablet_bootstrap.cc:492] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:10.753626 26739 leader_election.cc:304] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:10.798555 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45015.2us
I20260928 20:03:10.799613 28719 raft_consensus.cc:2804] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:10.801054 28719 raft_consensus.cc:697] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:10.802034 28719 consensus_queue.cc:237] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.805671 28752 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.809371 28752 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:10.846598 26594 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:10.847023 26594 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:10.809618 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:10.850644 26507 raft_consensus.cc:3060] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.858445 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:10.859020 26790 raft_consensus.cc:3060] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:10.879586 26790 raft_consensus.cc:2468] T 40942986095446f8a1b13da12315e804 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:10.877358 26507 raft_consensus.cc:2468] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:10.884835 26595 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:10.885103 26912 tablet_bootstrap.cc:654] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:10.898253 28753 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:10.904754 28717 raft_consensus.cc:493] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.905285 28717 raft_consensus.cc:515] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.907434 28717 leader_election.cc:290] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:10.912012 26913 tablet_bootstrap.cc:492] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:10.912534 26913 ts_tablet_manager.cc:1449] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.214s user 0.011s sys 0.004s
I20260928 20:03:10.912690 28753 raft_consensus.cc:2804] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:10.913829 28753 raft_consensus.cc:697] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:10.914685 28753 consensus_queue.cc:237] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.917091 26913 raft_consensus.cc:359] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:10.918186 27822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.685s (SENT) [suppressed 1 similar messages]
I20260928 20:03:10.931893 26916 tablet_bootstrap.cc:654] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:10.940696 26740 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3
I20260928 20:03:10.955626 26912 tablet_bootstrap.cc:492] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:10.956043 26912 ts_tablet_manager.cc:1449] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.202s user 0.006s sys 0.003s
I20260928 20:03:10.966442 26912 raft_consensus.cc:359] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.967121 26912 raft_consensus.cc:385] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:10.967377 26912 raft_consensus.cc:740] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.967967 26912 consensus_queue.cc:260] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.969437 26912 ts_tablet_manager.cc:1480] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260928 20:03:10.982216 28751 raft_consensus.cc:493] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:10.982815 28751 raft_consensus.cc:515] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:10.985086 28751 leader_election.cc:290] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:10.987098 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:10.988922 26450 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.001312 26913 raft_consensus.cc:385] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.001801 26913 raft_consensus.cc:740] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:10.946404 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626a876a51d04095b5dd54726bb995f3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:11.002810 26648 raft_consensus.cc:2468] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:10.986037 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:11.003109 26913 consensus_queue.cc:260] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:11.005882 26450 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.006268 26450 leader_election.cc:304] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.008354 28751 raft_consensus.cc:2749] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.015647 26739 leader_election.cc:304] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:11.020800 28719 raft_consensus.cc:2804] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:11.021327 28719 raft_consensus.cc:493] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:11.021763 28719 raft_consensus.cc:3060] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:11.030129 26740 consensus_peers.cc:597] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:11.054344 26912 tablet_bootstrap.cc:492] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:11.054731 28752 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.055274 28752 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.058696 28752 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:11.060746 26912 tablet_bootstrap.cc:654] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:11.067831 26595 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:11.069170 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.074069 28752 raft_consensus.cc:493] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.074661 28752 raft_consensus.cc:515] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.079855 26913 ts_tablet_manager.cc:1480] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.167s user 0.003s sys 0.003s
W20260928 20:03:11.080771 26595 leader_election.cc:343] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d13562e920244194969520df564a949d
I20260928 20:03:11.078087 28752 leader_election.cc:290] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:11.082082 26916 tablet_bootstrap.cc:492] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:11.082650 26916 ts_tablet_manager.cc:1449] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.287s user 0.012s sys 0.000s
I20260928 20:03:11.106598 26916 raft_consensus.cc:359] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.112844 28628 consensus_queue.cc:1048] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260928 20:03:11.123243 26916 raft_consensus.cc:385] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.122974 28719 raft_consensus.cc:515] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.124867 28719 leader_election.cc:290] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:11.127945 26740 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3
I20260928 20:03:11.126655 26916 raft_consensus.cc:740] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.133054 26916 consensus_queue.cc:260] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:11.134486 26594 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.134918 26594 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.136009 28686 raft_consensus.cc:2749] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.138672 26912 tablet_bootstrap.cc:492] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:11.139134 26912 ts_tablet_manager.cc:1449] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.085s user 0.008s sys 0.001s
I20260928 20:03:11.160179 26916 ts_tablet_manager.cc:1480] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.077s user 0.006s sys 0.000s
I20260928 20:03:11.141546 26912 raft_consensus.cc:359] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.160985 26912 raft_consensus.cc:385] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.161720 28751 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.162192 28751 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.164232 28751 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.161623 26912 raft_consensus.cc:740] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.173806 26912 consensus_queue.cc:260] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.175920 26912 ts_tablet_manager.cc:1480] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260928 20:03:11.182796 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626a876a51d04095b5dd54726bb995f3" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:11.183328 26648 raft_consensus.cc:3060] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:11.187582 26916 tablet_bootstrap.cc:492] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:11.194876 26648 raft_consensus.cc:2468] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:11.205339 26912 tablet_bootstrap.cc:492] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:11.213815 26916 tablet_bootstrap.cc:654] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.216580 26913 tablet_bootstrap.cc:492] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:11.220628 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13562e920244194969520df564a949d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.226588 26913 tablet_bootstrap.cc:654] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.237038 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.240568 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:11.240080 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:11.252275 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.252671 26450 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.253485 28770 raft_consensus.cc:2749] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.259145 26913 tablet_bootstrap.cc:492] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:11.268046 26912 tablet_bootstrap.cc:654] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.275509 26913 ts_tablet_manager.cc:1449] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.059s user 0.012s sys 0.000s
I20260928 20:03:11.288287 26916 tablet_bootstrap.cc:492] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:11.289067 26916 ts_tablet_manager.cc:1449] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.102s user 0.012s sys 0.000s
W20260928 20:03:11.295979 26594 leader_election.cc:343] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.296383 26594 leader_election.cc:304] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.297322 28752 raft_consensus.cc:2749] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.298205 26913 raft_consensus.cc:359] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.299304 26913 raft_consensus.cc:385] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.299811 26913 raft_consensus.cc:740] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.314379 28762 consensus_queue.cc:1048] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:11.312459 26913 consensus_queue.cc:260] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.313907 26916 raft_consensus.cc:359] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:11.323200 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b94aed8337bb4b20b7977e91640c6710 (table default.Table_88a3630ba1604375aba3e2ef7f7c1003 [id=80962b238d944b279991bb38e31ffddd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b94aed8337bb4b20b7977e91640c6710 consensus state has no leader
I20260928 20:03:11.323758 26916 raft_consensus.cc:385] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.325618 26913 ts_tablet_manager.cc:1480] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20260928 20:03:11.326694 26913 tablet_bootstrap.cc:492] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:11.324177 26916 raft_consensus.cc:740] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.328096 26916 consensus_queue.cc:260] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.331391 26916 ts_tablet_manager.cc:1480] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20260928 20:03:11.334780 26739 leader_election.cc:304] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:11.350297 28719 raft_consensus.cc:2804] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:11.350838 28719 raft_consensus.cc:697] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:11.351635 28719 consensus_queue.cc:237] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.392146 28770 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.392618 28770 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:11.393230 26912 tablet_bootstrap.cc:492] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:11.393618 26912 ts_tablet_manager.cc:1449] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.188s user 0.013s sys 0.000s
I20260928 20:03:11.394598 28770 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.396200 26912 raft_consensus.cc:359] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.396800 26912 raft_consensus.cc:385] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.397063 26912 raft_consensus.cc:740] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.397034 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:11.398757 26450 leader_election.cc:343] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.397653 26912 consensus_queue.cc:260] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.409631 26912 ts_tablet_manager.cc:1480] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260928 20:03:11.410542 26912 tablet_bootstrap.cc:492] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:11.414176 26916 tablet_bootstrap.cc:492] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:11.428401 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:11.430153 26450 leader_election.cc:343] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.430657 26450 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.431488 28770 raft_consensus.cc:2749] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:11.443706 28777 log.cc:927] Time spent T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
W20260928 20:03:11.447531 28776 log.cc:927] Time spent T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
W20260928 20:03:11.482591 26740 consensus_peers.cc:597] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:11.486027 28770 raft_consensus.cc:493] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.486523 28770 raft_consensus.cc:515] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.489066 28770 leader_election.cc:290] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.490881 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.491083 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:11.492865 26450 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:11.493530 26450 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.493885 26450 leader_election.cc:304] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.495697 26912 tablet_bootstrap.cc:654] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.501547 28770 raft_consensus.cc:2749] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.507206 26913 tablet_bootstrap.cc:654] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.479957 26916 tablet_bootstrap.cc:654] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.567492 26916 tablet_bootstrap.cc:492] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:11.584090 26912 tablet_bootstrap.cc:492] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:11.584525 26912 ts_tablet_manager.cc:1449] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.174s user 0.009s sys 0.001s
I20260928 20:03:11.592511 26913 tablet_bootstrap.cc:492] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:11.592984 26913 ts_tablet_manager.cc:1449] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.266s user 0.005s sys 0.009s
I20260928 20:03:11.567953 26916 ts_tablet_manager.cc:1449] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.168s user 0.007s sys 0.003s
I20260928 20:03:11.596895 26916 raft_consensus.cc:359] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.597579 26916 raft_consensus.cc:385] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.597815 26916 raft_consensus.cc:740] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.598523 26916 consensus_queue.cc:260] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.599807 26912 raft_consensus.cc:359] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.600420 26912 raft_consensus.cc:385] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.600646 26912 raft_consensus.cc:740] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.601214 26912 consensus_queue.cc:260] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.582305 28783 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:11.606959 28783 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:11.609124 26913 raft_consensus.cc:359] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.624900 26913 raft_consensus.cc:385] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.625259 26913 raft_consensus.cc:740] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.625964 26913 consensus_queue.cc:260] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:11.627661 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.685s (SENT)
I20260928 20:03:11.628235 26913 ts_tablet_manager.cc:1480] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20260928 20:03:11.628072 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:11.629751 26916 ts_tablet_manager.cc:1480] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260928 20:03:11.631956 28719 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.644164 26912 ts_tablet_manager.cc:1480] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.059s user 0.006s sys 0.001s
I20260928 20:03:11.645252 26912 tablet_bootstrap.cc:492] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:11.632428 28719 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.648352 28770 raft_consensus.cc:493] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.648900 28770 raft_consensus.cc:515] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:11.650384 26740 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:03:11.651053 28770 leader_election.cc:290] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.652774 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.655537 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:11.657006 26450 leader_election.cc:343] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:11.666349 26450 leader_election.cc:343] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.666787 26450 leader_election.cc:304] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.667508 28770 raft_consensus.cc:2749] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.671142 28783 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:11.671511 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:11.678553 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:11.679139 26646 raft_consensus.cc:2468] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:11.684592 28770 raft_consensus.cc:493] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.685101 28770 raft_consensus.cc:515] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.687108 28770 leader_election.cc:290] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.690160 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:11.691547 26450 leader_election.cc:343] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.695660 26916 tablet_bootstrap.cc:492] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:11.700495 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.701383 26916 tablet_bootstrap.cc:654] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:11.702172 26450 leader_election.cc:343] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.702572 26450 leader_election.cc:304] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.703258 28770 raft_consensus.cc:2749] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.651333 28719 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:11.709261 26912 tablet_bootstrap.cc:654] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.720361 28785 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 20:03:11.723016 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 95386.5us
I20260928 20:03:11.732616 28628 raft_consensus.cc:493] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.733121 28628 raft_consensus.cc:515] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.737169 26916 tablet_bootstrap.cc:492] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:11.737653 26916 ts_tablet_manager.cc:1449] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.009s
I20260928 20:03:11.740471 28770 raft_consensus.cc:493] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.740866 28770 raft_consensus.cc:515] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.742835 26739 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:11.743731 28762 raft_consensus.cc:2804] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:11.744061 28762 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:11.744347 28762 raft_consensus.cc:3060] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:11.745245 28770 leader_election.cc:290] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.746938 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:11.747205 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:11.748409 26450 leader_election.cc:343] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:11.749042 26450 leader_election.cc:343] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:11.749037 26740 consensus_peers.cc:597] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:11.749360 26450 leader_election.cc:304] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:11.750372 28770 raft_consensus.cc:2749] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:11.751312 28628 leader_election.cc:290] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:11.740017 26916 raft_consensus.cc:359] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.751885 26916 raft_consensus.cc:385] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.751696 28762 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.752170 26916 raft_consensus.cc:740] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.753161 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:11.753691 26507 raft_consensus.cc:2468] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:11.754418 26916 consensus_queue.cc:260] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.755873 26740 leader_election.cc:304] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:11.756589 26740 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:03:11.757162 28719 raft_consensus.cc:2804] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:11.757483 28719 raft_consensus.cc:493] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:11.757773 28719 raft_consensus.cc:3060] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:11.759372 28762 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:11.760541 26916 ts_tablet_manager.cc:1480] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260928 20:03:11.762655 26916 tablet_bootstrap.cc:492] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:11.771121 26916 tablet_bootstrap.cc:654] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:11.786542 26740 consensus_peers.cc:597] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:11.809832 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 67067.3us
I20260928 20:03:11.815251 28719 raft_consensus.cc:515] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.834661 28752 consensus_queue.cc:1048] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:11.848289 26913 tablet_bootstrap.cc:492] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:11.859558 26913 tablet_bootstrap.cc:654] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.860244 28719 leader_election.cc:290] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:11.861672 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:11.862265 26510 raft_consensus.cc:3060] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:11.868993 28770 raft_consensus.cc:493] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.869503 28770 raft_consensus.cc:515] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.871495 28770 leader_election.cc:290] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.873726 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:11.875211 26450 leader_election.cc:343] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:11.880523 26912 tablet_bootstrap.cc:492] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:11.880468 26510 raft_consensus.cc:2468] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:11.881064 26912 ts_tablet_manager.cc:1449] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.236s user 0.005s sys 0.007s
I20260928 20:03:11.881699 26740 leader_election.cc:304] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:11.883810 26912 raft_consensus.cc:359] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.884408 28719 raft_consensus.cc:2804] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:11.885135 28719 raft_consensus.cc:697] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:11.886595 28719 consensus_queue.cc:237] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.884543 26912 raft_consensus.cc:385] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.902556 26912 raft_consensus.cc:740] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.903200 26912 consensus_queue.cc:260] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.905455 26912 ts_tablet_manager.cc:1480] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260928 20:03:11.911998 26913 tablet_bootstrap.cc:492] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:11.912447 26913 ts_tablet_manager.cc:1449] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.064s user 0.010s sys 0.001s
I20260928 20:03:11.913843 26912 tablet_bootstrap.cc:492] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:11.916289 26913 raft_consensus.cc:359] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:11.919135 26913 raft_consensus.cc:385] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.919919 26912 tablet_bootstrap.cc:654] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.920027 26913 raft_consensus.cc:740] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.921375 26913 consensus_queue.cc:260] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:11.925339 26913 ts_tablet_manager.cc:1480] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.013s user 0.003s sys 0.002s
I20260928 20:03:11.929508 26913 tablet_bootstrap.cc:492] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:11.932013 26912 tablet_bootstrap.cc:492] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:11.932462 26912 ts_tablet_manager.cc:1449] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.012s
I20260928 20:03:11.935250 26916 tablet_bootstrap.cc:492] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:11.935778 26916 ts_tablet_manager.cc:1449] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.173s user 0.034s sys 0.050s
I20260928 20:03:11.938448 26916 raft_consensus.cc:359] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.941346 26916 raft_consensus.cc:385] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.941669 26916 raft_consensus.cc:740] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.952332 26913 tablet_bootstrap.cc:654] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.952908 26916 consensus_queue.cc:260] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.955724 26916 ts_tablet_manager.cc:1480] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.020s user 0.003s sys 0.002s
I20260928 20:03:11.966323 26916 tablet_bootstrap.cc:492] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:11.970952 26912 raft_consensus.cc:359] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.971691 26912 raft_consensus.cc:385] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:11.971976 26912 raft_consensus.cc:740] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:11.972668 26912 consensus_queue.cc:260] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.979969 26916 tablet_bootstrap.cc:654] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:11.990409 28770 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:11.990921 28770 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:11.992784 28770 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:11.992905 26912 ts_tablet_manager.cc:1480] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.060s user 0.006s sys 0.001s
I20260928 20:03:11.994613 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:11.995985 26450 leader_election.cc:343] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.028468 28719 raft_consensus.cc:493] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.028921 28719 raft_consensus.cc:515] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.031347 28770 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.031843 28770 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.033691 28770 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.035341 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:12.036695 26450 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.036854 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:12.035336 28719 leader_election.cc:290] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.037464 26510 raft_consensus.cc:2468] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:12.038772 26740 leader_election.cc:304] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:12.039599 28719 raft_consensus.cc:2804] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:12.039927 28719 raft_consensus.cc:493] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:12.040243 28719 raft_consensus.cc:3060] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.047595 28719 raft_consensus.cc:515] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.053829 26912 tablet_bootstrap.cc:492] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:12.058653 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:12.059157 26510 raft_consensus.cc:3060] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.061203 26912 tablet_bootstrap.cc:654] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.065642 26510 raft_consensus.cc:2468] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:12.066849 26740 leader_election.cc:304] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:12.067719 28762 raft_consensus.cc:2804] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:12.068153 28762 raft_consensus.cc:697] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:12.068917 28762 consensus_queue.cc:237] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.070539 26916 tablet_bootstrap.cc:492] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:12.071012 26916 ts_tablet_manager.cc:1449] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.105s user 0.010s sys 0.006s
I20260928 20:03:12.073768 26916 raft_consensus.cc:359] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.074417 26916 raft_consensus.cc:385] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.074678 26916 raft_consensus.cc:740] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.075290 26916 consensus_queue.cc:260] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.077267 26916 ts_tablet_manager.cc:1480] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:03:12.078293 28719 leader_election.cc:290] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.108083 26916 tablet_bootstrap.cc:492] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:12.113823 26916 tablet_bootstrap.cc:654] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.122910 26912 tablet_bootstrap.cc:492] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:12.125458 28762 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.125941 28762 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.128114 28762 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:12.132897 26740 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:12.125005 26912 ts_tablet_manager.cc:1449] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.003s
I20260928 20:03:12.135991 26912 raft_consensus.cc:359] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:12.137064 26912 raft_consensus.cc:385] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.137408 26912 raft_consensus.cc:740] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.138188 26912 consensus_queue.cc:260] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:12.211192 26740 consensus_peers.cc:597] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:12.223664 26912 ts_tablet_manager.cc:1480] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.090s user 0.003s sys 0.003s
I20260928 20:03:12.142882 28770 raft_consensus.cc:493] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.226212 28770 raft_consensus.cc:515] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.228363 28770 leader_election.cc:290] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.230122 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:12.231252 28770 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.231683 28770 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.233702 28770 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:12.234957 26450 leader_election.cc:343] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.235373 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:12.236789 26450 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.242638 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.247861 26913 tablet_bootstrap.cc:492] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:12.248592 26913 ts_tablet_manager.cc:1449] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.319s user 0.008s sys 0.002s
I20260928 20:03:12.256366 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:12.258433 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292eef7bab904a7ea5ef6dbdaba1d37d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:12.259428 26654 raft_consensus.cc:3060] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.279732 26913 raft_consensus.cc:359] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.280627 26913 raft_consensus.cc:385] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.280915 26913 raft_consensus.cc:740] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.293880 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.294615 26655 raft_consensus.cc:2468] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:12.281608 26913 consensus_queue.cc:260] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.302388 26913 ts_tablet_manager.cc:1480] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.053s user 0.006s sys 0.004s
I20260928 20:03:12.309672 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b887f248114c1fbe539769daac776d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:12.310297 26646 raft_consensus.cc:3060] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:12.323118 26148 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.713s (SENT) [suppressed 1 similar messages]
I20260928 20:03:12.337831 26913 tablet_bootstrap.cc:492] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:12.344762 26913 tablet_bootstrap.cc:654] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.349280 26646 raft_consensus.cc:2468] T 90b887f248114c1fbe539769daac776d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:12.367740 28579 raft_consensus.cc:493] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.368218 28579 raft_consensus.cc:515] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.370298 28579 leader_election.cc:290] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:12.373066 26740 leader_election.cc:343] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d13562e920244194969520df564a949d
W20260928 20:03:12.384687 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 87024e1a4f184c669ff78efc918a9eef consensus state has no leader
I20260928 20:03:12.404274 28770 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.404727 28770 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.406641 28770 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.408597 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:12.410084 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.431331 28770 raft_consensus.cc:493] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.431807 28770 raft_consensus.cc:515] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.435339 28770 leader_election.cc:290] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.435568 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:12.437942 26450 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.356369 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.360219 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.360646 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.361109 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.361883 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.461508 26648 raft_consensus.cc:2468] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:12.364940 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.366233 26913 tablet_bootstrap.cc:492] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:12.429311 28801 raft_consensus.cc:493] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.462236 26913 ts_tablet_manager.cc:1449] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.125s user 0.013s sys 0.001s
I20260928 20:03:12.462509 28801 raft_consensus.cc:515] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.463335 26916 tablet_bootstrap.cc:492] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:12.463806 26916 ts_tablet_manager.cc:1449] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.356s user 0.005s sys 0.005s
I20260928 20:03:12.464596 26913 raft_consensus.cc:359] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:12.465160 26913 raft_consensus.cc:385] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.465428 26913 raft_consensus.cc:740] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.466064 26913 consensus_queue.cc:260] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:12.466614 26595 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211
I20260928 20:03:12.467578 26913 ts_tablet_manager.cc:1480] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260928 20:03:12.470499 26913 tablet_bootstrap.cc:492] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:12.454196 26654 raft_consensus.cc:2468] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:12.500316 28770 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.500842 28770 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.502494 26913 tablet_bootstrap.cc:654] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.508072 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:12.508335 26916 raft_consensus.cc:359] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.508981 26916 raft_consensus.cc:385] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.509248 26916 raft_consensus.cc:740] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:12.509534 26450 leader_election.cc:343] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.510916 28770 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.511453 28801 leader_election.cc:290] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.518924 28579 consensus_queue.cc:1048] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:12.523437 26739 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:12.526682 26739 leader_election.cc:343] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.528308 28719 consensus_queue.cc:1048] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:12.544849 26450 leader_election.cc:343] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.545312 26450 leader_election.cc:304] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.546619 28770 raft_consensus.cc:2749] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:12.552675 26450 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.553386 26450 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.554651 28770 raft_consensus.cc:2749] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:12.509853 26916 consensus_queue.cc:260] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.560650 26916 ts_tablet_manager.cc:1480] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.097s user 0.004s sys 0.000s
W20260928 20:03:12.562721 26450 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.563280 26450 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.564183 28770 raft_consensus.cc:2749] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:12.566118 26450 leader_election.cc:343] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.566594 26450 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.567476 28770 raft_consensus.cc:2749] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:12.570868 26912 tablet_bootstrap.cc:492] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:12.571396 28753 consensus_queue.cc:1048] T 40942986095446f8a1b13da12315e804 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:12.572330 26913 tablet_bootstrap.cc:492] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:12.572737 26913 ts_tablet_manager.cc:1449] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.102s user 0.022s sys 0.005s
I20260928 20:03:12.575703 26913 raft_consensus.cc:359] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.576315 26913 raft_consensus.cc:385] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.576442 26912 tablet_bootstrap.cc:654] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.576591 26913 raft_consensus.cc:740] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.577188 26913 consensus_queue.cc:260] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.578756 26913 ts_tablet_manager.cc:1480] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260928 20:03:12.582880 26916 tablet_bootstrap.cc:492] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:12.587232 26913 tablet_bootstrap.cc:492] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:12.592168 26450 leader_election.cc:343] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.592705 26450 leader_election.cc:304] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.593777 28770 raft_consensus.cc:2749] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:12.604776 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed48087b59c744f9a928c8d529b69211" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:12.605515 26797 raft_consensus.cc:2468] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:12.627527 26912 tablet_bootstrap.cc:492] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:12.627959 26912 ts_tablet_manager.cc:1449] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.000s
I20260928 20:03:12.619406 26739 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:12.629959 28628 raft_consensus.cc:2804] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:12.630407 28628 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:12.630797 28628 raft_consensus.cc:3060] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.639595 28628 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.641883 26739 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:12.645437 26740 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:12.646776 28719 raft_consensus.cc:2804] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:12.647334 28719 raft_consensus.cc:697] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:12.648226 28719 consensus_queue.cc:237] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.634416 26912 raft_consensus.cc:359] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:12.651391 26912 raft_consensus.cc:385] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.651634 26912 raft_consensus.cc:740] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.652199 26912 consensus_queue.cc:260] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:12.660123 26912 ts_tablet_manager.cc:1480] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20260928 20:03:12.660981 26912 tablet_bootstrap.cc:492] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:12.674031 26913 tablet_bootstrap.cc:654] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.676357 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13562e920244194969520df564a949d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.667977 28628 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.687296 26654 raft_consensus.cc:2468] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:12.701001 28770 raft_consensus.cc:493] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.701452 28770 raft_consensus.cc:515] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.701929 26916 tablet_bootstrap.cc:654] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.703977 28770 leader_election.cc:290] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.706144 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:12.690482 26594 leader_election.cc:304] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:12.714005 28798 raft_consensus.cc:2804] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:12.714460 28798 raft_consensus.cc:493] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:12.714821 28798 raft_consensus.cc:3060] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.721395 28800 raft_consensus.cc:493] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:12.738020 26450 leader_election.cc:343] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.740098 26912 tablet_bootstrap.cc:654] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.743407 28770 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.744016 28770 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.746197 28770 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.748540 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:12.757570 26450 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.768464 28770 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.769014 28770 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.773082 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:12.774663 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.771178 28770 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.794296 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55c1732e13e4e2ab4f5c5d80d0fa4f6" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:12.721992 28800 raft_consensus.cc:515] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.796080 26649 raft_consensus.cc:3060] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.803131 26651 raft_consensus.cc:3060] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.806854 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.808679 26649 raft_consensus.cc:2468] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:12.808852 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.810561 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.810999 28798 raft_consensus.cc:515] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.814983 26913 tablet_bootstrap.cc:492] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:12.815407 26913 ts_tablet_manager.cc:1449] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.228s user 0.015s sys 0.019s
I20260928 20:03:12.815642 28800 leader_election.cc:290] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.816867 26916 tablet_bootstrap.cc:492] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:03:12.784052 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 55980.7us
I20260928 20:03:12.820322 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:12.820376 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed48087b59c744f9a928c8d529b69211" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:12.821588 26791 raft_consensus.cc:3060] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.821502 26913 raft_consensus.cc:359] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.822935 26913 raft_consensus.cc:385] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.823211 26913 raft_consensus.cc:740] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.823863 26913 consensus_queue.cc:260] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:12.826051 26594 leader_election.cc:343] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.827291 26913 ts_tablet_manager.cc:1480] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260928 20:03:12.828200 26913 tablet_bootstrap.cc:492] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:12.829077 26912 tablet_bootstrap.cc:492] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
W20260928 20:03:12.829361 26595 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211
I20260928 20:03:12.829516 26912 ts_tablet_manager.cc:1449] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.169s user 0.013s sys 0.014s
I20260928 20:03:12.832011 28798 leader_election.cc:290] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.832036 26912 raft_consensus.cc:359] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.832778 26912 raft_consensus.cc:385] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.833055 26912 raft_consensus.cc:740] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.835065 26791 raft_consensus.cc:2468] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:12.836113 26594 leader_election.cc:304] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:12.817915 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:12.838464 26507 raft_consensus.cc:2468] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:12.839783 26916 ts_tablet_manager.cc:1449] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.257s user 0.010s sys 0.001s
I20260928 20:03:12.842979 26916 raft_consensus.cc:359] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.837282 26913 tablet_bootstrap.cc:654] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:12.842666 26595 leader_election.cc:304] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.851657 28819 raft_consensus.cc:2804] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:12.852279 28800 raft_consensus.cc:2804] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:12.852586 28800 raft_consensus.cc:493] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:12.852869 28800 raft_consensus.cc:3060] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.855037 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.856527 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.857805 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:12.859037 26739 leader_election.cc:304] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:12.861078 28628 raft_consensus.cc:2804] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:12.861423 28628 raft_consensus.cc:493] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:12.861727 28628 raft_consensus.cc:3060] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.863641 28819 raft_consensus.cc:697] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:12.864703 28819 consensus_queue.cc:237] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.872443 28719 consensus_queue.cc:1048] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:12.878419 28800 raft_consensus.cc:515] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.879441 28719 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.879817 28719 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:12.881971 28719 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:12.895488 28628 raft_consensus.cc:515] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.914229 28800 leader_election.cc:290] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.833675 26912 consensus_queue.cc:260] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.916152 28579 raft_consensus.cc:493] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.916582 28579 raft_consensus.cc:515] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.917165 26912 ts_tablet_manager.cc:1480] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.087s user 0.002s sys 0.003s
I20260928 20:03:12.918128 26912 tablet_bootstrap.cc:492] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:12.919454 28579 leader_election.cc:290] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.921769 28819 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.922267 28819 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:12.930344 28628 leader_election.cc:290] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:12.932250 26740 leader_election.cc:343] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d13562e920244194969520df564a949d
I20260928 20:03:12.897979 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:12.935843 26510 raft_consensus.cc:3060] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.924150 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:12.925028 26450 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.925403 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:12.941694 26450 leader_election.cc:304] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:12.941836 26508 raft_consensus.cc:2468] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:12.942596 28770 raft_consensus.cc:2749] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:12.943238 26595 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:12.944427 26510 raft_consensus.cc:2468] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:12.945904 26916 raft_consensus.cc:385] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:12.946305 26916 raft_consensus.cc:740] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:12.960238 28798 raft_consensus.cc:2804] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:12.960639 28798 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:12.960958 28798 raft_consensus.cc:3060] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:12.969352 28753 raft_consensus.cc:493] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:12.969830 28753 raft_consensus.cc:515] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.972918 28753 leader_election.cc:290] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:12.978765 28819 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:12.998808 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:12.999053 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:12.998917 26916 consensus_queue.cc:260] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:12.999444 26507 raft_consensus.cc:2468] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:12.999498 26450 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.008240 26912 tablet_bootstrap.cc:654] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.013186 26913 tablet_bootstrap.cc:492] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:13.013635 26913 ts_tablet_manager.cc:1449] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.186s user 0.004s sys 0.017s
I20260928 20:03:13.016187 28798 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:13.026559 26450 leader_election.cc:343] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.027031 26450 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.030242 28770 raft_consensus.cc:2749] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.032819 26916 ts_tablet_manager.cc:1480] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.193s user 0.007s sys 0.000s
I20260928 20:03:13.033151 28798 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.033836 26916 tablet_bootstrap.cc:492] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:13.046743 26450 leader_election.cc:343] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.055842 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 195133us
I20260928 20:03:13.059062 28717 consensus_queue.cc:1048] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:13.016208 26913 raft_consensus.cc:359] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.047345 26450 leader_election.cc:304] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.079773 28770 raft_consensus.cc:2749] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.082247 26740 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:13.082355 26450 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.082788 26450 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.090353 28717 raft_consensus.cc:2804] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:13.090806 28717 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:13.091221 28717 raft_consensus.cc:3060] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:13.091205 26148 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.713s (SENT)
I20260928 20:03:13.091576 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:03:13.101594 28770 raft_consensus.cc:2749] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.102275 28770 raft_consensus.cc:2749] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.103247 26912 tablet_bootstrap.cc:492] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:13.103796 26912 ts_tablet_manager.cc:1449] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.186s user 0.008s sys 0.000s
I20260928 20:03:13.106720 26912 raft_consensus.cc:359] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.107322 26912 raft_consensus.cc:385] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.107570 26912 raft_consensus.cc:740] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.108161 26912 consensus_queue.cc:260] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.109517 26912 ts_tablet_manager.cc:1480] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260928 20:03:13.115613 26916 tablet_bootstrap.cc:654] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.124267 28798 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.128232 26913 raft_consensus.cc:385] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.128572 26913 raft_consensus.cc:740] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.128430 28798 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.129278 26913 consensus_queue.cc:260] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.130429 28798 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.134979 26739 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:13.135875 28719 raft_consensus.cc:2804] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:13.136581 28719 raft_consensus.cc:697] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:13.137413 28719 consensus_queue.cc:237] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.144286 28717 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.146724 28827 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 20:03:13.147536 26148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 56360.3us
W20260928 20:03:13.124763 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.149881 26450 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.150705 28770 raft_consensus.cc:2749] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.151927 28770 raft_consensus.cc:493] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.151855 26595 leader_election.cc:304] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:13.152618 28798 raft_consensus.cc:2804] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:13.152309 28770 raft_consensus.cc:515] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.153028 28798 raft_consensus.cc:697] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:13.153761 28798 consensus_queue.cc:237] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.154316 28770 leader_election.cc:290] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.159449 28819 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.159873 28819 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.140889 28826 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.161597 28826 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.161934 28819 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:13.164312 28826 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.167137 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:13.167619 26510 raft_consensus.cc:3060] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.167873 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:13.168370 26512 raft_consensus.cc:2468] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:13.175830 26510 raft_consensus.cc:2468] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:13.177018 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:13.180716 26913 ts_tablet_manager.cc:1480] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.167s user 0.002s sys 0.006s
I20260928 20:03:13.192402 26912 tablet_bootstrap.cc:492] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:13.196919 28628 consensus_queue.cc:1048] T fec512104cb6418db320e072476c2874 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:13.199628 28579 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.203343 28579 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.205160 28579 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:13.206844 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:13.207520 26507 raft_consensus.cc:2468] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:13.208057 26916 tablet_bootstrap.cc:492] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:13.208489 26916 ts_tablet_manager.cc:1449] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.175s user 0.006s sys 0.004s
I20260928 20:03:13.208611 26740 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:13.209470 28579 raft_consensus.cc:2804] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:13.209779 28579 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:13.210079 28579 raft_consensus.cc:3060] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.211534 26912 tablet_bootstrap.cc:654] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.211480 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.213598 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.213955 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.217173 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.225152 28770 raft_consensus.cc:493] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.225708 28770 raft_consensus.cc:515] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.227813 28770 leader_election.cc:290] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.231514 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:13.232236 26507 raft_consensus.cc:2468] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:13.233351 28830 log.cc:927] Time spent T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260928 20:03:13.235967 26913 tablet_bootstrap.cc:492] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:13.239873 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:13.248098 28717 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:13.254513 28798 raft_consensus.cc:493] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.257375 28798 raft_consensus.cc:515] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.258543 26507 raft_consensus.cc:2393] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:13.261067 28798 leader_election.cc:290] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:13.254267 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 55017.9us
I20260928 20:03:13.237702 28579 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.272306 28826 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.272892 28826 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.275017 28826 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.283888 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:13.285378 26507 raft_consensus.cc:3060] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.287338 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.287626 28579 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:13.288040 26658 raft_consensus.cc:2393] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:13.286710 26595 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:13.289299 28753 raft_consensus.cc:2804] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:13.289638 28753 raft_consensus.cc:493] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:13.285985 28826 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.291713 28826 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.297967 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.294512 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:13.308693 26512 raft_consensus.cc:2468] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:13.311034 28826 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.323194 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.337009 26507 raft_consensus.cc:2468] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:13.289937 28753 raft_consensus.cc:3060] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.337978 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13562e920244194969520df564a949d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:13.338562 26657 raft_consensus.cc:3060] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.338009 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.292376 26595 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:13.341517 26913 tablet_bootstrap.cc:654] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.342010 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.345494 26657 raft_consensus.cc:2468] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:13.354908 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.356078 26912 tablet_bootstrap.cc:492] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:13.356632 26912 ts_tablet_manager.cc:1449] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.164s user 0.007s sys 0.028s
I20260928 20:03:13.359308 26912 raft_consensus.cc:359] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.359989 26912 raft_consensus.cc:385] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.360253 26912 raft_consensus.cc:740] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.361163 28800 raft_consensus.cc:2804] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:13.360881 26912 consensus_queue.cc:260] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.361624 28800 raft_consensus.cc:697] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:13.362401 28800 consensus_queue.cc:237] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.382922 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:13.385898 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.388932 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:13.389509 26797 raft_consensus.cc:3060] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.397395 26797 raft_consensus.cc:2468] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:13.405088 28753 raft_consensus.cc:515] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.408128 26659 raft_consensus.cc:2393] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:13.406319 28833 consensus_queue.cc:1048] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:13.409250 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec512104cb6418db320e072476c2874" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.410079 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.417796 26799 raft_consensus.cc:2393] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:13.410488 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:13.409978 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.410897 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.413961 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.419617 26792 raft_consensus.cc:2468] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:13.428553 26796 raft_consensus.cc:2393] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:13.331099 26916 raft_consensus.cc:359] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.429243 26916 raft_consensus.cc:385] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.429538 26916 raft_consensus.cc:740] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.430034 26790 raft_consensus.cc:2393] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:13.429821 26740 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:13.430208 26916 consensus_queue.cc:260] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.430841 28833 raft_consensus.cc:2804] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:03:13.322988 26450 leader_election.cc:343] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.420334 28770 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.431299 28833 raft_consensus.cc:697] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:13.431438 28770 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.432363 26916 ts_tablet_manager.cc:1480] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.224s user 0.005s sys 0.001s
I20260928 20:03:13.432128 28833 consensus_queue.cc:237] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.433251 26916 tablet_bootstrap.cc:492] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:13.433334 28770 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.379993 28826 raft_consensus.cc:493] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.434314 28826 raft_consensus.cc:515] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:13.434969 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 112013us
W20260928 20:03:13.435629 26450 leader_election.cc:343] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.436307 28826 leader_election.cc:290] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.438897 26912 ts_tablet_manager.cc:1480] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.082s user 0.006s sys 0.000s
W20260928 20:03:13.436220 26450 leader_election.cc:343] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.442754 26450 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.443485 26450 leader_election.cc:343] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.444152 26450 leader_election.cc:304] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.447075 28826 raft_consensus.cc:2749] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.447759 28753 leader_election.cc:290] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:13.448625 26450 leader_election.cc:343] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.445868 26916 tablet_bootstrap.cc:654] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.450456 26450 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:13.453763 26450 leader_election.cc:343] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.477147 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 16796100116a4fe4a64893f49fb1cad4 consensus state has no leader
I20260928 20:03:13.482487 26450 leader_election.cc:304] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.483505 28826 raft_consensus.cc:2749] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.454216 28845 raft_consensus.cc:2749] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.487185 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:03:13.487850 26450 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.488370 26659 raft_consensus.cc:2393] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:13.488234 26450 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.490497 26912 tablet_bootstrap.cc:492] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:13.489360 28826 raft_consensus.cc:2749] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.496534 28845 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.497072 28845 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.499424 28845 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.507192 26913 tablet_bootstrap.cc:492] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:13.507634 26913 ts_tablet_manager.cc:1449] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.272s user 0.009s sys 0.004s
W20260928 20:03:13.520108 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 204165us
W20260928 20:03:13.534488 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46659.6us
W20260928 20:03:13.536865 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 244531us
I20260928 20:03:13.536972 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.539322 26595 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:13.539606 26912 tablet_bootstrap.cc:654] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.540714 28819 raft_consensus.cc:2804] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:13.541096 28819 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:13.541556 28819 raft_consensus.cc:3060] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.548086 26913 raft_consensus.cc:359] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.548863 26913 raft_consensus.cc:385] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.549095 26913 raft_consensus.cc:740] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.549680 26913 consensus_queue.cc:260] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.551105 26913 ts_tablet_manager.cc:1480] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.042s user 0.004s sys 0.000s
I20260928 20:03:13.555197 26916 tablet_bootstrap.cc:492] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:13.555631 26916 ts_tablet_manager.cc:1449] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.123s user 0.011s sys 0.001s
I20260928 20:03:13.555946 26739 leader_election.cc:304] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:13.556627 28628 raft_consensus.cc:2749] T 78c5918f0c05420b8ed8885c18c63907 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.561734 28628 consensus_queue.cc:1048] T 90b887f248114c1fbe539769daac776d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:13.576103 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.587174 26739 leader_election.cc:304] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:13.588986 28833 raft_consensus.cc:2804] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:13.589475 28833 raft_consensus.cc:697] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:13.590353 28833 consensus_queue.cc:237] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.596668 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.596982 28826 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.596948 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.597452 28826 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.598836 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.599970 28826 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.599714 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.603497 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:13.608449 26740 consensus_peers.cc:597] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:13.608944 26913 tablet_bootstrap.cc:492] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:13.596764 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.619037 26916 raft_consensus.cc:359] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.619689 26916 raft_consensus.cc:385] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.619942 26916 raft_consensus.cc:740] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.620524 26916 consensus_queue.cc:260] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:13.626772 26450 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.627470 26450 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.628017 26450 leader_election.cc:343] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.631101 26916 ts_tablet_manager.cc:1480] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.075s user 0.005s sys 0.001s
I20260928 20:03:13.638274 26739 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:13.638970 28717 raft_consensus.cc:2749] T 0abf33cd0d114c25a729bd0eb8ae1278 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.639321 26594 leader_election.cc:304] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.640106 28839 raft_consensus.cc:2749] T fec512104cb6418db320e072476c2874 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:13.641167 26594 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.643798 28845 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.644304 28845 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.646180 28845 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:13.647051 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.654049 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:13.654691 26507 raft_consensus.cc:2393] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
W20260928 20:03:13.659961 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 120682us
I20260928 20:03:13.585788 28819 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.662958 28819 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:13.667757 26594 leader_election.cc:304] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:13.676332 26912 tablet_bootstrap.cc:492] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:13.676783 26912 ts_tablet_manager.cc:1449] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.187s user 0.009s sys 0.002s
I20260928 20:03:13.678913 28845 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.679386 28845 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.681156 28845 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.684739 26912 raft_consensus.cc:359] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.685526 26912 raft_consensus.cc:385] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.685791 26912 raft_consensus.cc:740] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.700286 26913 tablet_bootstrap.cc:654] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:13.704780 26450 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.705253 26450 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.706039 28845 raft_consensus.cc:2749] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:13.706390 26450 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.706758 26450 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.707386 28845 raft_consensus.cc:2749] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.709173 28845 raft_consensus.cc:493] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.709612 28845 raft_consensus.cc:515] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.711508 28845 leader_election.cc:290] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.716602 28819 raft_consensus.cc:2804] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:13.717175 28819 raft_consensus.cc:493] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:13.717733 28819 raft_consensus.cc:3060] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.747985 26916 tablet_bootstrap.cc:492] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:13.707690 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.751976 26450 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.752748 28845 raft_consensus.cc:2749] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.756814 26916 tablet_bootstrap.cc:654] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:13.758391 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 50715.1us
I20260928 20:03:13.763561 26912 consensus_queue.cc:260] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:13.790946 26450 leader_election.cc:343] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.791401 26450 leader_election.cc:304] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.792091 28845 raft_consensus.cc:2749] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.818589 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbffea517e2438d90ca234b9f72f733" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:13.820524 26912 ts_tablet_manager.cc:1480] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.143s user 0.005s sys 0.001s
I20260928 20:03:13.821564 26912 tablet_bootstrap.cc:492] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:13.845921 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.855520 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.862730 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.864078 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.865305 26913 tablet_bootstrap.cc:492] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:13.865693 26913 ts_tablet_manager.cc:1449] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.314s user 0.010s sys 0.000s
I20260928 20:03:13.868040 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:13.875918 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.879387 26913 raft_consensus.cc:359] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.880084 26913 raft_consensus.cc:385] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.880347 26913 raft_consensus.cc:740] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.881091 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.880988 26913 consensus_queue.cc:260] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.881721 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:13.884157 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:13.887878 28819 raft_consensus.cc:515] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.894418 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:13.895012 26507 raft_consensus.cc:3060] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:13.910812 26594 leader_election.cc:304] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:13.911813 28838 raft_consensus.cc:2749] T 8cbffea517e2438d90ca234b9f72f733 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:13.928855 26507 raft_consensus.cc:2468] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:13.933900 26912 tablet_bootstrap.cc:654] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:13.934028 26913 ts_tablet_manager.cc:1480] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.068s user 0.007s sys 0.000s
I20260928 20:03:13.943310 26916 tablet_bootstrap.cc:492] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:13.943812 26916 ts_tablet_manager.cc:1449] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.196s user 0.007s sys 0.007s
I20260928 20:03:13.946892 28845 raft_consensus.cc:493] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.947396 28845 raft_consensus.cc:515] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.949388 28845 leader_election.cc:290] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.949841 28845 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:13.950397 28845 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:13.952240 28845 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:13.951133 26595 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:13.953214 28839 raft_consensus.cc:2804] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:13.953743 28839 raft_consensus.cc:697] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:13.954689 28839 consensus_queue.cc:237] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.966264 26913 tablet_bootstrap.cc:492] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:13.947059 26450 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.968892 26450 leader_election.cc:343] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.970600 26450 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.978327 26916 raft_consensus.cc:359] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.979022 26916 raft_consensus.cc:385] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:13.979282 26916 raft_consensus.cc:740] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:13.979869 26916 consensus_queue.cc:260] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:13.982752 28819 leader_election.cc:290] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:13.987506 26450 leader_election.cc:343] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:13.992779 26450 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:13.993366 26450 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:14.012801 26450 leader_election.cc:343] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.015221 28845 raft_consensus.cc:2749] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.015162 26450 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.016345 28845 raft_consensus.cc:2749] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:14.016427 26450 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.016853 26450 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.017524 28826 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.001394 26916 ts_tablet_manager.cc:1480] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.057s user 0.005s sys 0.002s
W20260928 20:03:14.017858 26450 leader_election.cc:343] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.018276 26450 leader_election.cc:304] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.018970 26916 tablet_bootstrap.cc:492] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.019338 28826 raft_consensus.cc:2749] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.037359 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:14.037883 26510 raft_consensus.cc:3060] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.037388 26916 tablet_bootstrap.cc:654] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.044643 26510 raft_consensus.cc:2468] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:14.047281 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.043043 28863 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:14.054860 28863 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:14.057662 28863 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:14.058431 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:14.059360 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.064585 26595 leader_election.cc:304] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:14.065490 28839 raft_consensus.cc:2804] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:14.065953 28839 raft_consensus.cc:697] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:14.066838 28839 consensus_queue.cc:237] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:14.076370 26450 leader_election.cc:343] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:14.079074 26450 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:14.082907 26595 consensus_peers.cc:597] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:14.090446 26913 tablet_bootstrap.cc:654] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.113206 28839 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.113802 28839 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.116084 28839 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:14.127187 26595 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:14.131157 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.133862 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.138212 26916 tablet_bootstrap.cc:492] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:03:14.150381 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 79480us
I20260928 20:03:14.155259 26916 ts_tablet_manager.cc:1449] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.137s user 0.010s sys 0.002s
I20260928 20:03:14.174417 26916 raft_consensus.cc:359] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.192205 28717 raft_consensus.cc:493] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.193213 28717 raft_consensus.cc:515] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.196247 28717 leader_election.cc:290] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:14.205310 26912 tablet_bootstrap.cc:492] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:14.206003 26912 ts_tablet_manager.cc:1449] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.385s user 0.011s sys 0.001s
I20260928 20:03:14.206820 26916 raft_consensus.cc:385] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.207233 26916 raft_consensus.cc:740] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:14.207518 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 56214.7us
I20260928 20:03:14.207959 26916 consensus_queue.cc:260] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.210575 26916 ts_tablet_manager.cc:1480] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.055s user 0.006s sys 0.000s
W20260928 20:03:14.212621 26450 leader_election.cc:343] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.213074 26450 leader_election.cc:304] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:14.214241 26450 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.214382 28826 raft_consensus.cc:2749] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.214639 26450 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.218294 28826 raft_consensus.cc:2749] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.233682 26912 raft_consensus.cc:359] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.234531 26912 raft_consensus.cc:385] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.234828 26912 raft_consensus.cc:740] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.235513 26912 consensus_queue.cc:260] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.237763 26912 ts_tablet_manager.cc:1480] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.031s user 0.003s sys 0.003s
I20260928 20:03:14.241341 26913 tablet_bootstrap.cc:492] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:14.241786 26913 ts_tablet_manager.cc:1449] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.276s user 0.022s sys 0.011s
I20260928 20:03:14.242432 28826 raft_consensus.cc:493] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.242908 28826 raft_consensus.cc:515] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.245002 28826 leader_election.cc:290] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.245442 28872 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:14.246039 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.247318 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:14.247997 26450 leader_election.cc:343] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:14.258548 26450 leader_election.cc:343] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.259076 26450 leader_election.cc:304] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.259861 28826 raft_consensus.cc:2749] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.266696 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:14.267254 26507 raft_consensus.cc:2468] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:14.270325 26916 tablet_bootstrap.cc:492] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.245893 28872 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:14.274503 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:14.278002 28872 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:14.291352 26912 tablet_bootstrap.cc:492] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:14.244426 26913 raft_consensus.cc:359] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.302811 26913 raft_consensus.cc:385] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.303102 26913 raft_consensus.cc:740] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.303941 26913 consensus_queue.cc:260] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.305166 28826 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.305928 26913 ts_tablet_manager.cc:1480] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.064s user 0.006s sys 0.001s
I20260928 20:03:14.305727 28826 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.308046 28826 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.309309 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.309578 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:14.311240 26450 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:14.334395 26450 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.334784 26450 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.335486 28826 raft_consensus.cc:2749] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.338651 28800 consensus_queue.cc:1048] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:14.354200 28826 raft_consensus.cc:493] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.354779 28826 raft_consensus.cc:515] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.356925 28826 leader_election.cc:290] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.359603 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.360235 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:14.362692 26594 leader_election.cc:343] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:14.364526 26740 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 54980.8us
I20260928 20:03:14.368944 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:14.369154 26450 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.369532 26655 raft_consensus.cc:2468] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:03:14.369849 26450 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.370222 26450 leader_election.cc:304] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.371076 28826 raft_consensus.cc:2749] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.384852 26916 tablet_bootstrap.cc:654] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.391572 26740 leader_election.cc:304] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:14.408144 28866 raft_consensus.cc:2804] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:14.408612 28866 raft_consensus.cc:493] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:14.408975 28866 raft_consensus.cc:3060] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.413616 26913 tablet_bootstrap.cc:492] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:14.421253 26913 tablet_bootstrap.cc:654] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:14.422081 26740 consensus_peers.cc:597] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:14.447681 28579 consensus_queue.cc:1048] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:14.462229 26912 tablet_bootstrap.cc:654] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.471112 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:14.471740 26789 raft_consensus.cc:3060] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.472666 26913 tablet_bootstrap.cc:492] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:14.473073 26913 ts_tablet_manager.cc:1449] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.002s
I20260928 20:03:14.479573 26913 raft_consensus.cc:359] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.480201 26913 raft_consensus.cc:385] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.480458 26913 raft_consensus.cc:740] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.453706 28866 raft_consensus.cc:515] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.494145 28800 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.494693 28800 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.497606 28800 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:14.498946 26595 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:14.502910 28800 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.503445 28800 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.506187 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:14.506711 26512 raft_consensus.cc:2468] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:14.507783 26595 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:14.512214 28839 raft_consensus.cc:2804] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:14.515712 28839 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:14.516048 28839 raft_consensus.cc:3060] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.526930 28839 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.529516 28839 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.525903 28800 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.530120 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:14.530671 26512 raft_consensus.cc:3060] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.547745 26512 raft_consensus.cc:2468] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:14.548995 26595 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:14.549783 28800 raft_consensus.cc:2804] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:14.550239 26916 tablet_bootstrap.cc:492] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:14.550486 28800 raft_consensus.cc:697] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:14.550698 26916 ts_tablet_manager.cc:1449] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.339s user 0.009s sys 0.054s
I20260928 20:03:14.551257 28800 consensus_queue.cc:237] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.553745 28839 consensus_queue.cc:1048] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:14.554402 26916 raft_consensus.cc:359] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.555075 26916 raft_consensus.cc:385] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.555357 26916 raft_consensus.cc:740] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.555945 26916 consensus_queue.cc:260] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.559752 26789 raft_consensus.cc:2468] T 964f7c83a1c048688ea1f3227a88bb8f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:14.562208 26916 ts_tablet_manager.cc:1480] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260928 20:03:14.562899 28866 leader_election.cc:290] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:14.563585 26916 tablet_bootstrap.cc:492] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.575337 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.577668 26916 tablet_bootstrap.cc:654] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.588773 26916 tablet_bootstrap.cc:492] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:14.589351 26916 ts_tablet_manager.cc:1449] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.010s
I20260928 20:03:14.589295 28839 consensus_queue.cc:1048] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:14.585700 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:14.589972 26510 raft_consensus.cc:3060] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.592250 26916 raft_consensus.cc:359] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.593104 26916 raft_consensus.cc:385] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.593410 26916 raft_consensus.cc:740] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.594187 26916 consensus_queue.cc:260] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:14.595916 26594 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:14.596252 26916 ts_tablet_manager.cc:1480] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260928 20:03:14.596450 26594 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.597226 28800 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:14.597442 26916 tablet_bootstrap.cc:492] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.599421 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f0f9d65836425f966e9ee4f709915c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:14.600126 26659 raft_consensus.cc:3060] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.604096 26916 tablet_bootstrap.cc:654] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.611773 28839 consensus_queue.cc:1048] T 0abf33cd0d114c25a729bd0eb8ae1278 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:14.612850 28800 raft_consensus.cc:493] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.613287 28800 raft_consensus.cc:515] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.615183 28800 leader_election.cc:290] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:14.615396 26510 raft_consensus.cc:2468] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:14.616725 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:14.617322 26512 raft_consensus.cc:2468] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:14.618621 26595 leader_election.cc:304] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:14.619511 28886 raft_consensus.cc:2804] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:14.619912 28886 raft_consensus.cc:493] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:14.620278 28886 raft_consensus.cc:3060] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.621811 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:14.575979 26799 raft_consensus.cc:2468] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:14.627476 28870 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.628294 26740 leader_election.cc:304] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:14.628046 28870 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.630553 28871 raft_consensus.cc:2804] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:14.631029 28871 raft_consensus.cc:697] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:14.640182 26913 consensus_queue.cc:260] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.640705 26916 tablet_bootstrap.cc:492] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:14.641156 26916 ts_tablet_manager.cc:1449] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.011s
I20260928 20:03:14.631942 28871 consensus_queue.cc:237] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.643637 26916 raft_consensus.cc:359] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.644304 26916 raft_consensus.cc:385] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.644570 26916 raft_consensus.cc:740] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.645188 26916 consensus_queue.cc:260] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.651798 26916 ts_tablet_manager.cc:1480] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260928 20:03:14.659835 28826 raft_consensus.cc:493] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.660279 28826 raft_consensus.cc:515] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.663173 28826 leader_election.cc:290] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.659415 26916 tablet_bootstrap.cc:492] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.682183 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.683749 26913 ts_tablet_manager.cc:1480] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.210s user 0.006s sys 0.001s
W20260928 20:03:14.684501 26450 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.684963 26916 tablet_bootstrap.cc:654] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.690979 28886 raft_consensus.cc:515] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.698041 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:14.698891 26512 raft_consensus.cc:3060] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.699061 28886 leader_election.cc:290] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:14.707726 26659 raft_consensus.cc:2468] T d9f0f9d65836425f966e9ee4f709915c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:14.710501 26512 raft_consensus.cc:2468] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:14.711784 26595 leader_election.cc:304] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:14.712492 28886 raft_consensus.cc:2804] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:14.713174 28886 raft_consensus.cc:697] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:14.713918 28886 consensus_queue.cc:237] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.725831 26913 tablet_bootstrap.cc:492] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:14.744158 28856 raft_consensus.cc:493] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.746273 28826 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.746801 28826 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.749025 28826 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.751256 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.752156 26659 raft_consensus.cc:2468] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:14.753813 26450 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:14.754932 28826 raft_consensus.cc:2804] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:14.755378 28826 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:14.755792 28826 raft_consensus.cc:3060] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.763075 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.764031 28870 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:03:14.765537 26450 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.765987 26450 leader_election.cc:304] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.749648 28856 raft_consensus.cc:515] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.769232 28826 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.794273 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.796051 28579 consensus_queue.cc:1048] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260928 20:03:14.809409 28826 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.810012 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:14.810604 26659 raft_consensus.cc:3060] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:14.824163 26916 tablet_bootstrap.cc:492] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:14.824766 26916 ts_tablet_manager.cc:1449] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.166s user 0.013s sys 0.002s
I20260928 20:03:14.827155 26916 raft_consensus.cc:359] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.828588 26916 raft_consensus.cc:385] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.828882 26916 raft_consensus.cc:740] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.831435 26916 consensus_queue.cc:260] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:14.794713 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 49629.9us
I20260928 20:03:14.840235 26916 ts_tablet_manager.cc:1480] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260928 20:03:14.840281 26659 raft_consensus.cc:2468] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:14.850831 26916 tablet_bootstrap.cc:492] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.857024 26916 tablet_bootstrap.cc:654] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.858577 28856 leader_election.cc:290] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:14.868536 26450 leader_election.cc:343] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.876899 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:14.881161 26450 leader_election.cc:343] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.887868 26916 tablet_bootstrap.cc:492] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:14.888346 26916 ts_tablet_manager.cc:1449] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.007s
I20260928 20:03:14.888208 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:14.889002 26510 raft_consensus.cc:2393] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:14.895152 28826 raft_consensus.cc:493] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.895622 28826 raft_consensus.cc:515] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.897804 28826 leader_election.cc:290] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.905936 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.906266 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:14.907020 26512 raft_consensus.cc:2393] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
W20260928 20:03:14.907632 26450 leader_election.cc:343] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:14.918931 26916 raft_consensus.cc:359] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.921200 26916 raft_consensus.cc:385] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.921761 26916 raft_consensus.cc:740] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.922659 26916 consensus_queue.cc:260] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:14.924736 26740 consensus_peers.cc:597] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d13562e920244194969520df564a949d. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:14.793957 28894 raft_consensus.cc:2749] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:14.943440 26916 ts_tablet_manager.cc:1480] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.032s user 0.004s sys 0.002s
I20260928 20:03:14.946165 26916 tablet_bootstrap.cc:492] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:14.955539 26916 tablet_bootstrap.cc:654] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.956504 26913 tablet_bootstrap.cc:654] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:14.965112 28894 raft_consensus.cc:493] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:14.965672 28894 raft_consensus.cc:515] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:14.966753 26450 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:14.967520 28826 raft_consensus.cc:2804] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:14.967705 28894 leader_election.cc:290] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:14.968042 28826 raft_consensus.cc:697] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:14.968896 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:14.968931 28826 consensus_queue.cc:237] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:14.972035 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 87909.8us
I20260928 20:03:14.973438 26916 tablet_bootstrap.cc:492] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:14.974009 26916 ts_tablet_manager.cc:1449] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.009s
W20260928 20:03:14.976058 26450 leader_election.cc:343] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:14.976903 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 229551us
I20260928 20:03:14.980659 26916 raft_consensus.cc:359] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:14.992060 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:14.994753 26912 tablet_bootstrap.cc:492] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:14.995162 26912 ts_tablet_manager.cc:1449] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.704s user 0.020s sys 0.002s
I20260928 20:03:14.997697 26916 raft_consensus.cc:385] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:14.998515 26916 raft_consensus.cc:740] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:14.999662 26916 consensus_queue.cc:260] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:15.006779 28628 consensus_queue.cc:1048] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:15.007939 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.009500 26916 ts_tablet_manager.cc:1480] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.035s user 0.004s sys 0.002s
W20260928 20:03:15.009353 26450 leader_election.cc:343] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.009956 26450 leader_election.cc:304] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.010692 28826 raft_consensus.cc:2749] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:15.011309 26450 leader_election.cc:343] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.011718 26450 leader_election.cc:304] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.012415 28826 raft_consensus.cc:2749] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:15.029803 28838 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
W20260928 20:03:15.030356 26148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 56861us
I20260928 20:03:15.030306 28838 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.032270 28838 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:15.032925 28826 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.033422 28826 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.036132 28826 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.011916 26916 tablet_bootstrap.cc:492] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.037127 26912 raft_consensus.cc:359] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.037771 26912 raft_consensus.cc:385] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.038013 26912 raft_consensus.cc:740] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.038646 26912 consensus_queue.cc:260] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.040644 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.040627 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:15.042219 26450 leader_election.cc:343] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:15.042865 26450 leader_election.cc:343] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.043226 26450 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.043895 28826 raft_consensus.cc:2749] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:15.053540 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 47001.5us
I20260928 20:03:15.063494 26912 ts_tablet_manager.cc:1480] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260928 20:03:15.064476 26912 tablet_bootstrap.cc:492] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:15.067703 28826 raft_consensus.cc:493] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.068117 28826 raft_consensus.cc:515] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.070308 26916 tablet_bootstrap.cc:654] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.070246 28628 consensus_queue.cc:1048] T 8cbffea517e2438d90ca234b9f72f733 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.075191 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:15.078146 28826 leader_election.cc:290] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:15.086617 26450 leader_election.cc:343] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:15.114149 26594 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:15.114562 26594 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.116252 28800 raft_consensus.cc:2749] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:15.116955 28800 consensus_queue.cc:1048] T 78c5918f0c05420b8ed8885c18c63907 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.123096 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:15.136731 26595 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:15.137658 28838 consensus_queue.cc:1048] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.145710 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.150534 28838 consensus_queue.cc:1048] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.152475 28826 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.152943 28826 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.155040 28826 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.156520 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:15.161674 26450 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.175736 26913 tablet_bootstrap.cc:492] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:15.176223 26913 ts_tablet_manager.cc:1449] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.451s user 0.009s sys 0.009s
I20260928 20:03:15.203943 26912 tablet_bootstrap.cc:654] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.213122 28826 raft_consensus.cc:493] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.213593 28826 raft_consensus.cc:515] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.215716 28826 leader_election.cc:290] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.226078 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:15.230497 26450 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.232537 26916 tablet_bootstrap.cc:492] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.233036 26916 ts_tablet_manager.cc:1449] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.222s user 0.013s sys 0.003s
I20260928 20:03:15.213725 26913 raft_consensus.cc:359] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.253103 26913 raft_consensus.cc:385] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.253470 26913 raft_consensus.cc:740] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.254084 26913 consensus_queue.cc:260] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.257835 26913 ts_tablet_manager.cc:1480] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.081s user 0.003s sys 0.003s
I20260928 20:03:15.258816 26913 tablet_bootstrap.cc:492] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:15.258819 28826 raft_consensus.cc:493] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.259275 28826 raft_consensus.cc:515] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:15.261307 28826 leader_election.cc:290] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.263710 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:15.265512 26450 leader_election.cc:343] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.267596 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.278434 28826 raft_consensus.cc:493] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.279152 28826 raft_consensus.cc:515] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.282302 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:15.282850 26797 raft_consensus.cc:2468] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:15.281527 28826 leader_election.cc:290] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.287757 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:15.289529 26450 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.294905 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.310783 26916 raft_consensus.cc:359] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.311179 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.311445 26916 raft_consensus.cc:385] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.311708 26916 raft_consensus.cc:740] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.312381 26916 consensus_queue.cc:260] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.312722 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.318769 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db52eb6b080457583b0a59291995843" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:15.319403 26793 raft_consensus.cc:3060] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:15.330171 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.336304 26793 raft_consensus.cc:2468] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:15.336757 26912 tablet_bootstrap.cc:492] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:15.337162 26912 ts_tablet_manager.cc:1449] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.273s user 0.007s sys 0.002s
W20260928 20:03:15.342281 26450 leader_election.cc:343] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.342705 26450 leader_election.cc:304] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:15.344223 26450 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.344635 26450 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.345304 28895 raft_consensus.cc:2749] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:15.345598 26450 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.346309 28894 raft_consensus.cc:2749] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:15.345988 26450 leader_election.cc:304] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.352643 28826 raft_consensus.cc:2749] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:15.372367 26912 raft_consensus.cc:359] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.373056 26912 raft_consensus.cc:385] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.358304 26916 ts_tablet_manager.cc:1480] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.125s user 0.008s sys 0.000s
I20260928 20:03:15.365720 28826 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.398669 28826 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.404784 28826 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.422207 26912 raft_consensus.cc:740] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.422943 26912 consensus_queue.cc:260] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.425036 26912 ts_tablet_manager.cc:1480] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.088s user 0.003s sys 0.003s
I20260928 20:03:15.473896 28800 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.474570 28800 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.477711 28800 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:15.480325 26916 tablet_bootstrap.cc:492] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.486564 26916 tablet_bootstrap.cc:654] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:15.516741 26594 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:15.517220 26594 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:15.518388 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.683s (SENT)
I20260928 20:03:15.518893 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:15.520144 28898 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:15.523787 26916 tablet_bootstrap.cc:492] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.524210 26916 ts_tablet_manager.cc:1449] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.044s user 0.011s sys 0.000s
I20260928 20:03:15.527005 26916 raft_consensus.cc:359] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.527612 26916 raft_consensus.cc:385] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.527856 26916 raft_consensus.cc:740] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.528396 26916 consensus_queue.cc:260] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.530632 26916 ts_tablet_manager.cc:1480] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:03:15.531545 26916 tablet_bootstrap.cc:492] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.532593 26913 tablet_bootstrap.cc:654] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.548569 26916 tablet_bootstrap.cc:654] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.550894 28924 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 20:03:15.554710 28870 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.555143 28870 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.558203 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:15.558799 26507 raft_consensus.cc:2468] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:15.560025 26740 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:15.560729 28871 raft_consensus.cc:2804] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:15.561026 28871 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:15.561301 28871 raft_consensus.cc:3060] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:15.570312 28870 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:15.569732 28871 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.573340 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:15.573820 26507 raft_consensus.cc:3060] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:15.576638 26916 tablet_bootstrap.cc:492] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.577039 26916 ts_tablet_manager.cc:1449] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.046s user 0.006s sys 0.007s
I20260928 20:03:15.577893 28898 consensus_queue.cc:1048] T 964f7c83a1c048688ea1f3227a88bb8f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.579461 26916 raft_consensus.cc:359] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:15.580050 26916 raft_consensus.cc:385] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.580288 26916 raft_consensus.cc:740] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.580919 26916 consensus_queue.cc:260] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:15.591706 26507 raft_consensus.cc:2468] T 4056bc0590264672bd7c4f6d97050dd5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:15.593134 26916 ts_tablet_manager.cc:1480] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260928 20:03:15.592991 26740 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:15.594031 26916 tablet_bootstrap.cc:492] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.593961 28870 raft_consensus.cc:2804] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:15.594859 28870 raft_consensus.cc:697] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:15.595960 28870 consensus_queue.cc:237] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.598258 26912 tablet_bootstrap.cc:492] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:15.604138 26912 tablet_bootstrap.cc:654] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.616076 26913 tablet_bootstrap.cc:492] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:15.619024 26916 tablet_bootstrap.cc:654] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.630245 28871 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:15.356540 26450 leader_election.cc:343] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.634543 26450 leader_election.cc:304] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.635286 28826 raft_consensus.cc:2749] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:15.635433 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 279234us
I20260928 20:03:15.636422 26912 tablet_bootstrap.cc:492] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:15.636991 26912 ts_tablet_manager.cc:1449] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.000s
I20260928 20:03:15.637097 28826 raft_consensus.cc:493] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.637492 28826 raft_consensus.cc:515] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:15.639478 28826 leader_election.cc:290] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.640919 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:15.645961 26799 raft_consensus.cc:3060] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:15.648063 26916 tablet_bootstrap.cc:492] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.648506 26916 ts_tablet_manager.cc:1449] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.055s user 0.011s sys 0.008s
I20260928 20:03:15.650893 26916 raft_consensus.cc:359] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.651526 26916 raft_consensus.cc:385] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.651758 26916 raft_consensus.cc:740] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.652494 26916 consensus_queue.cc:260] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.616506 26913 ts_tablet_manager.cc:1449] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.358s user 0.006s sys 0.003s
I20260928 20:03:15.659356 26913 raft_consensus.cc:359] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.660005 26913 raft_consensus.cc:385] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.660259 26913 raft_consensus.cc:740] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.661569 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.662417 28826 raft_consensus.cc:493] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.662876 28826 raft_consensus.cc:515] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.663401 26912 raft_consensus.cc:359] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.664045 26912 raft_consensus.cc:385] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.664273 26912 raft_consensus.cc:740] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.664884 26912 consensus_queue.cc:260] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.667311 28826 leader_election.cc:290] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.673882 26912 ts_tablet_manager.cc:1480] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.037s user 0.007s sys 0.000s
I20260928 20:03:15.681123 26916 ts_tablet_manager.cc:1480] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260928 20:03:15.687587 26797 raft_consensus.cc:3060] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:15.692502 26912 tablet_bootstrap.cc:492] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:15.704144 26916 tablet_bootstrap.cc:492] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.714798 26916 tablet_bootstrap.cc:654] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.728716 26739 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:15.729658 28856 raft_consensus.cc:2749] T 30ef26307b9a459f8634d59b1ca373ef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:15.731091 26913 consensus_queue.cc:260] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.733944 26913 ts_tablet_manager.cc:1480] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.077s user 0.005s sys 0.000s
W20260928 20:03:15.735193 26148 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.700s (SENT)
I20260928 20:03:15.735572 26148 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd517ada41af42d8b8d85ba1e657e003; no voters: 0b347187d9be4ad08708acffdf4dda63, 5308dad1e3384995a990de7c4866f1b1
I20260928 20:03:15.743733 26916 tablet_bootstrap.cc:492] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.744128 26916 ts_tablet_manager.cc:1449] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.000s
I20260928 20:03:15.750401 26739 leader_election.cc:304] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:15.750617 26916 raft_consensus.cc:359] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.751937 28856 raft_consensus.cc:2749] T 9db52eb6b080457583b0a59291995843 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:15.751343 26916 raft_consensus.cc:385] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.752411 26916 raft_consensus.cc:740] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.753360 26913 tablet_bootstrap.cc:492] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:15.753868 26916 consensus_queue.cc:260] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.762585 28933 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 20:03:15.763310 26916 ts_tablet_manager.cc:1480] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260928 20:03:15.771653 26912 tablet_bootstrap.cc:654] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.775979 28871 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.776557 28871 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.779408 28856 consensus_queue.cc:1048] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.785704 28898 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.785852 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:15.786260 28898 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:15.788409 26450 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:15.788775 26450 leader_election.cc:304] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:15.789410 28826 raft_consensus.cc:2749] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:15.789718 26450 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:15.790809 26595 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:15.792930 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:15.795629 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:15.801911 28871 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:15.803324 26916 tablet_bootstrap.cc:492] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.805121 28800 consensus_queue.cc:1048] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.806488 28826 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.806931 28826 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.807340 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.808591 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:15.808916 28826 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.812815 26916 tablet_bootstrap.cc:654] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.815369 26913 tablet_bootstrap.cc:654] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.825868 28898 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:15.835664 26916 tablet_bootstrap.cc:492] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.836162 26916 ts_tablet_manager.cc:1449] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.007s
I20260928 20:03:15.838754 26916 raft_consensus.cc:359] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.839540 26916 raft_consensus.cc:385] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.842206 26916 raft_consensus.cc:740] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.842900 26916 consensus_queue.cc:260] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.848351 26916 ts_tablet_manager.cc:1480] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260928 20:03:15.849786 26916 tablet_bootstrap.cc:492] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.839987 26913 tablet_bootstrap.cc:492] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:15.854417 26913 ts_tablet_manager.cc:1449] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.101s user 0.010s sys 0.000s
I20260928 20:03:15.860065 26913 raft_consensus.cc:359] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.860736 26913 raft_consensus.cc:385] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.861016 26913 raft_consensus.cc:740] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.862367 28826 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.862813 26916 tablet_bootstrap.cc:654] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.862882 28826 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.864120 26912 tablet_bootstrap.cc:492] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:15.864486 26912 ts_tablet_manager.cc:1449] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.172s user 0.011s sys 0.000s
I20260928 20:03:15.864887 28826 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.867123 26912 raft_consensus.cc:359] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.867832 26912 raft_consensus.cc:385] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.868126 26912 raft_consensus.cc:740] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.868831 26912 consensus_queue.cc:260] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.880975 26916 tablet_bootstrap.cc:492] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.881438 26916 ts_tablet_manager.cc:1449] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.000s
I20260928 20:03:15.861677 26913 consensus_queue.cc:260] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.883797 26916 raft_consensus.cc:359] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.884410 26916 raft_consensus.cc:385] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.884658 26916 raft_consensus.cc:740] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.885340 26916 consensus_queue.cc:260] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.891185 26916 ts_tablet_manager.cc:1480] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260928 20:03:15.894651 26913 ts_tablet_manager.cc:1480] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260928 20:03:15.895615 26913 tablet_bootstrap.cc:492] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:15.896613 26912 ts_tablet_manager.cc:1480] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260928 20:03:15.896842 28826 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.897349 28826 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.899473 28826 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.901345 26916 tablet_bootstrap.cc:492] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.912817 26916 tablet_bootstrap.cc:654] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.924681 28826 raft_consensus.cc:493] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.925206 28826 raft_consensus.cc:515] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.927376 28826 leader_election.cc:290] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.925735 28898 raft_consensus.cc:493] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.927955 28898 raft_consensus.cc:515] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:15.931465 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 126854us
I20260928 20:03:15.933593 26912 tablet_bootstrap.cc:492] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:15.935525 28898 leader_election.cc:290] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:15.935737 26916 tablet_bootstrap.cc:492] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.936148 26916 ts_tablet_manager.cc:1449] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.015s
I20260928 20:03:15.936654 28898 consensus_queue.cc:1048] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:15.938177 28826 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.938688 28826 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.940738 28826 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:15.942580 26916 raft_consensus.cc:359] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.943182 26916 raft_consensus.cc:385] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.943450 26916 raft_consensus.cc:740] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.944165 26916 consensus_queue.cc:260] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.946213 26916 ts_tablet_manager.cc:1480] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.010s user 0.004s sys 0.003s
I20260928 20:03:15.947090 26916 tablet_bootstrap.cc:492] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:15.952625 26916 tablet_bootstrap.cc:654] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:15.966557 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 82977.8us
I20260928 20:03:15.970194 28856 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:15.970757 28856 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.974216 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:15.974946 26913 tablet_bootstrap.cc:654] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:15.991005 26916 tablet_bootstrap.cc:492] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:15.991497 26916 ts_tablet_manager.cc:1449] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.002s
I20260928 20:03:15.995200 26916 raft_consensus.cc:359] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.995796 26916 raft_consensus.cc:385] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:15.996058 26916 raft_consensus.cc:740] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:15.996862 26916 consensus_queue.cc:260] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:15.998916 26916 ts_tablet_manager.cc:1480] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260928 20:03:15.999747 26916 tablet_bootstrap.cc:492] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:15.999966 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 61914.9us
I20260928 20:03:16.015484 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.015947 26913 tablet_bootstrap.cc:492] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:16.016091 26646 raft_consensus.cc:2468] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:16.016347 26913 ts_tablet_manager.cc:1449] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.121s user 0.005s sys 0.004s
I20260928 20:03:16.018061 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:16.018595 26646 raft_consensus.cc:3060] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.026029 26646 raft_consensus.cc:2468] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:16.031751 26912 tablet_bootstrap.cc:654] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:16.034489 26450 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.034860 26450 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:16.035918 26450 leader_election.cc:343] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:16.036432 26450 leader_election.cc:343] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.037242 28949 raft_consensus.cc:493] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.037874 28826 raft_consensus.cc:2749] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:16.037623 28949 raft_consensus.cc:515] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:16.042852 28856 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.044075 28949 leader_election.cc:290] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.052702 26916 tablet_bootstrap.cc:654] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.074904 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.076701 26916 tablet_bootstrap.cc:492] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:16.076620 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.077116 26916 ts_tablet_manager.cc:1449] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.078s user 0.009s sys 0.001s
I20260928 20:03:16.078004 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.079437 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.080827 26916 raft_consensus.cc:359] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:16.081264 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.081538 26916 raft_consensus.cc:385] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.081801 26916 raft_consensus.cc:740] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.082562 26916 consensus_queue.cc:260] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:16.082825 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.084684 26916 ts_tablet_manager.cc:1480] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260928 20:03:16.085382 26793 raft_consensus.cc:3060] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.085632 26916 tablet_bootstrap.cc:492] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:16.095738 26913 raft_consensus.cc:359] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.096455 26913 raft_consensus.cc:385] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.096726 26913 raft_consensus.cc:740] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.097329 26913 consensus_queue.cc:260] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:16.098749 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 58850.5us
I20260928 20:03:16.102465 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.102697 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.103511 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.103644 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.104904 28949 raft_consensus.cc:493] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.105494 28949 raft_consensus.cc:515] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.106446 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.107975 28949 leader_election.cc:290] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.113071 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.113859 26652 raft_consensus.cc:2393] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:16.117623 26916 tablet_bootstrap.cc:654] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.061538 28955 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:16.123291 28955 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:16.126075 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:16.130496 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.131343 26913 ts_tablet_manager.cc:1480] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.115s user 0.006s sys 0.001s
I20260928 20:03:16.138581 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.143853 28954 raft_consensus.cc:493] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.144359 28954 raft_consensus.cc:515] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.166388 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:16.167052 26507 raft_consensus.cc:2468] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:16.175067 26912 tablet_bootstrap.cc:492] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:16.175488 26912 ts_tablet_manager.cc:1449] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.242s user 0.010s sys 0.000s
I20260928 20:03:16.179296 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:16.179929 26506 raft_consensus.cc:2468] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:16.180903 26450 leader_election.cc:343] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.181255 26450 leader_election.cc:304] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:16.182955 28826 raft_consensus.cc:2749] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:16.187141 28954 leader_election.cc:290] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.191709 26916 tablet_bootstrap.cc:492] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:16.192106 26916 ts_tablet_manager.cc:1449] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.107s user 0.018s sys 0.007s
I20260928 20:03:16.194484 28955 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:16.194550 26916 raft_consensus.cc:359] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.201185 26916 raft_consensus.cc:385] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.203150 26916 raft_consensus.cc:740] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.204797 26916 consensus_queue.cc:260] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.205933 28826 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.206383 28826 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.206925 26916 ts_tablet_manager.cc:1480] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260928 20:03:16.208233 26913 tablet_bootstrap.cc:492] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:16.214614 26913 tablet_bootstrap.cc:654] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.218881 26916 tablet_bootstrap.cc:492] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:16.219260 26595 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 59801.1us
I20260928 20:03:16.225401 26913 tablet_bootstrap.cc:492] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:16.225837 26913 ts_tablet_manager.cc:1449] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.000s
I20260928 20:03:16.226722 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.227201 26797 raft_consensus.cc:2468] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:16.228272 28951 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.228744 28951 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.230774 28951 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.232492 26913 raft_consensus.cc:359] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.233173 26913 raft_consensus.cc:385] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.233448 26913 raft_consensus.cc:740] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.234162 26913 consensus_queue.cc:260] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.242372 28937 consensus_queue.cc:1048] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:16.246657 28937 consensus_queue.cc:1048] T 30ef26307b9a459f8634d59b1ca373ef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:16.249239 26594 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:16.249662 26594 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:16.250667 28937 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:16.256418 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.263891 26912 raft_consensus.cc:359] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.264556 26912 raft_consensus.cc:385] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.264801 26912 raft_consensus.cc:740] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.265411 26912 consensus_queue.cc:260] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.280175 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.280762 26658 raft_consensus.cc:2468] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:16.281916 28937 consensus_queue.cc:1048] T 9db52eb6b080457583b0a59291995843 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:16.284385 26594 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:16.286221 28937 raft_consensus.cc:2804] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:16.286600 28937 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:16.287081 28937 raft_consensus.cc:3060] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.294781 26913 ts_tablet_manager.cc:1480] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.069s user 0.007s sys 0.000s
I20260928 20:03:16.304610 26913 tablet_bootstrap.cc:492] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:16.313333 26739 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:16.294721 28937 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.320351 28945 raft_consensus.cc:2749] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:16.297037 26594 leader_election.cc:343] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.328032 28937 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.336760 26913 tablet_bootstrap.cc:654] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.343075 28944 consensus_queue.cc:1048] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:16.352713 26739 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:16.353681 28948 raft_consensus.cc:2749] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:16.382501 26739 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:16.384001 28948 raft_consensus.cc:2804] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:16.384374 28948 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:16.384722 28948 raft_consensus.cc:3060] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.397110 26912 ts_tablet_manager.cc:1480] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.221s user 0.006s sys 0.000s
I20260928 20:03:16.405145 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:16.405727 26512 raft_consensus.cc:2468] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:16.284322 28954 raft_consensus.cc:493] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.413496 28949 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.434319 26916 tablet_bootstrap.cc:654] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.440039 28935 consensus_queue.cc:1048] T d9f0f9d65836425f966e9ee4f709915c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:16.416201 28954 raft_consensus.cc:515] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.449522 28954 leader_election.cc:290] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.443166 28826 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.437469 28949 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.451993 28949 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:16.478466 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 297567us
W20260928 20:03:16.479254 26450 leader_election.cc:343] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.483450 28871 consensus_queue.cc:1048] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:16.489259 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 106826us
I20260928 20:03:16.514856 26450 leader_election.cc:304] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:16.515849 28963 raft_consensus.cc:2749] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:16.516963 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:16.517668 26450 leader_election.cc:343] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:16.522852 26221 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8cbffea517e2438d90ca234b9f72f733 consensus state has no leader
I20260928 20:03:16.531697 26916 tablet_bootstrap.cc:492] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:16.532124 26916 ts_tablet_manager.cc:1449] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.313s user 0.006s sys 0.005s
I20260928 20:03:16.534646 26916 raft_consensus.cc:359] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.535400 26916 raft_consensus.cc:385] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.535655 26916 raft_consensus.cc:740] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.536249 26916 consensus_queue.cc:260] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.544715 28963 raft_consensus.cc:493] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.545217 28963 raft_consensus.cc:515] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:16.547456 28963 leader_election.cc:290] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.563979 26912 tablet_bootstrap.cc:492] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:16.576557 26916 ts_tablet_manager.cc:1480] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.008s sys 0.000s
I20260928 20:03:16.577044 26913 tablet_bootstrap.cc:492] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:16.577507 26913 ts_tablet_manager.cc:1449] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.273s user 0.042s sys 0.032s
I20260928 20:03:16.577569 26916 tablet_bootstrap.cc:492] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:16.584309 26913 raft_consensus.cc:359] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.585032 26913 raft_consensus.cc:385] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.585352 26913 raft_consensus.cc:740] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.600804 28948 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.601449 26913 consensus_queue.cc:260] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.611143 28963 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.611996 26913 ts_tablet_manager.cc:1480] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.034s user 0.001s sys 0.005s
I20260928 20:03:16.611749 28963 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.613870 28963 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:16.621456 26450 leader_election.cc:343] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:16.634884 26450 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.644646 28800 raft_consensus.cc:493] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.645081 28800 raft_consensus.cc:515] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.648072 28800 leader_election.cc:290] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.633965 28963 raft_consensus.cc:493] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.659262 28963 raft_consensus.cc:515] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.661592 28963 leader_election.cc:290] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:16.662982 26450 leader_election.cc:343] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.666311 26913 tablet_bootstrap.cc:492] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:16.674463 28800 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.675055 28800 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.677805 28800 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.678936 26913 tablet_bootstrap.cc:654] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:16.686412 26450 leader_election.cc:343] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:16.687894 28963 consensus_queue.cc:1048] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:16.688156 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.702054 26913 tablet_bootstrap.cc:492] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:16.702510 26913 ts_tablet_manager.cc:1449] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.002s
I20260928 20:03:16.705430 26913 raft_consensus.cc:359] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.706074 26913 raft_consensus.cc:385] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.706342 26913 raft_consensus.cc:740] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.706903 26913 consensus_queue.cc:260] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.708237 26913 ts_tablet_manager.cc:1480] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260928 20:03:16.709074 26913 tablet_bootstrap.cc:492] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:16.645356 26916 tablet_bootstrap.cc:654] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.732123 26595 leader_election.cc:304] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:16.734175 27822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.541s (SENT) [suppressed 1 similar messages]
I20260928 20:03:16.734472 28957 raft_consensus.cc:2804] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:16.734792 28957 raft_consensus.cc:493] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:16.735137 28957 raft_consensus.cc:3060] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.737804 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.752398 26913 tablet_bootstrap.cc:654] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.709098 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:16.759958 26789 raft_consensus.cc:2393] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:16.749366 28957 raft_consensus.cc:515] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.762456 28957 leader_election.cc:290] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.729602 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:16.776932 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 43867us
I20260928 20:03:16.730378 26912 tablet_bootstrap.cc:654] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.733379 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.791911 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.792497 26655 raft_consensus.cc:2468] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:16.792424 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.793423 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.794193 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.796396 26916 tablet_bootstrap.cc:492] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:16.796831 26916 ts_tablet_manager.cc:1449] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.219s user 0.009s sys 0.000s
I20260928 20:03:16.801707 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.802147 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.802517 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.803232 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.804597 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.811717 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:16.812290 26504 raft_consensus.cc:3060] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.810511 28948 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:16.835224 26913 tablet_bootstrap.cc:492] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:16.835632 26913 ts_tablet_manager.cc:1449] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.127s user 0.022s sys 0.010s
I20260928 20:03:16.845434 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.837894 26913 raft_consensus.cc:359] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.846796 26913 raft_consensus.cc:385] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.847067 26913 raft_consensus.cc:740] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.847689 26913 consensus_queue.cc:260] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.850348 26504 raft_consensus.cc:2468] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:16.865945 26913 ts_tablet_manager.cc:1480] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260928 20:03:16.876323 26916 raft_consensus.cc:359] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.877082 26916 raft_consensus.cc:385] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:16.877349 26916 raft_consensus.cc:740] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:16.884769 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:16.885411 26803 raft_consensus.cc:3060] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:16.888280 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6ff2fe1d054eeebeebc6b3b5b5e4c1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.893707 26740 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:16.882923 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:16.898912 26913 tablet_bootstrap.cc:492] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:16.907600 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.912110 28963 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.912626 28963 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.913686 26913 tablet_bootstrap.cc:654] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:16.914564 28963 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.914969 28963 raft_consensus.cc:493] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.915333 28963 raft_consensus.cc:515] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.917070 28963 leader_election.cc:290] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.926869 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:16.927119 28949 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.927587 26646 raft_consensus.cc:2393] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:16.927536 28949 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.929307 28949 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:16.930651 28949 raft_consensus.cc:493] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:16.931107 28949 raft_consensus.cc:515] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.933089 28949 leader_election.cc:290] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:16.943756 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 50151.4us
I20260928 20:03:16.944475 28951 raft_consensus.cc:2804] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:16.946054 26803 raft_consensus.cc:2468] T 21cb34c5e33544c9875e7babf4830164 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:16.955018 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:16.954375 28951 raft_consensus.cc:697] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:16.960806 28951 consensus_queue.cc:237] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:16.979518 26913 tablet_bootstrap.cc:492] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:16.979977 26913 ts_tablet_manager.cc:1449] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.081s user 0.006s sys 0.003s
I20260928 20:03:17.003979 26913 raft_consensus.cc:359] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.005793 26913 raft_consensus.cc:385] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.006058 26913 raft_consensus.cc:740] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:17.006675 26913 consensus_queue.cc:260] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.020952 26916 consensus_queue.cc:260] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.027269 26913 ts_tablet_manager.cc:1480] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.047s user 0.007s sys 0.000s
I20260928 20:03:17.028183 26913 tablet_bootstrap.cc:492] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:17.049101 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 121365us
I20260928 20:03:17.055316 28949 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.055787 28949 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:17.056545 26594 leader_election.cc:343] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.057590 28949 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:17.062287 26594 leader_election.cc:343] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:17.059479 26450 leader_election.cc:343] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.068216 26450 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:17.066370 28949 raft_consensus.cc:493] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.069238 28949 raft_consensus.cc:515] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.070855 26913 tablet_bootstrap.cc:654] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:17.071508 28949 leader_election.cc:290] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.067708 26916 ts_tablet_manager.cc:1480] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.271s user 0.005s sys 0.001s
W20260928 20:03:17.085361 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 62685.4us
I20260928 20:03:17.087975 28963 raft_consensus.cc:2749] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:17.088143 28628 consensus_queue.cc:1048] T 4056bc0590264672bd7c4f6d97050dd5 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:17.089491 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 153353us
W20260928 20:03:17.090293 26450 leader_election.cc:343] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.091238 28963 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.091784 28963 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.094167 28963 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.096199 28992 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:17.096659 28992 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:17.098744 28992 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:17.100229 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:17.100785 27924 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd517ada41af42d8b8d85ba1e657e003 in term 4.
I20260928 20:03:17.102486 26916 tablet_bootstrap.cc:492] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:17.103874 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003; no voters:
I20260928 20:03:17.105406 26913 tablet_bootstrap.cc:492] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:17.105887 26913 ts_tablet_manager.cc:1449] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.078s user 0.009s sys 0.000s
I20260928 20:03:17.108381 26913 raft_consensus.cc:359] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.109076 26913 raft_consensus.cc:385] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.109337 26913 raft_consensus.cc:740] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:17.109266 28992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 20:03:17.109761 28992 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5308dad1e3384995a990de7c4866f1b1)
I20260928 20:03:17.110193 28992 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 4 FOLLOWER]: Advancing to term 5
I20260928 20:03:17.124974 26913 consensus_queue.cc:260] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.125571 28949 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.126183 28949 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:17.127513 26913 ts_tablet_manager.cc:1480] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.021s user 0.004s sys 0.001s
I20260928 20:03:17.128486 28949 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.133893 28992 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:17.148878 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd517ada41af42d8b8d85ba1e657e003" candidate_term: 5 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63"
I20260928 20:03:17.149467 27924 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 4 FOLLOWER]: Advancing to term 5
I20260928 20:03:17.158064 27924 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd517ada41af42d8b8d85ba1e657e003 in term 5.
I20260928 20:03:17.160254 28981 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.160898 28981 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.161877 26146 leader_election.cc:304] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003; no voters:
I20260928 20:03:17.163316 28981 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.172894 28992 leader_election.cc:290] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 election: Requested vote from peers 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:17.178043 28992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 5 FOLLOWER]: Leader election won for term 5
I20260928 20:03:17.180197 28992 raft_consensus.cc:697] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 5 LEADER]: Becoming Leader. State: Replica: fd517ada41af42d8b8d85ba1e657e003, State: Running, Role: LEADER
I20260928 20:03:17.183975 28992 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 621, Committed index: 621, Last appended: 4.621, Last appended by leader: 621, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:17.195999 27924 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Rejecting Update request from peer 5308dad1e3384995a990de7c4866f1b1 for earlier term 4. Current term is 5. Ops: []
I20260928 20:03:17.198184 28998 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 }, Status: INVALID_TERM, Last received: 4.621, Next index: 622, Last known committed idx: 621, Time since last communication: 0.001s
I20260928 20:03:17.199759 28998 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260928 20:03:17.200342 28998 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5308dad1e3384995a990de7c4866f1b1, State: Running, Role: LEADER
I20260928 20:03:17.090735 26450 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:17.202270 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 112006us
W20260928 20:03:17.203069 26450 leader_election.cc:343] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.203502 26450 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:17.204506 26171 raft_consensus.cc:1240] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [term 5 LEADER]: Rejecting Update request from peer 5308dad1e3384995a990de7c4866f1b1 for earlier term 4. Current term is 5. Ops: []
I20260928 20:03:17.206718 28997 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd517ada41af42d8b8d85ba1e657e003. Latest consensus state: current_term: 5 leader_uuid: "fd517ada41af42d8b8d85ba1e657e003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:17.207686 28997 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: LEADER
I20260928 20:03:17.203367 28998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 621, Committed index: 621, Last appended: 4.621, Last appended by leader: 621, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:17.211179 29001 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260928 20:03:17.215193 28998 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 4 FOLLOWER]: Advancing to term 5
I20260928 20:03:17.241768 28963 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.246538 28963 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.248854 28963 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.249415 28963 raft_consensus.cc:2749] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:17.244302 28949 raft_consensus.cc:2749] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:17.273138 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 70091.3us
W20260928 20:03:17.279692 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 193617us
I20260928 20:03:17.300812 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026]
I20260928 20:03:17.302673 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_faf293f941b845a992e4a5bc2f0d8e97 [id=00b3eb91544b41a1ab2a3b09f4f003ba]
W20260928 20:03:17.274040 26450 leader_election.cc:343] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.312374 26450 leader_election.cc:304] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:17.313529 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.313941 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]
I20260928 20:03:17.313907 26450 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:17.314329 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.541s (SENT)
I20260928 20:03:17.314776 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:17.315585 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]
I20260928 20:03:17.317298 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_18c37f8dfcdb47169eb7230ea02b7b2a [id=03435de0a7f1414ca9387b9a6695e4a4]
I20260928 20:03:17.318763 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02]
I20260928 20:03:17.321503 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29]
I20260928 20:03:17.344875 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]
I20260928 20:03:17.346585 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]
I20260928 20:03:17.352563 26913 tablet_bootstrap.cc:492] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:17.360790 28949 raft_consensus.cc:2749] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:17.364658 28949 raft_consensus.cc:2749] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:17.379423 26912 tablet_bootstrap.cc:492] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:17.373293 29002 raft_consensus.cc:493] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.395160 26913 tablet_bootstrap.cc:654] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:17.406483 26912 ts_tablet_manager.cc:1449] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.843s user 0.028s sys 0.040s
I20260928 20:03:17.407742 28963 raft_consensus.cc:493] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.408231 28963 raft_consensus.cc:515] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.410264 28963 leader_election.cc:290] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.418493 29006 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260928 20:03:17.420936 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 139113us
W20260928 20:03:17.422160 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 107852us
I20260928 20:03:17.437009 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb]
I20260928 20:03:17.441944 26912 raft_consensus.cc:359] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.442698 26912 raft_consensus.cc:385] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.442950 26912 raft_consensus.cc:740] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:17.443506 26912 consensus_queue.cc:260] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.479779 26916 tablet_bootstrap.cc:654] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:17.486496 26594 leader_election.cc:304] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:17.487323 28981 raft_consensus.cc:2804] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:17.487733 28981 raft_consensus.cc:697] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:17.488454 28981 consensus_queue.cc:237] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.488669 29002 raft_consensus.cc:515] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:17.490819 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 177311us
W20260928 20:03:17.491443 26450 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.491778 26450 leader_election.cc:304] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:17.493096 28963 raft_consensus.cc:2749] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:17.493662 28963 consensus_queue.cc:1048] T b97ad3f841f54aa38bbb312c50db384e P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:17.505614 26913 tablet_bootstrap.cc:492] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:17.509039 26912 ts_tablet_manager.cc:1480] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.102s user 0.005s sys 0.000s
I20260928 20:03:17.509948 26912 tablet_bootstrap.cc:492] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:17.513294 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]
I20260928 20:03:17.514570 26913 ts_tablet_manager.cc:1449] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.162s user 0.010s sys 0.002s
I20260928 20:03:17.531546 29002 leader_election.cc:290] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.560681 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_99563ab39a854e5d9d4d2968f07bfe84 [id=0c98275433a24292b35617002df2cf6b]
I20260928 20:03:17.561573 29002 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.562000 29002 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.563823 29002 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:17.570312 26450 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.517125 26913 raft_consensus.cc:359] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:17.571192 26450 leader_election.cc:343] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.571059 26913 raft_consensus.cc:385] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.571617 26913 raft_consensus.cc:740] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:03:17.571713 26450 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:17.572180 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:17.572664 26450 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:17.573148 26450 leader_election.cc:343] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:17.573627 26450 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:17.579358 26913 consensus_queue.cc:260] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.581126 28898 raft_consensus.cc:493] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.581533 28898 raft_consensus.cc:515] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.583350 28898 leader_election.cc:290] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.583745 28898 raft_consensus.cc:493] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.585145 28998 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.585633 28998 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:17.586669 28898 raft_consensus.cc:515] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.588013 27924 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Refusing update from remote peer fd517ada41af42d8b8d85ba1e657e003: Log matching property violated. Preceding OpId in replica: term: 4 index: 621. Preceding OpId from leader: term: 5 index: 622. (index mismatch)
I20260928 20:03:17.588742 28998 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:17.590190 28898 leader_election.cc:290] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.591245 28992 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 622, Last known committed idx: 621, Time since last communication: 0.000s
I20260928 20:03:17.593688 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
W20260928 20:03:17.610117 26740 consensus_peers.cc:597] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:17.614382 29006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd517ada41af42d8b8d85ba1e657e003. Latest consensus state: current_term: 5 leader_uuid: "fd517ada41af42d8b8d85ba1e657e003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:17.615330 29006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:03:17.620045 26912 tablet_bootstrap.cc:654] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:17.625944 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]
I20260928 20:03:17.627638 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_007ea4b1225442a2b70ad99fa3bafe73 [id=0d8dd739f4ba4c9baeccfb6cd40490c3]
I20260928 20:03:17.629092 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b]
I20260928 20:03:17.631486 26913 ts_tablet_manager.cc:1480] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.117s user 0.004s sys 0.001s
I20260928 20:03:17.632910 26913 tablet_bootstrap.cc:492] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:17.638581 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:17.639389 26797 raft_consensus.cc:2468] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:17.689745 29006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "fd517ada41af42d8b8d85ba1e657e003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:17.690451 29006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:03:17.699450 26148 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.599s (SENT) [suppressed 1 similar messages]
W20260928 20:03:17.685398 26450 leader_election.cc:343] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:17.710052 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 135940us
I20260928 20:03:17.710353 28997 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "fd517ada41af42d8b8d85ba1e657e003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } } }
I20260928 20:03:17.711074 28997 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [sys.catalog]: This master's current role is: LEADER
I20260928 20:03:17.714293 28981 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.714856 28981 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.717578 28981 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.722760 26594 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:17.723871 29009 raft_consensus.cc:2804] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:17.723920 29002 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.724203 29009 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:17.724370 29002 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.724510 29009 raft_consensus.cc:3060] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:17.726662 29002 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:17.731884 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]
I20260928 20:03:17.738308 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:17.739152 26504 raft_consensus.cc:2393] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:17.717947 26916 tablet_bootstrap.cc:492] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:17.741554 26916 ts_tablet_manager.cc:1449] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.639s user 0.011s sys 0.006s
I20260928 20:03:17.756091 29007 consensus_queue.cc:1048] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:17.761734 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]
I20260928 20:03:17.762130 26912 tablet_bootstrap.cc:492] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:17.762566 26912 ts_tablet_manager.cc:1449] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.253s user 0.006s sys 0.006s
I20260928 20:03:17.759543 29009 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:17.764432 26148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 65001.3us
I20260928 20:03:17.766461 26912 raft_consensus.cc:359] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.767170 26912 raft_consensus.cc:385] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.767416 26912 raft_consensus.cc:740] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:17.767982 26912 consensus_queue.cc:260] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.772146 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0]
I20260928 20:03:17.777063 26916 raft_consensus.cc:359] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.777690 26916 raft_consensus.cc:385] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.779932 29009 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.789444 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:17.790076 26506 raft_consensus.cc:2468] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:17.793637 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:17.794654 26506 raft_consensus.cc:3060] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:17.796108 26912 ts_tablet_manager.cc:1480] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260928 20:03:17.797052 26912 tablet_bootstrap.cc:492] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:17.796962 26913 tablet_bootstrap.cc:654] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:17.808991 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b620de746d7346efac926837182aa589 [id=18bdc683ddf64bf2a02bb5902f73933a]
I20260928 20:03:17.822463 26913 tablet_bootstrap.cc:492] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:17.823050 26913 ts_tablet_manager.cc:1449] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.190s user 0.006s sys 0.011s
I20260928 20:03:17.828038 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_0823e9b9b5284c5bb8c2752223dc68a4 [id=195a25265b964b7382826f865bcc3022]
I20260928 20:03:17.825656 26913 raft_consensus.cc:359] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.836253 26913 raft_consensus.cc:385] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:17.837869 26913 raft_consensus.cc:740] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:17.840551 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_2bd98a3ca12b417aa6115a75f74e752c [id=1967b4ffcea84c8ab364a0e946e5d86b]
I20260928 20:03:17.842514 26913 consensus_queue.cc:260] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.852521 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c0cba0a8dbf4476e8c5b101a855ea68b [id=1ba1e6a48ca54423be0f36035c8308b7]
I20260928 20:03:17.857291 26913 ts_tablet_manager.cc:1480] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20260928 20:03:17.861351 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]
I20260928 20:03:17.777941 26916 raft_consensus.cc:740] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:17.869740 26916 consensus_queue.cc:260] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.872186 26916 ts_tablet_manager.cc:1480] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.130s user 0.006s sys 0.000s
I20260928 20:03:17.873055 26916 tablet_bootstrap.cc:492] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:17.876159 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]
I20260928 20:03:17.891716 28898 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:17.892154 28898 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.893793 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 [id=1eebb242f3974ae697935ddbe3403669]
I20260928 20:03:17.894076 28898 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.902789 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_83090de75bd14a7898987c9d0c93b871 [id=1f5468b83cf74cd49cde65514c10c24d]
I20260928 20:03:17.904516 26506 raft_consensus.cc:2468] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:17.910308 26913 tablet_bootstrap.cc:492] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:17.920454 26913 tablet_bootstrap.cc:654] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:17.885052 29007 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:17.929657 29007 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.891503 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:17.892621 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:17.899103 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:17.907203 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:17.937657 26793 raft_consensus.cc:3060] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:17.944473 29007 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:17.951180 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c68f60885a0940f583aa139abd8a834a [id=1fd0e6f7ff6b4552b40c8d2afce48966]
I20260928 20:03:17.955391 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8d26e012313e4a30b824a5f081aa548d [id=219bcf821c96465eb48c3199ea6f4237]
I20260928 20:03:17.970029 26913 tablet_bootstrap.cc:492] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:17.978679 26913 ts_tablet_manager.cc:1449] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.069s user 0.013s sys 0.000s
I20260928 20:03:17.993186 26913 raft_consensus.cc:359] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:17.981911 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3697e383390b4709b95e01cb55f17c34 [id=23a824778def463ebc96837ae1766677]
I20260928 20:03:18.003103 26913 raft_consensus.cc:385] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.005725 26913 raft_consensus.cc:740] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.011682 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.020170 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_12847c70617446c79bef47447bba6e7f [id=24710d0e366c44a0b041c457b40e9385]
I20260928 20:03:18.016944 26913 consensus_queue.cc:260] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.030937 26913 ts_tablet_manager.cc:1480] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20260928 20:03:18.043059 26913 tablet_bootstrap.cc:492] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:18.042788 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a]
I20260928 20:03:18.079877 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]
I20260928 20:03:18.081332 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.087175 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.087832 26501 raft_consensus.cc:2468] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:18.089600 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.090281 26501 raft_consensus.cc:2468] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:18.093842 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.094484 26502 raft_consensus.cc:2468] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:18.094203 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b4f6fb24e5d14de3afcb16e1fded33fd [id=2c8fc0970bcb4a83bfd995dcb6ecdf1d]
I20260928 20:03:18.101550 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:18.102020 26594 leader_election.cc:343] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:18.102607 26594 leader_election.cc:343] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:18.102823 26913 tablet_bootstrap.cc:654] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:18.103150 26594 leader_election.cc:343] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:18.105124 26594 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:18.106244 28987 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.106824 28987 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.108827 28987 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.117847 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c909970e41b44433885b634d80002868 [id=2e3160a2ecb54b22a2a543498ec403b0]
I20260928 20:03:18.117883 29002 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.118391 29002 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.120154 29002 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:18.122959 26220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.532s (SENT) [suppressed 5 similar messages]
I20260928 20:03:18.124303 26916 tablet_bootstrap.cc:654] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.122588 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_039c27c2317f4d218f78454b1adcde10 [id=30d0193942bb4680bd08e5ed6064b8ac]
I20260928 20:03:18.125952 29002 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.126385 29002 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.128180 29002 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.129423 26913 tablet_bootstrap.cc:492] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:18.129865 26913 ts_tablet_manager.cc:1449] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.088s user 0.008s sys 0.003s
I20260928 20:03:18.132205 26913 raft_consensus.cc:359] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.134402 29006 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:18.134896 29006 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:18.137035 29006 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:18.136526 26913 raft_consensus.cc:385] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.139621 26913 raft_consensus.cc:740] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.147707 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]
I20260928 20:03:18.146987 26913 consensus_queue.cc:260] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.149585 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.150317 26507 raft_consensus.cc:2468] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:18.157557 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af]
I20260928 20:03:18.163444 26913 ts_tablet_manager.cc:1480] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.033s user 0.003s sys 0.002s
I20260928 20:03:18.163532 26793 raft_consensus.cc:2468] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:18.165513 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 83486us
W20260928 20:03:18.168689 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 45812.3us
I20260928 20:03:18.171576 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:18.172149 26514 raft_consensus.cc:3060] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:18.180688 26514 raft_consensus.cc:2468] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:18.186189 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.186721 26504 raft_consensus.cc:2468] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:18.189723 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.191171 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.191457 26912 tablet_bootstrap.cc:700] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4: Time spent opening tablet: real 0.257s user 0.004s sys 0.000s
I20260928 20:03:18.192096 26912 tablet_bootstrap.cc:654] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.192178 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.193148 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.194258 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.194869 26646 raft_consensus.cc:2468] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:18.205566 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8fd74e2df9b84a1e998370b85625e609 [id=334efebe93f24b3d98e6a649ec121da4]
I20260928 20:03:18.222556 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.223363 26506 raft_consensus.cc:2468] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:18.231433 29002 raft_consensus.cc:493] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.231958 29002 raft_consensus.cc:515] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.233915 29002 leader_election.cc:290] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.236937 26913 tablet_bootstrap.cc:492] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:18.242683 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]
I20260928 20:03:18.244274 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ff6225f056a84389992b4f66f946fb3e [id=3749b65af21b404e8a638dfc03035266]
I20260928 20:03:18.245376 28898 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.245880 28898 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.247877 28898 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.255541 26913 tablet_bootstrap.cc:654] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.285413 26916 tablet_bootstrap.cc:492] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:18.285898 26916 ts_tablet_manager.cc:1449] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.413s user 0.009s sys 0.001s
I20260928 20:03:18.286396 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b6e9471784104b748304857c18d1c3c8 [id=37c8252e29f9443bb978a9ee2b863bf2]
I20260928 20:03:18.295617 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.299093 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.300016 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.300935 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.302592 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.303521 29002 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.303961 29002 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.301867 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.304802 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_d90e6a6913a54889810926926798a1b4 [id=3a5c78e561ee43729940d404c103ab3f]
I20260928 20:03:18.305377 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.305853 29002 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:18.308153 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 116241us
I20260928 20:03:18.322832 26916 raft_consensus.cc:359] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.323544 26916 raft_consensus.cc:385] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.323809 26916 raft_consensus.cc:740] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.331300 26913 tablet_bootstrap.cc:492] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:18.331784 26913 ts_tablet_manager.cc:1449] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.095s user 0.008s sys 0.004s
I20260928 20:03:18.332821 26916 consensus_queue.cc:260] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.317402 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015]
I20260928 20:03:18.355475 26595 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.355535 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.356659 29012 raft_consensus.cc:2749] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:18.361443 26595 leader_election.cc:343] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:18.362089 26595 leader_election.cc:304] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.363248 29012 raft_consensus.cc:2749] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:18.364089 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_92cd775d03ce43259e1527778a376855 [id=3bc1c712116e4b1bae264afc0f8030ed]
W20260928 20:03:18.367277 26148 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.599s (SENT)
I20260928 20:03:18.370951 26916 ts_tablet_manager.cc:1480] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.085s user 0.005s sys 0.001s
I20260928 20:03:18.371797 26913 raft_consensus.cc:359] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:18.376535 28987 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.378628 26913 raft_consensus.cc:385] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.378894 26913 raft_consensus.cc:740] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.378759 28987 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.380915 28987 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.385077 26916 tablet_bootstrap.cc:492] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:18.397251 26916 tablet_bootstrap.cc:654] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:18.399381 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 57709.6us
W20260928 20:03:18.401571 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 302761us
I20260928 20:03:18.413583 26913 consensus_queue.cc:260] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:18.414407 28987 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.414880 28987 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:18.415343 26913 ts_tablet_manager.cc:1480] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.083s user 0.003s sys 0.004s
I20260928 20:03:18.416239 26913 tablet_bootstrap.cc:492] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:18.423170 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_e81ad7e3711e4f25a6051f1ce257d20a [id=3da22346865f4613910dedb2fad45dc7]
I20260928 20:03:18.424849 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3]
I20260928 20:03:18.431798 28987 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.440794 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.447540 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.450888 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.452631 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.454088 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.455405 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.457048 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.468267 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.470906 26912 tablet_bootstrap.cc:492] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:18.475786 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.479214 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.480732 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.481712 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.482384 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.474977 26912 ts_tablet_manager.cc:1449] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.678s user 0.012s sys 0.008s
I20260928 20:03:18.492261 26912 raft_consensus.cc:359] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.494204 26912 raft_consensus.cc:385] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.494521 26912 raft_consensus.cc:740] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.498842 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_1a915ed0be934873a38f26d9661704fe [id=3ea7cdba6c2c4775aa2404a40482f3f4]
I20260928 20:03:18.500880 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 [id=41a61dca03a547108d47b214ba83b90f]
I20260928 20:03:18.502538 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]
I20260928 20:03:18.516819 26912 consensus_queue.cc:260] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.517972 26913 tablet_bootstrap.cc:654] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.519769 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]
I20260928 20:03:18.530860 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_39e9fc84df3844129902f8bb568244e2 [id=43ecf4974c7f4dc7a1ebcb5091d78076]
I20260928 20:03:18.559121 26912 ts_tablet_manager.cc:1480] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.073s user 0.004s sys 0.000s
I20260928 20:03:18.560082 26912 tablet_bootstrap.cc:492] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:18.565902 26912 tablet_bootstrap.cc:654] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.542305 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_4a912910bc1f4d59b94845c363144d28 [id=44987915fb2445b5b13c7df9db3e40e8]
I20260928 20:03:18.571519 26913 tablet_bootstrap.cc:492] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:18.571946 26913 ts_tablet_manager.cc:1449] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.156s user 0.009s sys 0.001s
I20260928 20:03:18.574218 26913 raft_consensus.cc:359] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.574963 26913 raft_consensus.cc:385] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.581112 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_28cdbc10adcb4b9da604e5bab2dda740 [id=44c95fceecbd42a38a0e6b240cc4b680]
I20260928 20:03:18.583443 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_05c17087f17c40ccaef5290a60a1234d [id=45a830baeeb54dcdb2109f053a9413ac]
W20260928 20:03:18.582297 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 177233us
I20260928 20:03:18.599543 26739 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:18.600415 29036 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:18.575270 26913 raft_consensus.cc:740] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.601739 26913 consensus_queue.cc:260] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:18.598852 26148 leader_election.cc:336] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.723s (SENT)
W20260928 20:03:18.646878 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 47419.6us
I20260928 20:03:18.647219 26595 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.648787 26594 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:18.649540 29012 raft_consensus.cc:2804] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:18.649866 29012 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:18.650094 28987 raft_consensus.cc:2804] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:18.650593 28987 raft_consensus.cc:697] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:18.651396 28987 consensus_queue.cc:237] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.653672 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.654295 26652 raft_consensus.cc:2468] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:18.650194 29012 raft_consensus.cc:3060] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:18.655483 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.655833 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:18.603951 26913 ts_tablet_manager.cc:1480] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.032s user 0.004s sys 0.000s
I20260928 20:03:18.656773 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.667122 29012 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.691895 29051 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:18.703078 26220 leader_election.cc:336] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899): Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.532s (SENT)
I20260928 20:03:18.703536 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:18.709007 29051 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.711375 26912 tablet_bootstrap.cc:492] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:18.720503 29012 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.735364 29002 raft_consensus.cc:493] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.736169 29002 raft_consensus.cc:515] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.738401 29051 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.738854 29002 leader_election.cc:290] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.739040 29051 raft_consensus.cc:493] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.739320 29002 raft_consensus.cc:493] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.739806 29002 raft_consensus.cc:515] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:18.712100 26740 consensus_peers.cc:597] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b667a45712c1449384e1a288f55fd062. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:18.742245 29002 leader_election.cc:290] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.748828 26912 ts_tablet_manager.cc:1449] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.189s user 0.008s sys 0.002s
I20260928 20:03:18.750448 26916 tablet_bootstrap.cc:492] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:18.751066 26916 ts_tablet_manager.cc:1449] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.366s user 0.009s sys 0.003s
I20260928 20:03:18.754726 26916 raft_consensus.cc:359] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.755452 26916 raft_consensus.cc:385] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.755720 26916 raft_consensus.cc:740] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.756403 26916 consensus_queue.cc:260] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.758843 26912 raft_consensus.cc:359] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.759810 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a4c5888ebf824ce6934efcc6b4257595 [id=462e52b478724a6eb3ce35b6206673e3]
I20260928 20:03:18.761487 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]
I20260928 20:03:18.763022 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_448e0060fd3d49018e59b4875da55674 [id=474b74c08e6348da8e5de4405064735f]
I20260928 20:03:18.764464 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]
I20260928 20:03:18.765693 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0]
I20260928 20:03:18.766549 26916 ts_tablet_manager.cc:1480] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.015s user 0.005s sys 0.002s
I20260928 20:03:18.771282 29051 raft_consensus.cc:515] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:18.773736 29051 leader_election.cc:290] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.776744 29058 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:18.778712 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 75675.9us
W20260928 20:03:18.780511 26450 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:18.783475 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 135215us
I20260928 20:03:18.788230 26595 leader_election.cc:304] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.789367 28898 raft_consensus.cc:2804] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:18.789217 26595 leader_election.cc:304] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.789744 28898 raft_consensus.cc:493] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:18.790071 28898 raft_consensus.cc:3060] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:18.790081 29012 raft_consensus.cc:2804] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:18.790596 29012 raft_consensus.cc:493] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:18.790943 29012 raft_consensus.cc:3060] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:18.802284 26450 leader_election.cc:304] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.804325 29056 raft_consensus.cc:2749] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:18.799202 26916 tablet_bootstrap.cc:492] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:18.808153 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c2e7429ecbd942bd908a88d634de17c6 [id=4a90001d3d204a01929c3a0d03e0bcc6]
I20260928 20:03:18.808000 28898 raft_consensus.cc:515] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.809480 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7]
I20260928 20:03:18.810499 29012 raft_consensus.cc:515] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.821664 29012 leader_election.cc:290] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.823158 26595 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.825846 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_419bbb75ac2d4717b1cb696825cf70dc [id=4ad6473396cd4040b3abda93d38b0428]
I20260928 20:03:18.826921 28987 raft_consensus.cc:2804] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:18.827315 28987 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:18.827718 28987 raft_consensus.cc:3060] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:18.835098 26450 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:18.772672 29046 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.835904 29046 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.835522 26450 leader_election.cc:304] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.837663 26450 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.837809 29046 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.838519 29055 raft_consensus.cc:2749] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:18.839246 29055 raft_consensus.cc:2804] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:18.839619 29055 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:18.840008 29055 raft_consensus.cc:3060] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:18.846967 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_f9542fb9d4054fec841718053fedb559 [id=4d41cf8ff46f412b8c28cfd2279268e8]
I20260928 20:03:18.848268 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_52834d7c9e064555a1ed3e9cd8b98e34 [id=4e50219ff53c4c6c94eec881bb4cfe75]
I20260928 20:03:18.850867 28987 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.851931 26912 raft_consensus.cc:385] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.852345 26912 raft_consensus.cc:740] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.853056 26912 consensus_queue.cc:260] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:18.853940 27792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 56303.8us
I20260928 20:03:18.855999 26912 ts_tablet_manager.cc:1480] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.107s user 0.005s sys 0.000s
W20260928 20:03:18.868158 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:18.869240 26450 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.869607 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:18.870038 29056 raft_consensus.cc:2749] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:18.870496 26513 raft_consensus.cc:2468] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:18.869518 28987 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.881213 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_80b7e921026a449aac1078cb8ef22d63 [id=520a43e0bc5d418a9e1e2227a8e65249]
I20260928 20:03:18.888350 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c6e3b12edab441c89f9e255a1a1a001c [id=54949ec9d297437d8f79a73d487f9b7e]
I20260928 20:03:18.894446 28898 leader_election.cc:290] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.901101 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]
I20260928 20:03:18.903231 26913 tablet_bootstrap.cc:492] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:18.905719 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a343f55509fc4555836efe7503996740 [id=569aa44462c74840b9cd56304974e74e]
I20260928 20:03:18.909631 26913 tablet_bootstrap.cc:654] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.910295 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_92b4d9ef87464f9b9b5582e6d529ac49 [id=57fa893f8f0f41fdb40c0150e9270d37]
I20260928 20:03:18.919260 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8691e84d63084dd38d8988f4311c83c6 [id=5bcb1e3b9dec45df8affc72f783620c1]
I20260928 20:03:18.926147 26916 tablet_bootstrap.cc:654] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.872172 29045 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:18.874182 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.926822 29045 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.927898 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b535172c333e41bba212d17bbb3a0a13 [id=5c5d5de98b4047919b9ded842e422341]
I20260928 20:03:18.929150 29045 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:18.931643 26912 tablet_bootstrap.cc:492] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:18.933487 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd]
W20260928 20:03:18.936869 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 68775.3us
W20260928 20:03:18.937669 26450 leader_election.cc:343] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:18.938062 26450 leader_election.cc:304] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.938789 29056 raft_consensus.cc:2749] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:18.939953 26450 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:18.940331 26450 leader_election.cc:304] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:18.950814 26913 tablet_bootstrap.cc:492] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:18.951418 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.953545 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:18.960393 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd]
I20260928 20:03:18.969096 26740 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:18.970023 29045 raft_consensus.cc:2804] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:18.970436 29045 raft_consensus.cc:493] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:18.970788 29045 raft_consensus.cc:3060] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:18.974390 29055 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.974735 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_75a90a6806eb4588bfc09ac96125f4df [id=6029f28219a24f429bf99d14baa35339]
I20260928 20:03:18.977478 29055 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:18.979736 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 [id=62a432d0a82e48efb93877e3c46cb37b]
I20260928 20:03:18.986116 26913 ts_tablet_manager.cc:1449] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.003s
I20260928 20:03:18.986912 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]
I20260928 20:03:18.988516 26913 raft_consensus.cc:359] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:18.989169 26913 raft_consensus.cc:385] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:18.989427 26913 raft_consensus.cc:740] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:18.991768 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_66b4fb7dfd10446d99fa01b7f3b019ec [id=639bd5507dc14745860aadffb4b7c94e]
I20260928 20:03:18.998818 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c628c1a16db34a3fbc9c818e95ad5f7a [id=65d9b7804d5e4d008d31a84cccc3458f]
I20260928 20:03:19.000733 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.001362 26793 raft_consensus.cc:3060] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.004071 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a]
I20260928 20:03:19.008728 26793 raft_consensus.cc:2468] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:19.008463 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_6655d0a31a0f40f495acbad72c9ccfc9 [id=69cb6b4dc2ac4e47b92be86a394c9929]
I20260928 20:03:19.020460 26912 tablet_bootstrap.cc:654] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:18.978044 29056 raft_consensus.cc:2749] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:18.984376 29054 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.022666 29054 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.025141 29054 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:18.987882 26450 leader_election.cc:343] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.026157 26450 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:19.028295 26450 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.026965 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f [id=6ded8787f37141558c95545a1da78a73]
I20260928 20:03:19.028789 26450 leader_election.cc:304] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.029633 29054 raft_consensus.cc:2749] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.030282 29054 raft_consensus.cc:2749] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.020423 26916 tablet_bootstrap.cc:492] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:19.031451 26916 ts_tablet_manager.cc:1449] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.233s user 0.012s sys 0.000s
I20260928 20:03:19.040175 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_4ab8d432c8da4b06acd99f3329549a73 [id=6f52e21fc32e4be58ef89782db2ebd56]
I20260928 20:03:19.046473 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:19.048362 26513 raft_consensus.cc:2468] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:19.048841 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 [id=6fc28fd5258c423ab0cf022d50525caf]
W20260928 20:03:19.055457 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 87024e1a4f184c669ff78efc918a9eef consensus state has no leader
I20260928 20:03:19.060027 28898 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.060494 28898 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:19.060675 26450 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.061530 26450 leader_election.cc:343] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.062165 26450 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.062345 28898 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:19.062726 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a]
W20260928 20:03:19.062922 26450 leader_election.cc:343] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.063532 26450 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:19.064031 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]
I20260928 20:03:19.065233 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2]
I20260928 20:03:19.074306 26916 raft_consensus.cc:359] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.075037 26916 raft_consensus.cc:385] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.074182 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_850721f396e049e48b48b6a6636ff076 [id=75699f46194e46278a2fa055683b658f]
I20260928 20:03:19.075304 26916 raft_consensus.cc:740] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.075939 26916 consensus_queue.cc:260] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:18.990022 26913 consensus_queue.cc:260] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:19.105746 26913 ts_tablet_manager.cc:1480] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.119s user 0.007s sys 0.000s
I20260928 20:03:19.111668 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_66f34d73b85d4af58844cc7ea97a7866 [id=7915573b0b384fb693d6bdafe1bb095e]
I20260928 20:03:19.079353 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.088093 26740 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:19.114455 26794 raft_consensus.cc:3060] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.114622 29046 raft_consensus.cc:2764] T 87718f040f0d4b9d88a551cae4f0d47f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 20:03:19.114735 26913 tablet_bootstrap.cc:492] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:19.091418 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.093263 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.096339 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.015448 29045 raft_consensus.cc:515] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.123744 26802 raft_consensus.cc:2393] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:19.124029 26794 raft_consensus.cc:2468] T 311f004a7acc4d43b4b88564b57efa74 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:19.126371 29055 raft_consensus.cc:2804] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:19.126966 29055 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:19.127362 29055 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.126865 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]
I20260928 20:03:19.131474 29045 leader_election.cc:290] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:19.135807 26916 ts_tablet_manager.cc:1480] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.104s user 0.006s sys 0.000s
I20260928 20:03:19.136830 26916 tablet_bootstrap.cc:492] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:19.139636 29051 raft_consensus.cc:493] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.140154 29051 raft_consensus.cc:515] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.144050 29051 leader_election.cc:290] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.144836 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:19.145546 26513 raft_consensus.cc:3060] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.145804 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_87c2af829d1743e89bc173be981dcbc7 [id=7edfca25231e43ef87f78fcc7816d969]
I20260928 20:03:19.152902 26513 raft_consensus.cc:2468] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:19.151352 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_21a9c8b591bd46a595f6762efcdb8a58 [id=7eeccc44c73f46b88801b8107c5b1cc9]
I20260928 20:03:19.154315 26740 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:19.156632 29045 raft_consensus.cc:2804] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:19.157523 29045 raft_consensus.cc:697] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
W20260928 20:03:19.158205 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 94749.7us
I20260928 20:03:19.158382 29045 consensus_queue.cc:237] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.161746 26913 tablet_bootstrap.cc:654] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.179339 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_41f900344d434a3aa235b7a49f202b4f [id=8242c87c5c8148d58cb3ba7b8a1cdcbc]
W20260928 20:03:19.182013 26450 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.189849 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_d41c7a2638544b2b90e5398f97ad686b [id=84e0df88dcfd4d2d90bcd01c2849069b]
W20260928 20:03:19.191202 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.191802 26450 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.192422 26450 leader_election.cc:343] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.192842 26912 tablet_bootstrap.cc:492] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
W20260928 20:03:19.193025 26450 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.193405 26912 ts_tablet_manager.cc:1449] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.262s user 0.010s sys 0.001s
W20260928 20:03:19.193619 26450 leader_election.cc:343] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.195917 26912 raft_consensus.cc:359] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.196609 26912 raft_consensus.cc:385] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.196914 26912 raft_consensus.cc:740] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.199227 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_505b4c5717db4fc4941b68e6271305a6 [id=85411afbf7894f15aa20dfcecafc0a17]
I20260928 20:03:19.207896 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.208629 26657 raft_consensus.cc:2393] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
W20260928 20:03:19.219211 26594 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:19.224067 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8]
I20260928 20:03:19.225510 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_7cf3f31c382c41328b3bc3b015ec4320 [id=880148005f7949888ad9308950ae5b32]
I20260928 20:03:19.229446 26913 tablet_bootstrap.cc:492] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:19.229925 26913 ts_tablet_manager.cc:1449] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.117s user 0.010s sys 0.000s
I20260928 20:03:19.233068 26913 raft_consensus.cc:359] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.233831 26913 raft_consensus.cc:385] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.234764 26912 consensus_queue.cc:260] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.238667 26913 raft_consensus.cc:740] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:03:19.246807 26450 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.247083 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.248019 26652 raft_consensus.cc:2393] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:19.242172 26913 consensus_queue.cc:260] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.234378 29055 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.259976 29055 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.264169 26912 ts_tablet_manager.cc:1480] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.070s user 0.005s sys 0.000s
W20260928 20:03:19.267714 26594 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.262132 26450 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.270054 26594 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.270759 26594 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.270931 26913 ts_tablet_manager.cc:1480] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.041s user 0.007s sys 0.000s
I20260928 20:03:19.271977 29012 consensus_queue.cc:1048] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:19.274926 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c17f6d0dcd96486ca59966415e8978de [id=8b3fd73182f14c10b4a847d1ae537630]
I20260928 20:03:19.279788 26450 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
W20260928 20:03:19.280702 26450 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.281622 26595 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.282709 26595 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.282721 29055 raft_consensus.cc:2804] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:19.283123 29055 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:19.283442 29055 raft_consensus.cc:3060] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.283679 28898 raft_consensus.cc:2804] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:19.284032 28898 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:19.284345 28898 raft_consensus.cc:3060] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.285171 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_43a3511ec731472cb9111882b4c3a9a0 [id=8ba59aca002240cd8e1141423f0e6e68]
I20260928 20:03:19.287672 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.288066 29052 raft_consensus.cc:2804] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:19.288375 29052 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:19.288681 29052 raft_consensus.cc:3060] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.297284 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3d54d1555a914679a1a011feaa634329 [id=8bce5ded64774186a5e753c7037b977f]
I20260928 20:03:19.305299 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_0cc6e9ab6483451aadcf7beddfa7058a [id=8c9cbf00a11841bca0bd04b6e73dfdbc]
I20260928 20:03:19.306739 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e]
I20260928 20:03:19.308663 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_22b94739706d4bcabfd2fe1c283c4ab9 [id=8e2065efd25245bfb73bf8fdcb9458af]
I20260928 20:03:19.309888 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301]
I20260928 20:03:19.310153 26916 tablet_bootstrap.cc:654] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.322614 29052 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.336910 28898 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.339416 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.348654 26653 raft_consensus.cc:2468] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:19.340075 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.341101 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.341948 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.343152 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:19.350412 26646 raft_consensus.cc:3060] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.344022 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.357405 26913 tablet_bootstrap.cc:492] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:19.362895 26913 tablet_bootstrap.cc:654] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.365338 26646 raft_consensus.cc:2468] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:19.366639 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.371927 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b6d3e2c8a9994b19b860b97f44a72785 [id=8f0c2c2f5bb74283976e75d6bcca7ba5]
I20260928 20:03:19.373322 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_13971cf4060b47aea813d1ea311e8347 [id=911769c45f044f3b8772d685b79d2e30]
I20260928 20:03:19.287482 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.339131 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.340703 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.341354 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.341948 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.342656 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.344277 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.376506 26796 raft_consensus.cc:3060] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.345516 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.381417 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:19.388595 26796 raft_consensus.cc:2468] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:19.390334 29055 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.392652 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.394738 29055 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:19.372267 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 91056.3us
W20260928 20:03:19.390664 26740 consensus_peers.cc:597] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:19.405380 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:19.405927 26659 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:19.409619 26912 tablet_bootstrap.cc:492] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:19.416245 26659 raft_consensus.cc:2468] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:19.395569 29054 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.418637 29054 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.420719 29054 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.396337 29051 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.421929 29051 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:19.423949 29051 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.398515 29056 raft_consensus.cc:493] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.424523 29056 raft_consensus.cc:515] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.390630 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:19.426520 29056 leader_election.cc:290] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.426656 28898 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:19.397466 29052 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:19.428831 29069 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.429260 29069 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:19.436494 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3bbea633f65b40279f5e069f2cf18cd3 [id=93f93c4333824319bec279868d0f3cfe]
I20260928 20:03:19.443928 26916 tablet_bootstrap.cc:492] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:19.444469 26916 ts_tablet_manager.cc:1449] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.308s user 0.007s sys 0.008s
I20260928 20:03:19.447331 26916 raft_consensus.cc:359] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.448182 26916 raft_consensus.cc:385] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.448493 26916 raft_consensus.cc:740] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.448913 29069 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:19.449707 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:19.449265 26916 consensus_queue.cc:260] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.433689 26594 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:19.456651 29012 raft_consensus.cc:2804] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:19.457110 29012 raft_consensus.cc:697] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:19.457927 29012 consensus_queue.cc:237] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.458092 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]
I20260928 20:03:19.467383 26913 tablet_bootstrap.cc:492] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:19.467785 26913 ts_tablet_manager.cc:1449] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.000s
I20260928 20:03:19.473528 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_65e7aa358d65483d80d93aab4fbce62a [id=968c4c02a8aa4807b160bc13339e2022]
W20260928 20:03:19.480460 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 79612.1us
W20260928 20:03:19.481083 26450 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.481393 26450 leader_election.cc:304] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.487800 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_d7d359f62a71495f99580370aacdbff7 [id=986f7e8be10e4f70930a513613b3731f]
W20260928 20:03:19.501364 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 61766.7us
I20260928 20:03:19.501482 29054 raft_consensus.cc:2749] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.501830 26916 ts_tablet_manager.cc:1480] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.057s user 0.005s sys 0.000s
W20260928 20:03:19.502615 26450 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.503005 26450 leader_election.cc:304] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.503623 29054 raft_consensus.cc:2749] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.505106 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.506940 29036 consensus_queue.cc:1048] T 5bdb8870dce541a2afb3be09bcb3c701 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:19.515143 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.659s (SENT)
W20260928 20:03:19.515682 27792 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899): Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.659s (SENT)
I20260928 20:03:19.516105 27792 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:19.518581 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b414add5e6554e31905d7f0162e3abb4 [id=9f809908d5c3416c895ea4d839c956ac]
I20260928 20:03:19.523142 26913 raft_consensus.cc:359] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.523865 26913 raft_consensus.cc:385] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.524132 26913 raft_consensus.cc:740] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.524791 26913 consensus_queue.cc:260] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.529425 26912 tablet_bootstrap.cc:654] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:19.505983 26450 leader_election.cc:343] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.539871 26450 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.549933 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]
I20260928 20:03:19.551896 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]
I20260928 20:03:19.553202 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]
I20260928 20:03:19.558514 26913 ts_tablet_manager.cc:1480] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.090s user 0.007s sys 0.000s
I20260928 20:03:19.562716 29054 raft_consensus.cc:2749] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.564844 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 58892.4us
W20260928 20:03:19.565482 26450 leader_election.cc:343] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.565817 26450 leader_election.cc:304] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.575585 29079 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:19.576488 27792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 60833.4us
I20260928 20:03:19.577790 26913 tablet_bootstrap.cc:492] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:19.593765 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228]
I20260928 20:03:19.597002 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_1d04da9e1ce749aaafdc63f86a11535e [id=aa9d03a4e0a840659761ea54cbb4519f]
I20260928 20:03:19.591404 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:19.602025 26652 raft_consensus.cc:2393] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:19.602909 26912 tablet_bootstrap.cc:492] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
W20260928 20:03:19.590062 26594 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.603356 26912 ts_tablet_manager.cc:1449] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.194s user 0.010s sys 0.000s
W20260928 20:03:19.603546 26594 leader_election.cc:343] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.606747 29054 raft_consensus.cc:2749] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.607828 26450 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.608187 26450 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.608815 29054 raft_consensus.cc:2749] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.609766 26450 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.610096 26450 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.610693 29054 raft_consensus.cc:2749] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.611590 26450 leader_election.cc:343] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.611907 26450 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.613686 26594 leader_election.cc:304] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:19.615545 29068 raft_consensus.cc:2804] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:19.616279 29068 raft_consensus.cc:697] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:19.616890 26916 tablet_bootstrap.cc:492] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:19.617102 29068 consensus_queue.cc:237] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.624521 26916 tablet_bootstrap.cc:654] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.625929 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.636293 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:19.654551 26913 tablet_bootstrap.cc:654] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.655988 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497]
I20260928 20:03:19.657460 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2]
I20260928 20:03:19.605803 26912 raft_consensus.cc:359] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.662703 26912 raft_consensus.cc:385] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.673894 26916 tablet_bootstrap.cc:492] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:19.674351 26916 ts_tablet_manager.cc:1449] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.058s user 0.007s sys 0.004s
W20260928 20:03:19.675920 26594 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.676128 29054 raft_consensus.cc:2749] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.676249 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 64684.8us
W20260928 20:03:19.676859 26450 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.677199 26450 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:19.678321 26450 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.678658 26450 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.680980 29073 raft_consensus.cc:2749] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.681588 29073 raft_consensus.cc:2749] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.684357 26594 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.684655 26912 raft_consensus.cc:740] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.685395 26912 consensus_queue.cc:260] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.687990 26912 ts_tablet_manager.cc:1480] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.084s user 0.005s sys 0.000s
I20260928 20:03:19.688880 26912 tablet_bootstrap.cc:492] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:19.706431 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]
I20260928 20:03:19.707903 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_6705a1b4132644408979a6ed69958eba [id=b265254a22fd4381a4c8135dda1abcd7]
I20260928 20:03:19.709921 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 [id=b4cbe8131b3a4452bf9d0305f6d89940]
I20260928 20:03:19.716048 29068 consensus_queue.cc:1048] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260928 20:03:19.722496 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 44195.7us
W20260928 20:03:19.723114 26450 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.722882 26916 raft_consensus.cc:359] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.723546 26916 raft_consensus.cc:385] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.723474 26450 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.723799 26916 raft_consensus.cc:740] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.724191 29054 raft_consensus.cc:2749] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.724399 26916 consensus_queue.cc:260] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:19.734295 26450 leader_election.cc:343] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.743813 26913 tablet_bootstrap.cc:492] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:19.744277 26913 ts_tablet_manager.cc:1449] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.167s user 0.011s sys 0.000s
I20260928 20:03:19.751087 26913 raft_consensus.cc:359] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.778215 26450 leader_election.cc:304] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.779114 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_286ac19bf2c94fccacea798394d419c8 [id=b5312b25c2f3437cba1d46c88efad660]
I20260928 20:03:19.784667 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]
I20260928 20:03:19.804903 26912 tablet_bootstrap.cc:654] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.807554 26913 raft_consensus.cc:385] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.807953 26913 raft_consensus.cc:740] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.810088 26913 consensus_queue.cc:260] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.811357 29054 raft_consensus.cc:2749] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:19.813788 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 79588.3us
I20260928 20:03:19.823534 26916 ts_tablet_manager.cc:1480] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.149s user 0.006s sys 0.000s
I20260928 20:03:19.824118 26913 ts_tablet_manager.cc:1480] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.080s user 0.006s sys 0.000s
I20260928 20:03:19.827251 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]
I20260928 20:03:19.829248 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_101a375ee5e84e1aa7e611fc10883e70 [id=b8d510931aff47298bc0ae12b984ac8c]
W20260928 20:03:19.824344 26450 leader_election.cc:343] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.830384 26450 leader_election.cc:304] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.831584 29054 raft_consensus.cc:2749] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.835405 29012 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.835928 29012 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.837953 29012 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:19.839092 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:19.841837 26594 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.842813 26913 tablet_bootstrap.cc:492] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:19.824546 26916 tablet_bootstrap.cc:492] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:19.874348 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 50219.6us
W20260928 20:03:19.875167 26740 consensus_peers.cc:597] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8. This is attempt 6: this message will repeat every 5th retry.
W20260928 20:03:19.876763 26450 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.877530 26450 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.878305 26450 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:19.880709 29055 raft_consensus.cc:2749] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:19.884119 26912 tablet_bootstrap.cc:492] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:19.884606 26912 ts_tablet_manager.cc:1449] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.196s user 0.009s sys 0.001s
I20260928 20:03:19.887104 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e]
I20260928 20:03:19.888481 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a367ac8973bb4ec4a752434bf59cd2a0 [id=bc50bdfe400c42fcbe7487dd842368ab]
I20260928 20:03:19.904834 26912 raft_consensus.cc:359] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.905670 26912 raft_consensus.cc:385] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:19.905977 26912 raft_consensus.cc:740] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:19.906678 26912 consensus_queue.cc:260] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.908185 26912 ts_tablet_manager.cc:1480] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260928 20:03:19.935269 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b82018a06c354d9291408f9811be2c33 [id=bcc46b95f2b14748ae012cc7dcf42b42]
I20260928 20:03:19.936116 26913 tablet_bootstrap.cc:654] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.937196 26912 tablet_bootstrap.cc:492] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:19.946544 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_d36ac45737c44b2da07aee540f3e9a13 [id=be5fa7ea994c4cd5a37001168b4ef9f4]
I20260928 20:03:19.948657 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_123669ff3966450d8a3dac4d2c6bd255 [id=bfcf8547a3264fc5868a8cd2635fa723]
I20260928 20:03:19.950356 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_39b8a2a0083445798ec0e58e3b2db431 [id=c0c669d5c2ab41b1817259de4326ccd0]
W20260928 20:03:19.954206 26450 leader_election.cc:343] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.954890 26450 leader_election.cc:343] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.955451 26450 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.955999 26450 leader_election.cc:343] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.956533 26450 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.957041 26450 leader_election.cc:343] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.957581 26450 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:19.963765 26916 tablet_bootstrap.cc:654] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.966720 26912 tablet_bootstrap.cc:654] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:19.974637 29012 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.975111 29012 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:19.976378 29055 raft_consensus.cc:493] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:19.976859 29055 raft_consensus.cc:515] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:19.978658 29012 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.978842 29055 leader_election.cc:290] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:19.979171 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:19.980641 26594 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:19.981423 26740 consensus_peers.cc:597] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:20.002153 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d]
I20260928 20:03:20.003516 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f [id=c43f875938fb4105b927b7aee9612a7c]
I20260928 20:03:20.006065 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 [id=c4fd9da4958c44e19d97f5fb4d1ef9d6]
W20260928 20:03:19.958061 26450 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.029911 26916 tablet_bootstrap.cc:492] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:20.030388 26916 ts_tablet_manager.cc:1449] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.206s user 0.011s sys 0.000s
I20260928 20:03:20.032912 26916 raft_consensus.cc:359] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.033563 26916 raft_consensus.cc:385] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.033839 26916 raft_consensus.cc:740] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:20.023542 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 65460.7us
W20260928 20:03:20.039912 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.053536 26913 tablet_bootstrap.cc:492] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:20.054667 26913 ts_tablet_manager.cc:1449] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.212s user 0.011s sys 0.000s
I20260928 20:03:20.059556 26913 raft_consensus.cc:359] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.060177 26913 raft_consensus.cc:385] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.060470 26913 raft_consensus.cc:740] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:20.061339 26450 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:20.062388 29055 raft_consensus.cc:2804] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:20.062871 29055 raft_consensus.cc:697] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:20.063752 29055 consensus_queue.cc:237] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.086634 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.087164 26513 raft_consensus.cc:2468] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:20.091089 29075 consensus_queue.cc:1048] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:20.096648 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.097355 26513 raft_consensus.cc:2468] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:20.113942 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]
I20260928 20:03:20.129475 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:20.130091 26513 raft_consensus.cc:3060] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.131966 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923]
I20260928 20:03:20.138450 26916 consensus_queue.cc:260] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.140712 26916 ts_tablet_manager.cc:1480] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.110s user 0.005s sys 0.000s
I20260928 20:03:20.143498 26513 raft_consensus.cc:2468] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:20.149719 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]
I20260928 20:03:20.158406 26913 consensus_queue.cc:260] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.159638 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_73bad59d2f45422d9e7f0409bdc4a2f4 [id=cbeeebe708654140b78d52a0bed4c6d0]
I20260928 20:03:20.160862 26913 ts_tablet_manager.cc:1480] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.106s user 0.004s sys 0.001s
I20260928 20:03:20.163015 26912 tablet_bootstrap.cc:492] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:20.163452 26912 ts_tablet_manager.cc:1449] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.226s user 0.013s sys 0.003s
I20260928 20:03:20.167501 29068 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.167985 29068 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.169835 29068 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:20.170521 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:20.171679 26594 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.165805 26912 raft_consensus.cc:359] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.172171 26912 raft_consensus.cc:385] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.179663 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:20.180274 26515 raft_consensus.cc:3060] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.180766 26912 raft_consensus.cc:740] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:20.187428 26515 raft_consensus.cc:2468] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:20.184357 26912 consensus_queue.cc:260] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.199479 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:20.199998 26516 raft_consensus.cc:3060] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.200924 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26797990cec14e87a4a30a3bbd2ff7c2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:20.201555 26515 raft_consensus.cc:2393] T 26797990cec14e87a4a30a3bbd2ff7c2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:20.209966 26516 raft_consensus.cc:2468] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:20.218093 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.218779 26513 raft_consensus.cc:2468] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:20.219324 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]
I20260928 20:03:20.223778 26913 tablet_bootstrap.cc:492] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:20.198132 26912 ts_tablet_manager.cc:1480] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.034s user 0.005s sys 0.003s
I20260928 20:03:20.240307 26916 tablet_bootstrap.cc:492] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:20.246742 26916 tablet_bootstrap.cc:654] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:20.255590 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:20.256290 26652 raft_consensus.cc:2393] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:20.260167 26912 tablet_bootstrap.cc:492] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:20.283876 26913 tablet_bootstrap.cc:654] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:20.284271 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 90639.7us
I20260928 20:03:20.286413 26912 tablet_bootstrap.cc:654] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:20.288826 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb [id=cead80ee7d2a408c9112b53b13e41fae]
I20260928 20:03:20.247514 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:20.290742 26514 raft_consensus.cc:2393] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:20.249775 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:20.291380 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_e8c7c9bf121c488eb28e0006cf46469c [id=d258873b4bfc4dd188356430c116e0ae]
I20260928 20:03:20.291579 26515 raft_consensus.cc:3060] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.292683 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8543155fabf44da1970cceef9f13d261 [id=d3d2473850b84badb95103c3973c6cd4]
I20260928 20:03:20.253791 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.294340 26510 raft_consensus.cc:2468] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:20.254169 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.254576 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.295214 26512 raft_consensus.cc:2468] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:20.257290 29055 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.295994 29055 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.295181 26505 raft_consensus.cc:2468] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:20.297878 29055 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.302296 26515 raft_consensus.cc:2468] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:20.314965 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:20.315371 29075 consensus_queue.cc:1048] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:20.316375 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:20.316918 26652 raft_consensus.cc:2468] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:20.317718 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:20.317869 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.318848 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.321049 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.322716 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:20.318849 26595 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:20.333244 26595 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.335100 26595 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.336776 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:20.339184 29068 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:20.340519 29012 raft_consensus.cc:2804] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:20.340827 29012 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:20.341123 29012 raft_consensus.cc:3060] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.343976 26595 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.350890 26916 tablet_bootstrap.cc:492] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:20.351384 26916 ts_tablet_manager.cc:1449] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.111s user 0.011s sys 0.000s
I20260928 20:03:20.355034 26916 raft_consensus.cc:359] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.371217 29055 raft_consensus.cc:493] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.372117 29073 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.372553 29073 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.371798 29055 raft_consensus.cc:515] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.374694 29012 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.376365 29068 raft_consensus.cc:2804] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:20.377041 29068 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:20.377390 29068 raft_consensus.cc:3060] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.378023 29073 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.378741 29055 leader_election.cc:290] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.384572 29068 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.385867 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:20.388316 29012 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:20.356899 26916 raft_consensus.cc:385] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.418133 26916 raft_consensus.cc:740] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:20.429466 29055 raft_consensus.cc:493] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.430392 29055 raft_consensus.cc:515] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.432631 29055 leader_election.cc:290] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.448037 26916 consensus_queue.cc:260] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:20.448969 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 105057us
I20260928 20:03:20.456008 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:20.457795 29107 consensus_queue.cc:1048] T 21cb34c5e33544c9875e7babf4830164 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:20.461215 29055 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.461300 29073 raft_consensus.cc:493] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.461793 29073 raft_consensus.cc:515] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.461756 29055 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.463706 29073 leader_election.cc:290] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.463809 29055 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.463845 29068 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.464635 29055 raft_consensus.cc:493] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.465130 29055 raft_consensus.cc:515] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.466893 26912 tablet_bootstrap.cc:492] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:20.467346 26912 ts_tablet_manager.cc:1449] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.208s user 0.006s sys 0.003s
I20260928 20:03:20.467271 29055 leader_election.cc:290] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.469503 29055 raft_consensus.cc:493] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.469934 29055 raft_consensus.cc:515] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.471995 29055 leader_election.cc:290] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.486161 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:20.486474 26594 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.486733 26791 raft_consensus.cc:3060] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.488580 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_4613895cb87549efa0173a0bc2de3828 [id=d3f0079cf16841ecb1f72fb8f91e79f9]
W20260928 20:03:20.495018 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 44391.8us
I20260928 20:03:20.495908 26595 leader_election.cc:304] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:20.470026 26450 leader_election.cc:343] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.502141 26450 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.503330 29073 raft_consensus.cc:2749] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:20.504647 26450 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.505342 29073 raft_consensus.cc:2804] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:20.505643 29073 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:20.505960 29073 raft_consensus.cc:3060] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.514158 29073 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.516219 29073 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.505837 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]
I20260928 20:03:20.528239 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_53c689bd6dc0475da06ec57192aaa587 [id=d739d9bcee244c8db96567e6cbc0fdc4]
I20260928 20:03:20.529874 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]
I20260928 20:03:20.539899 29036 raft_consensus.cc:493] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.540498 29036 raft_consensus.cc:515] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.543316 29036 leader_election.cc:290] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:20.546195 26916 ts_tablet_manager.cc:1480] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.194s user 0.007s sys 0.000s
W20260928 20:03:20.550704 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 54898.3us
I20260928 20:03:20.497660 29111 consensus_queue.cc:1048] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:20.513922 26913 tablet_bootstrap.cc:492] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:20.552554 26913 ts_tablet_manager.cc:1449] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.329s user 0.006s sys 0.006s
I20260928 20:03:20.556418 26916 tablet_bootstrap.cc:492] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:20.561691 29108 raft_consensus.cc:2804] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:20.562294 29108 raft_consensus.cc:697] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:20.563447 29108 consensus_queue.cc:237] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.567288 26913 raft_consensus.cc:359] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:20.570554 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 65953.3us
W20260928 20:03:20.574538 26450 leader_election.cc:343] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.575903 26450 leader_election.cc:304] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.469832 26912 raft_consensus.cc:359] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.577548 26912 raft_consensus.cc:385] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.577822 29055 raft_consensus.cc:493] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.577898 26912 raft_consensus.cc:740] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:20.578251 29055 raft_consensus.cc:515] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.579334 26912 consensus_queue.cc:260] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:20.579664 26740 leader_election.cc:343] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:20.580120 29055 leader_election.cc:290] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.580598 29055 raft_consensus.cc:2749] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:20.586568 26740 consensus_peers.cc:597] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:20.588469 26913 raft_consensus.cc:385] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.588757 26913 raft_consensus.cc:740] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:20.589401 26913 consensus_queue.cc:260] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:20.583916 26595 consensus_peers.cc:597] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd3fa371924149fb814c8458488aea61. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:20.586766 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6ff2fe1d054eeebeebc6b3b5b5e4c1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:20.599756 26655 raft_consensus.cc:2468] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:20.602963 29113 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:20.603463 29113 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:20.602041 26791 raft_consensus.cc:2468] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:20.627923 26913 ts_tablet_manager.cc:1480] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20260928 20:03:20.628917 26913 tablet_bootstrap.cc:492] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:20.633526 26450 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.633957 26450 leader_election.cc:304] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.636730 29073 raft_consensus.cc:2749] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:20.638233 26912 ts_tablet_manager.cc:1480] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.171s user 0.007s sys 0.000s
I20260928 20:03:20.646294 29073 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.646780 29073 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.652186 26739 leader_election.cc:304] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:20.668378 26450 leader_election.cc:343] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.668815 26450 leader_election.cc:304] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.669457 29055 raft_consensus.cc:2749] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:20.669765 26450 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.670162 26450 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.670265 28870 raft_consensus.cc:2804] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:20.670609 28870 raft_consensus.cc:493] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:20.670791 29055 raft_consensus.cc:2749] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:20.670980 28870 raft_consensus.cc:3060] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:20.671522 26450 leader_election.cc:343] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.671907 26450 leader_election.cc:304] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.672572 29055 raft_consensus.cc:2749] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:20.676540 26916 tablet_bootstrap.cc:654] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:20.698856 26912 tablet_bootstrap.cc:492] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:20.652805 29073 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.705112 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]
I20260928 20:03:20.707605 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]
I20260928 20:03:20.630931 26595 leader_election.cc:304] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.634080 29111 consensus_queue.cc:1048] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:20.711428 29111 raft_consensus.cc:2749] T 26797990cec14e87a4a30a3bbd2ff7c2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:20.712342 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 81497.1us
I20260928 20:03:20.717280 26595 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.718037 29111 raft_consensus.cc:2804] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:20.718451 29111 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:20.718856 29111 raft_consensus.cc:3060] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.676445 26594 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:20.728247 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 51884.8us
I20260928 20:03:20.729369 29106 raft_consensus.cc:2804] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:20.729967 29012 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.730393 29012 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.732340 29012 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.731763 29113 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:20.733835 29106 raft_consensus.cc:697] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:20.734892 29106 consensus_queue.cc:237] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.758311 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_02fef5b38f4b4eb382f4fba80de72cc3 [id=e1a9ab96f14847059cea861f9b9c3492]
I20260928 20:03:20.759774 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_9ef30a62591542edab5ee1be742ee4b3 [id=e246baf2b71f4e35811937013e2ff074]
I20260928 20:03:20.761077 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_0e324d2ffadb4e90871cc056c736bd27 [id=e260025cb2cd435bbb4389922d4a9426]
W20260928 20:03:20.763419 29115 log.cc:927] Time spent T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
W20260928 20:03:20.770519 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 53310.9us
I20260928 20:03:20.775166 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:20.790315 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 117444us
I20260928 20:03:20.791046 26450 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.791783 29055 raft_consensus.cc:2804] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:20.792207 29055 raft_consensus.cc:697] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:20.793040 29055 consensus_queue.cc:237] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.812005 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279]
I20260928 20:03:20.813331 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_d3b253774b324f229aed498d392a1514 [id=e370d4e71e194623b62982406b02dfec]
W20260928 20:03:20.823367 26594 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:20.830120 26450 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:20.830610 26450 leader_election.cc:304] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:20.831198 28870 raft_consensus.cc:515] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.835968 26912 tablet_bootstrap.cc:654] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:20.842796 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18]
I20260928 20:03:20.844216 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_2a6a2e75f86f4344ba5d2e495190619b [id=e5a58b48db114aa29aca24eec47130d9]
I20260928 20:03:20.845546 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_07b83969683b44e6a8cfc75d770cd0be [id=e7207699bc354c2fa79e9c58574cddd1]
I20260928 20:03:20.849820 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_ba5e44badca344a2b91e22382cdb8ac1 [id=ec32368ba1694873892ec3f1a5140105]
I20260928 20:03:20.851329 29073 raft_consensus.cc:493] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.851792 29073 raft_consensus.cc:515] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:20.853710 29073 leader_election.cc:290] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:20.854358 29073 raft_consensus.cc:2749] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:20.856426 26916 tablet_bootstrap.cc:492] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:20.856834 26916 ts_tablet_manager.cc:1449] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.301s user 0.012s sys 0.000s
I20260928 20:03:20.859282 26916 raft_consensus.cc:359] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.859849 26916 raft_consensus.cc:385] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.860101 26916 raft_consensus.cc:740] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:20.860774 26916 consensus_queue.cc:260] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.864317 26913 tablet_bootstrap.cc:654] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:20.864838 26916 ts_tablet_manager.cc:1480] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260928 20:03:20.865717 26916 tablet_bootstrap.cc:492] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:20.870545 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 61645.9us
I20260928 20:03:20.875378 29111 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.877436 29111 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:20.895151 28870 leader_election.cc:290] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:20.900593 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_8fdfcb3717154d7a8da1009ef6e6b13d [id=eecba72bbe4b47d5908cb12d57e2eece]
I20260928 20:03:20.926954 29036 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.927628 29036 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.902029 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]
I20260928 20:03:20.930876 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:20.931490 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_a6f405608c6542a6818f887b3abc1129 [id=ef08155a9e7b478a94ef141960781541]
I20260928 20:03:20.931443 26515 raft_consensus.cc:2468] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:20.932202 29036 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:20.938658 26912 tablet_bootstrap.cc:492] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:20.939123 26912 ts_tablet_manager.cc:1449] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.240s user 0.017s sys 0.001s
I20260928 20:03:20.935441 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_0c6396df18a447838b8edbf495c2f3dd [id=f004ce733e90484faa39955bca33a4fb]
I20260928 20:03:20.944792 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]
I20260928 20:03:20.907083 29012 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:20.948048 29012 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.950165 29012 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:20.957162 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 67477.1us
I20260928 20:03:20.941658 26912 raft_consensus.cc:359] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:20.963958 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]
I20260928 20:03:20.965332 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd]
I20260928 20:03:20.967347 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6ff2fe1d054eeebeebc6b3b5b5e4c1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:20.967979 26659 raft_consensus.cc:3060] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.972255 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_58732efb3f0e459c8af18aac5919b612 [id=f3479b39c6f7407fbd7b818cddb09f7a]
I20260928 20:03:20.974489 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_cdb14377bf684d90ba23733f91f3a0d6 [id=f70247fb59cd4a758fd2760ce97c6c91]
I20260928 20:03:20.974547 26659 raft_consensus.cc:2468] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:20.979276 26913 tablet_bootstrap.cc:492] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
W20260928 20:03:20.979156 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 149085us
I20260928 20:03:20.980104 26913 ts_tablet_manager.cc:1449] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.351s user 0.011s sys 0.000s
I20260928 20:03:20.980600 26450 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
W20260928 20:03:20.981468 26450 leader_election.cc:343] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:20.982055 26450 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:20.982878 26450 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:20.983045 26595 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 67464us
I20260928 20:03:20.962090 26912 raft_consensus.cc:385] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:20.985682 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.988435 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.989456 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.990608 29073 raft_consensus.cc:2804] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:20.991009 29073 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:20.991127 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.991348 29073 raft_consensus.cc:3060] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:20.992377 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.992931 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.992077 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.996183 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:20.997153 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:20.992642 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.001766 26916 tablet_bootstrap.cc:654] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.002074 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.009899 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.010648 26646 raft_consensus.cc:2393] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:21.023829 29073 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:21.029093 29111 consensus_queue.cc:1048] T e868e5a3ebd2494ca20e1e08a146850e P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:21.030506 26220 leader_election.cc:336] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899): Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.744s (SENT)
I20260928 20:03:21.030923 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:20.990602 26912 raft_consensus.cc:740] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.025875 29073 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.042640 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf]
W20260928 20:03:21.042764 26740 leader_election.cc:343] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:21.042484 26912 consensus_queue.cc:260] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.043350 26740 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:21.044076 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]
I20260928 20:03:21.044924 26912 ts_tablet_manager.cc:1480] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.106s user 0.009s sys 0.000s
I20260928 20:03:21.052248 26913 raft_consensus.cc:359] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.053318 26913 raft_consensus.cc:385] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.053841 26913 raft_consensus.cc:740] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.056622 29055 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.057070 29055 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.057360 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:21.057539 29124 raft_consensus.cc:493] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.057854 26512 raft_consensus.cc:3060] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.058007 29124 raft_consensus.cc:515] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.059010 29055 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.056814 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:21.059901 29124 leader_election.cc:290] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.060055 26515 raft_consensus.cc:2393] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:21.060691 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_3df208002e624823846e63d97d7d9038 [id=fbd517599006491b92bd6e5869c4212d]
I20260928 20:03:21.065182 26512 raft_consensus.cc:2468] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:21.067958 26916 tablet_bootstrap.cc:492] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:21.068396 26916 ts_tablet_manager.cc:1449] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.203s user 0.010s sys 0.000s
I20260928 20:03:21.061961 29001 catalog_manager.cc:692] Loaded metadata for table default.Table_db4ea683c5a44f919cbc94271cd36567 [id=fc063b01e61e4f5987f5a014fc218959]
I20260928 20:03:21.083045 26916 raft_consensus.cc:359] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.083809 26916 raft_consensus.cc:385] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.084071 26916 raft_consensus.cc:740] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:21.084502 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 55627.8us
I20260928 20:03:21.084699 26916 consensus_queue.cc:260] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.087126 26916 ts_tablet_manager.cc:1480] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260928 20:03:21.087776 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.093145 26595 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.094848 26595 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.095970 29012 raft_consensus.cc:2749] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:21.096540 29012 raft_consensus.cc:2804] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.096822 29012 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.097101 29012 raft_consensus.cc:3060] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.104334 29128 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:21.105446 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 74975.2us
I20260928 20:03:21.107342 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.117558 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:21.118078 26510 raft_consensus.cc:2468] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:21.045929 26912 tablet_bootstrap.cc:492] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:21.046214 29075 raft_consensus.cc:2804] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.122295 29075 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.122655 29075 raft_consensus.cc:3060] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.133963 26913 consensus_queue.cc:260] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.139393 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.139985 26646 raft_consensus.cc:2468] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:21.141192 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.143498 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.144687 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.145191 26646 raft_consensus.cc:2468] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:21.150080 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.151422 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.152679 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:21.153312 26646 raft_consensus.cc:2393] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:21.041983 29092 raft_consensus.cc:493] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.154222 29012 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.154435 29092 raft_consensus.cc:515] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.156246 29012 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:21.156967 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 62281.3us
I20260928 20:03:21.157115 29092 leader_election.cc:290] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.056440 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.157860 26595 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.077340 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:21.158959 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:21.115063 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.159658 26513 raft_consensus.cc:2393] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:21.160595 29075 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.161748 26799 raft_consensus.cc:2393] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:21.164834 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:21.165314 26513 raft_consensus.cc:3060] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.166018 26916 tablet_bootstrap.cc:492] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:21.166662 26595 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.167650 26595 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.168290 29106 raft_consensus.cc:2804] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.168617 29106 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.168941 29106 raft_consensus.cc:3060] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.174276 29107 raft_consensus.cc:2804] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.174664 29107 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.175451 29107 raft_consensus.cc:3060] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.137933 26913 ts_tablet_manager.cc:1480] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.157s user 0.005s sys 0.002s
I20260928 20:03:21.187050 26913 tablet_bootstrap.cc:492] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:21.189978 29068 raft_consensus.cc:2804] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:21.193198 29068 raft_consensus.cc:697] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:21.194002 29068 consensus_queue.cc:237] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.197002 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:21.197654 26514 raft_consensus.cc:2468] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:21.211802 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:21.221161 26913 tablet_bootstrap.cc:654] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.231565 29075 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.232436 26739 leader_election.cc:304] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:21.232506 29107 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.209170 29106 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:21.235129 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:21.235862 29106 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.236106 26505 raft_consensus.cc:3060] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.240248 29036 raft_consensus.cc:2804] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:21.240697 29036 raft_consensus.cc:697] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:21.241494 29036 consensus_queue.cc:237] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.245692 29068 raft_consensus.cc:493] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.246136 29068 raft_consensus.cc:515] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.247939 29068 leader_election.cc:290] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.249711 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.252964 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.254053 26912 tablet_bootstrap.cc:654] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.253930 26513 raft_consensus.cc:2468] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:21.255172 26740 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:21.255998 29075 raft_consensus.cc:2804] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:21.256407 26505 raft_consensus.cc:2468] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:21.257359 29075 raft_consensus.cc:697] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:21.258149 29075 consensus_queue.cc:237] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.260967 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.267390 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:21.268154 26505 raft_consensus.cc:2393] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:21.273813 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:21.274299 26450 leader_election.cc:343] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.274300 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 73910.6us
W20260928 20:03:21.278678 26594 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.282871 29107 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.284036 26912 tablet_bootstrap.cc:492] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:21.283933 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:21.284471 26912 ts_tablet_manager.cc:1449] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.239s user 0.008s sys 0.003s
I20260928 20:03:21.285563 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:21.293082 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:21.296962 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.274354 26512 raft_consensus.cc:2468] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:21.320039 26594 leader_election.cc:343] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.321717 26594 leader_election.cc:343] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.307292 26916 tablet_bootstrap.cc:654] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.275652 26450 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.336755 29124 raft_consensus.cc:2749] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:21.338985 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 64778.9us
W20260928 20:03:21.339675 26450 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.340518 26450 leader_election.cc:343] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.340894 26450 leader_election.cc:304] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.341572 29124 raft_consensus.cc:2749] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:21.342411 27792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 53980.4us
W20260928 20:03:21.342716 26450 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.343047 26450 leader_election.cc:304] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.367957 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:21.374694 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 53027us
W20260928 20:03:21.376863 26594 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.401145 29124 raft_consensus.cc:2749] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:21.403177 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 60482.5us
W20260928 20:03:21.403832 26450 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.404170 26450 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:21.405076 26594 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.423859 26913 tablet_bootstrap.cc:492] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:21.424415 26912 raft_consensus.cc:359] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.425118 26912 raft_consensus.cc:385] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.425400 26912 raft_consensus.cc:740] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.426203 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:21.427416 26659 raft_consensus.cc:2393] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:21.428068 26912 consensus_queue.cc:260] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.429520 26912 ts_tablet_manager.cc:1480] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.145s user 0.006s sys 0.001s
I20260928 20:03:21.444706 29124 raft_consensus.cc:2749] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:21.448340 26450 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.449139 26450 leader_election.cc:343] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.449791 26450 leader_election.cc:343] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.450408 26450 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.457713 26916 tablet_bootstrap.cc:492] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:21.424772 26913 ts_tablet_manager.cc:1449] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.238s user 0.014s sys 0.016s
I20260928 20:03:21.458686 26912 tablet_bootstrap.cc:492] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:21.497769 26791 raft_consensus.cc:3060] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.459589 26916 ts_tablet_manager.cc:1449] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.294s user 0.018s sys 0.000s
I20260928 20:03:21.461073 26913 raft_consensus.cc:359] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.527002 26913 raft_consensus.cc:385] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.527745 26913 raft_consensus.cc:740] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.529173 26913 consensus_queue.cc:260] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.534435 26916 raft_consensus.cc:359] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.535080 26916 raft_consensus.cc:385] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.535322 26916 raft_consensus.cc:740] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.534968 29133 consensus_queue.cc:1048] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:21.510075 26912 tablet_bootstrap.cc:654] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.566151 26739 leader_election.cc:304] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:21.575290 29092 raft_consensus.cc:2749] T 25512bb19e3c4f78bb917378b10021e5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:21.505141 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 54743.7us
W20260928 20:03:21.577363 26450 leader_election.cc:343] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.579059 26450 leader_election.cc:343] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.579622 26450 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.580154 26450 leader_election.cc:343] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.580693 26450 leader_election.cc:343] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.582171 26450 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:21.582732 26450 leader_election.cc:343] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.601593 26913 ts_tablet_manager.cc:1480] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.143s user 0.006s sys 0.001s
I20260928 20:03:21.607199 29133 raft_consensus.cc:493] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.607795 29133 raft_consensus.cc:515] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.610281 29133 leader_election.cc:290] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.614704 26913 tablet_bootstrap.cc:492] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:21.535876 26916 consensus_queue.cc:260] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.623477 26916 ts_tablet_manager.cc:1480] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.101s user 0.002s sys 0.005s
I20260928 20:03:21.624526 26916 tablet_bootstrap.cc:492] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:21.628695 26450 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.631152 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.632452 26595 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.633363 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:21.635198 29068 raft_consensus.cc:2749] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:21.635842 29068 consensus_queue.cc:1048] T 87718f040f0d4b9d88a551cae4f0d47f P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:21.637545 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:21.653210 29075 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.653705 29075 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.655791 29075 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.668018 26913 tablet_bootstrap.cc:654] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.675264 26912 tablet_bootstrap.cc:492] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:21.675688 26912 ts_tablet_manager.cc:1449] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.217s user 0.010s sys 0.000s
I20260928 20:03:21.675881 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:21.676608 26513 raft_consensus.cc:2393] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:21.685334 29124 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.685832 29124 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.687805 29124 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.704715 29124 raft_consensus.cc:493] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.705138 29124 raft_consensus.cc:515] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.707196 29124 leader_election.cc:290] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.734714 26595 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.735183 26912 raft_consensus.cc:359] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.735809 26912 raft_consensus.cc:385] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.736068 26912 raft_consensus.cc:740] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.737546 29106 raft_consensus.cc:2804] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.737864 29106 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.738188 29106 raft_consensus.cc:3060] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.742556 29108 consensus_queue.cc:1048] T 311f004a7acc4d43b4b88564b57efa74 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:21.748871 26595 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.750878 29107 raft_consensus.cc:2804] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.751231 29107 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.751586 29107 raft_consensus.cc:3060] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.762131 26595 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.769515 26595 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.771027 29108 raft_consensus.cc:2749] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:21.771552 29108 raft_consensus.cc:2804] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:21.771912 29108 raft_consensus.cc:697] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:21.774262 29108 consensus_queue.cc:237] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.778149 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:21.789559 26594 leader_election.cc:343] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.792475 29107 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.795977 26595 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.796619 29068 raft_consensus.cc:2749] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:21.768237 29106 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:21.799710 29068 raft_consensus.cc:493] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.800125 29068 raft_consensus.cc:515] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.802273 29068 leader_election.cc:290] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.804097 26595 leader_election.cc:304] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.812408 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:21.813093 26646 raft_consensus.cc:2393] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:21.816534 26913 tablet_bootstrap.cc:492] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:21.816967 26913 ts_tablet_manager.cc:1449] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.202s user 0.018s sys 0.003s
I20260928 20:03:21.817440 29106 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.773054 26912 consensus_queue.cc:260] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.819329 26913 raft_consensus.cc:359] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.826954 26913 raft_consensus.cc:385] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:21.827246 26913 raft_consensus.cc:740] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:21.826972 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.821720 29149 raft_consensus.cc:2804] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:21.829051 29124 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.829476 29149 raft_consensus.cc:493] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.829484 29124 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.829872 29149 raft_consensus.cc:3060] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:21.833034 29124 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.827839 26913 consensus_queue.cc:260] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.837033 26913 ts_tablet_manager.cc:1480] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20260928 20:03:21.837908 26913 tablet_bootstrap.cc:492] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:21.831339 26740 consensus_peers.cc:597] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:21.855454 29124 raft_consensus.cc:493] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:21.856866 26450 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.824232 29107 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.824841 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.866555 29149 raft_consensus.cc:515] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.869711 26912 ts_tablet_manager.cc:1480] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.193s user 0.014s sys 0.002s
I20260928 20:03:21.883793 26916 tablet_bootstrap.cc:700] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent opening tablet: real 0.139s user 0.003s sys 0.000s
I20260928 20:03:21.884471 26916 tablet_bootstrap.cc:654] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:21.869518 26595 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 47870.6us
I20260928 20:03:21.886915 29124 raft_consensus.cc:515] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.889791 29124 leader_election.cc:290] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.890298 29124 raft_consensus.cc:493] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:21.890728 29124 raft_consensus.cc:515] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:21.892648 29124 leader_election.cc:290] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:21.895978 29149 leader_election.cc:290] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:21.900314 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:21.901129 26652 raft_consensus.cc:2393] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:21.871085 26913 tablet_bootstrap.cc:654] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:21.911854 26912 tablet_bootstrap.cc:492] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:21.932147 29108 consensus_queue.cc:1048] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:21.941695 27792 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899): Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.598s (SENT)
I20260928 20:03:21.857285 26450 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.945994 29152 raft_consensus.cc:2749] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:21.946161 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 89328.7us
W20260928 20:03:21.946786 26450 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.947130 26450 leader_election.cc:304] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.950042 29152 raft_consensus.cc:2749] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:21.950400 26450 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.951282 29152 raft_consensus.cc:2804] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260928 20:03:21.951574 26450 leader_election.cc:343] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.951582 29152 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:21.951973 26450 leader_election.cc:304] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:21.951993 29152 raft_consensus.cc:3060] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:21.952901 26450 leader_election.cc:343] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:21.953241 26450 leader_election.cc:304] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:21.966786 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.598s (SENT)
I20260928 20:03:21.967207 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:21.978606 26913 tablet_bootstrap.cc:492] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:21.978998 26913 ts_tablet_manager.cc:1449] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.141s user 0.006s sys 0.006s
I20260928 20:03:21.982640 29157 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:21.999536 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:22.000375 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:22.000634 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:22.001575 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:22.009151 29156 raft_consensus.cc:2749] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:22.011914 26740 consensus_peers.cc:597] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:22.025853 26916 tablet_bootstrap.cc:492] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:22.026321 26916 ts_tablet_manager.cc:1449] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.402s user 0.011s sys 0.000s
I20260928 20:03:22.035858 29156 raft_consensus.cc:2749] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:22.044541 26913 raft_consensus.cc:359] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.050552 29075 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.051059 29075 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.053166 29075 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.054952 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:22.015048 29152 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.088112 29124 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.088646 29124 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.090682 29124 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.096787 29001 tablet_loader.cc:96] loaded metadata for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200])
I20260928 20:03:22.113224 26916 raft_consensus.cc:359] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:22.113960 26916 raft_consensus.cc:385] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:22.114240 26916 raft_consensus.cc:740] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:22.114878 26916 consensus_queue.cc:260] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:22.103574 26912 tablet_bootstrap.cc:654] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:22.085152 26594 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:22.118731 26594 leader_election.cc:343] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:22.119275 26594 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.120447 26913 raft_consensus.cc:385] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:22.120957 26913 raft_consensus.cc:740] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:22.121707 26913 consensus_queue.cc:260] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.124689 26913 ts_tablet_manager.cc:1480] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.145s user 0.006s sys 0.000s
I20260928 20:03:22.126638 26913 tablet_bootstrap.cc:492] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:22.132920 26594 leader_election.cc:343] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:22.150475 26740 consensus_peers.cc:597] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:22.158457 29001 tablet_loader.cc:96] loaded metadata for tablet 029a15ae85ff48d897493156fdd41d3b (table default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d])
I20260928 20:03:22.200685 29155 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.201231 29155 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.205487 26913 tablet_bootstrap.cc:654] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:22.215037 29001 tablet_loader.cc:96] loaded metadata for tablet 03bd721cb5b34b9288fad286290db847 (table default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29])
I20260928 20:03:22.218303 29155 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.219053 29068 raft_consensus.cc:493] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.219502 29068 raft_consensus.cc:515] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.219965 29152 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.221346 29068 leader_election.cc:290] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.230422 29001 tablet_loader.cc:96] loaded metadata for tablet 03d9d379b2e647d1a020406acc54bc75 (table default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8])
I20260928 20:03:22.231878 26916 ts_tablet_manager.cc:1480] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.205s user 0.006s sys 0.000s
I20260928 20:03:22.233796 26916 tablet_bootstrap.cc:492] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:22.236980 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 284076us
I20260928 20:03:22.237720 26450 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:22.238407 29152 raft_consensus.cc:2804] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:22.238735 29152 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:22.239054 29152 raft_consensus.cc:3060] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:22.242656 26450 leader_election.cc:343] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.243098 26450 leader_election.cc:304] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:22.243341 29161 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.243788 29161 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:22.247062 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:22.255545 29001 tablet_loader.cc:96] loaded metadata for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f])
I20260928 20:03:22.272025 26913 tablet_bootstrap.cc:492] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:22.272902 26913 ts_tablet_manager.cc:1449] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.147s user 0.012s sys 0.002s
I20260928 20:03:22.277944 26739 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:22.278702 29141 raft_consensus.cc:3060] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:22.276886 29001 tablet_loader.cc:96] loaded metadata for tablet 04a3511e5f1b42e4b48342a50f013fd0 (table default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e])
I20260928 20:03:22.284552 29001 tablet_loader.cc:96] loaded metadata for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c])
I20260928 20:03:22.294008 29075 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.294548 29075 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.297448 29075 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.298841 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:22.299578 26513 raft_consensus.cc:2393] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:22.302059 26912 tablet_bootstrap.cc:492] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:22.302568 26912 ts_tablet_manager.cc:1449] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.403s user 0.014s sys 0.014s
I20260928 20:03:22.304911 26912 raft_consensus.cc:359] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.305666 26912 raft_consensus.cc:385] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:22.309702 29155 raft_consensus.cc:2749] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:22.310885 29001 tablet_loader.cc:96] loaded metadata for tablet 06f7b05e756f4a4db5031ff1e14c6ff6 (table default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2])
W20260928 20:03:22.311120 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 68488.9us
W20260928 20:03:22.311797 26450 leader_election.cc:343] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.311987 29001 tablet_loader.cc:96] loaded metadata for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3])
I20260928 20:03:22.312184 26450 leader_election.cc:304] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:22.312861 29155 raft_consensus.cc:2749] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:22.313918 26450 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:22.304361 26913 raft_consensus.cc:359] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.314550 29155 raft_consensus.cc:2749] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:22.314802 26913 raft_consensus.cc:385] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:22.315056 26913 raft_consensus.cc:740] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:22.320019 29001 tablet_loader.cc:96] loaded metadata for tablet 0abf33cd0d114c25a729bd0eb8ae1278 (table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92])
I20260928 20:03:22.325169 29001 tablet_loader.cc:96] loaded metadata for tablet 0b42615f62284e359cdc1f4c9cc715c5 (table default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0])
I20260928 20:03:22.330515 29001 tablet_loader.cc:96] loaded metadata for tablet 0dc1eea43de1459aa49e7072cf8b89ca (table default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a])
I20260928 20:03:22.343420 29001 tablet_loader.cc:96] loaded metadata for tablet 0fd962ebd7d9413e866b0cfee2cd7134 (table default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb])
I20260928 20:03:22.245992 29161 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:22.349546 29001 tablet_loader.cc:96] loaded metadata for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc])
I20260928 20:03:22.356457 29155 raft_consensus.cc:493] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.356905 29155 raft_consensus.cc:515] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.358840 29155 leader_election.cc:290] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.367995 29001 tablet_loader.cc:96] loaded metadata for tablet 158ddf1201784a93ada93e629befa030 (table default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923])
I20260928 20:03:22.375311 29001 tablet_loader.cc:96] loaded metadata for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6])
I20260928 20:03:22.382433 29001 tablet_loader.cc:96] loaded metadata for tablet 19331ec575fa42d79c0dc18123d26d71 (table default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015])
I20260928 20:03:22.388221 29141 raft_consensus.cc:2749] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:22.388782 29001 tablet_loader.cc:96] loaded metadata for tablet 1d016129c3a140518cf310089360c7b7 (table default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd])
I20260928 20:03:22.393658 29152 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:22.396394 29152 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.397150 29001 tablet_loader.cc:96] loaded metadata for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d])
I20260928 20:03:22.415678 26912 raft_consensus.cc:740] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:22.415014 29001 tablet_loader.cc:96] loaded metadata for tablet 2034cd490bd14992aa2572f31d2ff63b (table default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e])
I20260928 20:03:22.417044 26912 consensus_queue.cc:260] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.419353 26912 ts_tablet_manager.cc:1480] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.117s user 0.004s sys 0.001s
I20260928 20:03:22.422017 29001 tablet_loader.cc:96] loaded metadata for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf])
I20260928 20:03:22.427753 29001 tablet_loader.cc:96] loaded metadata for tablet 21cb34c5e33544c9875e7babf4830164 (table default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd])
I20260928 20:03:22.438812 29001 tablet_loader.cc:96] loaded metadata for tablet 22e032f645304dbc88a895fae4bbd777 (table default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18])
I20260928 20:03:22.450168 29001 tablet_loader.cc:96] loaded metadata for tablet 23e030d67e3a476abf25301e888fecc0 (table default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279])
I20260928 20:03:22.457994 29001 tablet_loader.cc:96] loaded metadata for tablet 25512bb19e3c4f78bb917378b10021e5 (table default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0])
I20260928 20:03:22.465531 29001 tablet_loader.cc:96] loaded metadata for tablet 25595d85d1ad4ac7a80db4c55cd9c86f (table default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd])
W20260928 20:03:22.430552 26450 leader_election.cc:343] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.468863 26450 leader_election.cc:304] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:22.470011 26450 leader_election.cc:343] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.470757 26450 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:22.471441 29155 raft_consensus.cc:2749] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:22.472033 29155 raft_consensus.cc:2749] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:22.473254 26450 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.473697 26450 leader_election.cc:304] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:22.474462 29155 raft_consensus.cc:2749] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:22.450562 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 77681.4us
I20260928 20:03:22.491555 29001 tablet_loader.cc:96] loaded metadata for tablet 26797990cec14e87a4a30a3bbd2ff7c2 (table default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b])
I20260928 20:03:22.500144 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:22.521271 29001 tablet_loader.cc:96] loaded metadata for tablet 28c285483dd7460db934a160c5706d3d (table default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026])
I20260928 20:03:22.531639 26916 tablet_bootstrap.cc:654] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:22.536923 29001 tablet_loader.cc:96] loaded metadata for tablet 292fce41d80d47db93f95e2d4ee784ec (table default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7])
I20260928 20:03:22.540580 29075 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.541049 29075 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.542855 26912 tablet_bootstrap.cc:492] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:22.547904 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:22.548616 26513 raft_consensus.cc:2468] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:22.550148 29152 consensus_queue.cc:1048] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:22.553033 29001 tablet_loader.cc:96] loaded metadata for tablet 29c54767c86649b599ef539765d2b2dd (table default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301])
I20260928 20:03:22.560410 29001 tablet_loader.cc:96] loaded metadata for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3])
I20260928 20:03:22.563138 26740 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:22.564111 29001 tablet_loader.cc:96] loaded metadata for tablet 2a5ef01e0dbd49398b27911a713626cd (table default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02])
W20260928 20:03:22.565477 26450 leader_election.cc:343] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:22.568826 26450 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:22.568609 29001 tablet_loader.cc:96] loaded metadata for tablet 2d02292105e6430c9231f26b62befe34 (table default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a])
I20260928 20:03:22.569666 29152 consensus_queue.cc:1048] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:22.573565 29001 tablet_loader.cc:96] loaded metadata for tablet 2d1c8e5a49db49f39e90c3737c33e8fc (table default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf])
I20260928 20:03:22.595171 29092 raft_consensus.cc:2804] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:22.598229 29092 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:22.598623 29092 raft_consensus.cc:3060] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:22.608920 26912 tablet_bootstrap.cc:654] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:22.607640 29001 tablet_loader.cc:96] loaded metadata for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_99563ab39a854e5d9d4d2968f07bfe84 [id=0c98275433a24292b35617002df2cf6b])
W20260928 20:03:22.616083 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46586.3us
I20260928 20:03:22.618304 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:22.618858 26513 raft_consensus.cc:3060] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:22.620914 29075 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.622661 29092 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:22.668951 26740 consensus_peers.cc:597] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:22.626075 26513 raft_consensus.cc:2468] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:22.673585 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:22.675485 26652 raft_consensus.cc:2393] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:22.649097 26916 tablet_bootstrap.cc:492] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:22.687248 26916 ts_tablet_manager.cc:1449] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.454s user 0.015s sys 0.000s
I20260928 20:03:22.663092 29152 raft_consensus.cc:493] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.690752 29152 raft_consensus.cc:515] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.693437 29152 leader_election.cc:290] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.704995 29152 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.705490 29152 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.649405 29001 tablet_loader.cc:96] loaded metadata for tablet 309f8fcc50e545178888846ac90afcf2 (table default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2])
I20260928 20:03:22.707551 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:22.708352 26505 raft_consensus.cc:2393] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:22.708611 26913 consensus_queue.cc:260] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.713507 29152 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.689719 26916 raft_consensus.cc:359] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.714463 26916 raft_consensus.cc:385] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:22.714736 26916 raft_consensus.cc:740] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:22.715358 26916 consensus_queue.cc:260] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.726826 26916 ts_tablet_manager.cc:1480] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260928 20:03:22.750200 29092 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.750244 29152 raft_consensus.cc:493] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.750746 29152 raft_consensus.cc:515] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.754119 29152 leader_election.cc:290] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:22.757655 29154 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:22.759806 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:22.760453 26505 raft_consensus.cc:2468] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:22.764477 29001 tablet_loader.cc:96] loaded metadata for tablet 30ef26307b9a459f8634d59b1ca373ef (table default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59])
I20260928 20:03:22.775719 29154 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.781611 29107 raft_consensus.cc:493] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:22.787676 29001 tablet_loader.cc:96] loaded metadata for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d])
I20260928 20:03:22.782318 29107 raft_consensus.cc:515] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.778033 29154 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.795449 29107 leader_election.cc:290] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.809660 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:22.811165 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:22.811844 26515 raft_consensus.cc:2393] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:22.812959 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:22.813457 26515 raft_consensus.cc:2468] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:22.828605 26913 ts_tablet_manager.cc:1480] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.555s user 0.008s sys 0.010s
W20260928 20:03:22.829044 26913 ts_tablet_manager.cc:1513] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Tablet startup took 555ms
I20260928 20:03:22.842540 29001 tablet_loader.cc:96] loaded metadata for tablet 323a20314a734279a4af64e8b4f0ff0d (table default.Table_65e7aa358d65483d80d93aab4fbce62a [id=968c4c02a8aa4807b160bc13339e2022])
I20260928 20:03:22.843681 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:22.843828 29001 tablet_loader.cc:96] loaded metadata for tablet 34d91ea748a94cb7a75cbbd2f39f49f6 (table default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497])
I20260928 20:03:22.844506 26513 raft_consensus.cc:2393] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:22.862825 26912 tablet_bootstrap.cc:492] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:22.863328 26912 ts_tablet_manager.cc:1449] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.321s user 0.009s sys 0.002s
I20260928 20:03:22.879585 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:22.880235 26515 raft_consensus.cc:3060] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:22.888118 26515 raft_consensus.cc:2468] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:22.892897 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:22.896492 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:22.896896 26916 tablet_bootstrap.cc:492] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:22.898464 26655 raft_consensus.cc:2393] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
W20260928 20:03:22.829336 26913 ts_tablet_manager.cc:1515] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Trace:
0928 20:02:51.702629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:51.705389 (+ 2760us) service_pool.cc:224] Handling call
0928 20:02:51.734162 (+ 28773us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:51.734276 (+ 114us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:51.767264 (+ 32988us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:52.199690 (+432426us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:52.412483 (+212793us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800000f98. stack: 00007f5df58d3373 00007f5df58d3270 00007f5df5476574 0000000000516a24 00000000005169b9 00007f5df5789881 00007f5df58cdba1 00007f5df58ce1d2 00007f5dfe847379 00007f5dfda57c18 00007f5dfdb1e3d3 00007f5dfdb1a16f 00007f5dfdb1a92d 00007f5dfdac89b0 00007f5dfc04fbf4 00007f5dfc04fb82
0928 20:02:52.412759 (+ 276us) inbound_call.cc:177] Queueing success response
0928 20:03:22.125842 (+29713083us) ts_tablet_manager.cc:1425] Bootstrapping tablet
0928 20:03:22.273558 (+147716us) ts_tablet_manager.cc:1481] Starting tablet replica
0928 20:03:22.279083 (+ 5525us) tablet_replica.cc:261] Starting instrumentation
0928 20:03:22.293072 (+ 13989us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":3748,"raft.queue_time_us":46308,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":272,"spinlock_wait_cycles":24823040,"tablet-open.queue_time_us":29713091,"thread_start_us":117797,"threads_started":1}
I20260928 20:03:22.902917 26913 tablet_bootstrap.cc:492] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:22.905907 26916 tablet_bootstrap.cc:654] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:22.912652 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:22.913411 26652 raft_consensus.cc:2393] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:22.914186 29092 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:22.914806 29092 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.916867 29092 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:22.922039 26794 raft_consensus.cc:3060] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:22.926280 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:22.934386 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:22.934775 29001 tablet_loader.cc:96] loaded metadata for tablet 39880ebea60d4712a7e4734b100aeb11 (table default.Table_39b8a2a0083445798ec0e58e3b2db431 [id=c0c669d5c2ab41b1817259de4326ccd0])
I20260928 20:03:22.936048 29001 tablet_loader.cc:96] loaded metadata for tablet 39fb6f22905945578fa74b671d31c5f3 (table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec])
I20260928 20:03:22.937127 29001 tablet_loader.cc:96] loaded metadata for tablet 3b0694e341d64cdea99bb462beb1150b (table default.Table_d41c7a2638544b2b90e5398f97ad686b [id=84e0df88dcfd4d2d90bcd01c2849069b])
I20260928 20:03:22.943477 29141 consensus_queue.cc:1048] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:22.956713 26912 raft_consensus.cc:359] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.957576 26912 raft_consensus.cc:385] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:22.957888 26912 raft_consensus.cc:740] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:22.958597 26912 consensus_queue.cc:260] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.960783 26912 ts_tablet_manager.cc:1480] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.094s user 0.005s sys 0.000s
I20260928 20:03:22.984265 29001 tablet_loader.cc:96] loaded metadata for tablet 3cf943cffdd440caa2978769faed7f2c (table default.Table_39e9fc84df3844129902f8bb568244e2 [id=43ecf4974c7f4dc7a1ebcb5091d78076])
I20260928 20:03:22.985538 29001 tablet_loader.cc:96] loaded metadata for tablet 3e7c544b3449427dab981465e2e08a38 (table default.Table_3d54d1555a914679a1a011feaa634329 [id=8bce5ded64774186a5e753c7037b977f])
I20260928 20:03:22.987733 29001 tablet_loader.cc:96] loaded metadata for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353])
W20260928 20:03:22.991933 26594 leader_election.cc:343] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.005375 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.006072 26510 raft_consensus.cc:2468] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:23.009558 29149 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.009971 29149 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.012511 29149 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.023397 26916 tablet_bootstrap.cc:492] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:23.023870 26916 ts_tablet_manager.cc:1449] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.127s user 0.011s sys 0.000s
I20260928 20:03:22.989567 29001 tablet_loader.cc:96] loaded metadata for tablet 40942986095446f8a1b13da12315e804 (table default.Table_b6d3e2c8a9994b19b860b97f44a72785 [id=8f0c2c2f5bb74283976e75d6bcca7ba5])
I20260928 20:03:23.029501 29001 tablet_loader.cc:96] loaded metadata for tablet 41ac9772778c4fe8afc272f98eee2999 (table default.Table_d7d359f62a71495f99580370aacdbff7 [id=986f7e8be10e4f70930a513613b3731f])
I20260928 20:03:23.030812 29001 tablet_loader.cc:96] loaded metadata for tablet 42cf8cc998fb4039897ca93158c2202a (table default.Table_53c689bd6dc0475da06ec57192aaa587 [id=d739d9bcee244c8db96567e6cbc0fdc4])
I20260928 20:03:23.031214 26916 raft_consensus.cc:359] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.032166 26913 tablet_bootstrap.cc:654] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.037328 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.031850 26916 raft_consensus.cc:385] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.041909 26916 raft_consensus.cc:740] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.042575 26916 consensus_queue.cc:260] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:22.985801 26739 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:23.049799 29075 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:23.049954 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 66311.8us
I20260928 20:03:23.052459 29162 consensus_queue.cc:1048] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.054296 29149 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.054793 29149 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.057268 29149 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.060472 29001 tablet_loader.cc:96] loaded metadata for tablet 4433b79132934b48a3f2dd089592fcaf (table default.Table_101a375ee5e84e1aa7e611fc10883e70 [id=b8d510931aff47298bc0ae12b984ac8c])
I20260928 20:03:23.061597 29075 raft_consensus.cc:2749] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.061728 29001 tablet_loader.cc:96] loaded metadata for tablet 44f337138bc84030a3edf1ec1248d456 (table default.Table_faf293f941b845a992e4a5bc2f0d8e97 [id=00b3eb91544b41a1ab2a3b09f4f003ba])
I20260928 20:03:23.064694 26739 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:23.065369 29162 raft_consensus.cc:2749] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.066514 29001 tablet_loader.cc:96] loaded metadata for tablet 45dd4297f4aa400aa3be253bc3168390 (table default.Table_87c2af829d1743e89bc173be981dcbc7 [id=7edfca25231e43ef87f78fcc7816d969])
I20260928 20:03:23.068145 26916 ts_tablet_manager.cc:1480] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
I20260928 20:03:23.069032 29001 tablet_loader.cc:96] loaded metadata for tablet 47bf3dd9ed054197b4208324938d96b0 (table default.Table_448e0060fd3d49018e59b4875da55674 [id=474b74c08e6348da8e5de4405064735f])
I20260928 20:03:23.077709 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.078367 26514 raft_consensus.cc:2468] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:23.079106 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.079752 26515 raft_consensus.cc:2468] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:23.083942 26916 tablet_bootstrap.cc:492] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:23.099035 29162 consensus_queue.cc:1048] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.107631 29149 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.108080 29149 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.108629 26912 tablet_bootstrap.cc:492] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:23.111778 26739 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:23.112483 29075 raft_consensus.cc:2749] T ea01d2ddd91d4a0fa29afaebfbd83528 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.109985 29149 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.115911 26912 tablet_bootstrap.cc:654] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.070050 29001 tablet_loader.cc:96] loaded metadata for tablet 48d1af02ecb8456c8354ede7872b1ffb (table default.Table_4613895cb87549efa0173a0bc2de3828 [id=d3f0079cf16841ecb1f72fb8f91e79f9])
I20260928 20:03:23.141440 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.141835 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.142418 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.142632 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.143826 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.144375 26653 raft_consensus.cc:2468] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:23.145346 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.145849 26657 raft_consensus.cc:2468] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:23.145844 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.146420 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.146775 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.147116 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.147552 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.148222 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:23.148566 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.146697 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.149433 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:23.150434 26657 raft_consensus.cc:2393] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:23.151304 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.152326 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.163695 26913 tablet_bootstrap.cc:492] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:23.163744 29001 tablet_loader.cc:96] loaded metadata for tablet 4ba5d2cc979241c4918a154f25dcd305 (table default.Table_07b83969683b44e6a8cfc75d770cd0be [id=e7207699bc354c2fa79e9c58574cddd1])
I20260928 20:03:23.164255 26913 ts_tablet_manager.cc:1449] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.262s user 0.007s sys 0.004s
I20260928 20:03:23.172022 26916 tablet_bootstrap.cc:654] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.186496 26913 raft_consensus.cc:359] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.198390 26913 raft_consensus.cc:385] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.210836 29001 tablet_loader.cc:96] loaded metadata for tablet 4ce6188a8420478ab3565fbc9fb7e5e9 (table default.Table_3bbea633f65b40279f5e069f2cf18cd3 [id=93f93c4333824319bec279868d0f3cfe])
I20260928 20:03:23.216598 26912 tablet_bootstrap.cc:492] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:23.216993 26912 ts_tablet_manager.cc:1449] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.003s
I20260928 20:03:23.200651 26913 raft_consensus.cc:740] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.229405 26916 tablet_bootstrap.cc:492] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:23.229856 26916 ts_tablet_manager.cc:1449] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.152s user 0.011s sys 0.000s
I20260928 20:03:23.223815 26913 consensus_queue.cc:260] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.235280 26912 raft_consensus.cc:359] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.235924 26912 raft_consensus.cc:385] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.236167 26912 raft_consensus.cc:740] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.236756 26912 consensus_queue.cc:260] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.237072 26916 raft_consensus.cc:359] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.237638 26916 raft_consensus.cc:385] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.237885 26916 raft_consensus.cc:740] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.239231 26916 consensus_queue.cc:260] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.240738 26913 ts_tablet_manager.cc:1480] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.076s user 0.008s sys 0.000s
I20260928 20:03:23.240949 26916 ts_tablet_manager.cc:1480] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260928 20:03:23.241145 29001 tablet_loader.cc:96] loaded metadata for tablet 502edf35a86646178cfc121519c85c53 (table default.Table_ba5e44badca344a2b91e22382cdb8ac1 [id=ec32368ba1694873892ec3f1a5140105])
I20260928 20:03:23.241781 26916 tablet_bootstrap.cc:492] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:23.253115 26913 tablet_bootstrap.cc:492] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:23.255154 26912 ts_tablet_manager.cc:1480] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.038s user 0.005s sys 0.003s
I20260928 20:03:23.254261 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.257436 29001 tablet_loader.cc:96] loaded metadata for tablet 534674440ee649e4afbc87b3cce5c43e (table default.Table_e8c7c9bf121c488eb28e0006cf46469c [id=d258873b4bfc4dd188356430c116e0ae])
I20260928 20:03:23.258637 29001 tablet_loader.cc:96] loaded metadata for tablet 56b3ac3820e34f519f593a794b7e0899 (table default.Table_4a912910bc1f4d59b94845c363144d28 [id=44987915fb2445b5b13c7df9db3e40e8])
W20260928 20:03:23.261211 26594 leader_election.cc:343] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.262976 29149 consensus_queue.cc:1048] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.284101 29001 tablet_loader.cc:96] loaded metadata for tablet 583d005c68fd4e30ad705080c620226a (table default.Table_8d28094f407f435190e32f3d52716436 [id=b5bed5274cdf4c1f886428eb339e5f57])
I20260928 20:03:23.285789 29171 raft_consensus.cc:493] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.286273 29171 raft_consensus.cc:515] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.288686 29171 leader_election.cc:290] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.285385 29001 tablet_loader.cc:96] loaded metadata for tablet 585030449f204e5782c3200758324ebc (table default.Table_02fef5b38f4b4eb382f4fba80de72cc3 [id=e1a9ab96f14847059cea861f9b9c3492])
W20260928 20:03:23.309158 26740 consensus_peers.cc:597] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:23.315861 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.316548 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:23.317962 26595 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.318974 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.319315 29168 raft_consensus.cc:2804] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:23.319895 29168 raft_consensus.cc:697] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:23.320533 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:23.320806 29168 consensus_queue.cc:237] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.321801 26659 raft_consensus.cc:2393] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:23.322544 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.325428 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.328002 29001 tablet_loader.cc:96] loaded metadata for tablet 5b276f21d85c4bb4bdd777f8f9a43960 (table default.Table_505b4c5717db4fc4941b68e6271305a6 [id=85411afbf7894f15aa20dfcecafc0a17])
I20260928 20:03:23.331777 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.332621 26912 tablet_bootstrap.cc:492] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:23.338568 29171 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:23.339313 29171 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.340597 26912 tablet_bootstrap.cc:654] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.345865 29171 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.350906 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.359686 26913 tablet_bootstrap.cc:654] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.363009 26916 tablet_bootstrap.cc:654] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.377187 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.377820 26793 raft_consensus.cc:2468] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:23.349926 29001 tablet_loader.cc:96] loaded metadata for tablet 5bdb8870dce541a2afb3be09bcb3c701 (table default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 [id=b4cbe8131b3a4452bf9d0305f6d89940])
I20260928 20:03:23.396196 29001 tablet_loader.cc:96] loaded metadata for tablet 6048c2fc40cf48229c4822e6b68f9376 (table default.Table_cdb14377bf684d90ba23733f91f3a0d6 [id=f70247fb59cd4a758fd2760ce97c6c91])
I20260928 20:03:23.397399 29001 tablet_loader.cc:96] loaded metadata for tablet 61b2ba7635fd4a22ac367d3fdc4dd847 (table default.Table_c6e3b12edab441c89f9e255a1a1a001c [id=54949ec9d297437d8f79a73d487f9b7e])
I20260928 20:03:23.407478 26912 tablet_bootstrap.cc:492] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:23.408423 26912 ts_tablet_manager.cc:1449] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.076s user 0.011s sys 0.000s
I20260928 20:03:23.416538 29152 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.417038 29152 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.419014 29152 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:23.421165 29001 tablet_loader.cc:96] loaded metadata for tablet 61bd0122845044fd993d166824f3b9cc (table default.Table_83090de75bd14a7898987c9d0c93b871 [id=1f5468b83cf74cd49cde65514c10c24d])
I20260928 20:03:23.423759 29001 tablet_loader.cc:96] loaded metadata for tablet 6393d0583a9a47ec9eb455b30a548fc3 (table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0])
I20260928 20:03:23.424813 29001 tablet_loader.cc:96] loaded metadata for tablet 6447b96436b34949a35f93b93732a820 (table default.Table_d90e6a6913a54889810926926798a1b4 [id=3a5c78e561ee43729940d404c103ab3f])
I20260928 20:03:23.426853 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.428637 26912 raft_consensus.cc:359] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.429301 26912 raft_consensus.cc:385] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.429556 26912 raft_consensus.cc:740] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.430167 26912 consensus_queue.cc:260] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.431635 26912 ts_tablet_manager.cc:1480] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260928 20:03:23.432430 26912 tablet_bootstrap.cc:492] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:23.438671 26913 tablet_bootstrap.cc:492] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
W20260928 20:03:23.440608 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 422203us
I20260928 20:03:23.442276 26913 ts_tablet_manager.cc:1449] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.189s user 0.014s sys 0.000s
I20260928 20:03:23.449721 29195 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:23.426024 29001 tablet_loader.cc:96] loaded metadata for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6])
I20260928 20:03:23.451942 26916 tablet_bootstrap.cc:492] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:23.452323 29001 tablet_loader.cc:96] loaded metadata for tablet 674eef4920f94d4f88aa5dc3a0b362d3 (table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547])
I20260928 20:03:23.452500 26916 ts_tablet_manager.cc:1449] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.211s user 0.010s sys 0.000s
I20260928 20:03:23.453451 29001 tablet_loader.cc:96] loaded metadata for tablet 693cc46819bf4480b5cef0f9b92e66b2 (table default.Table_41f900344d434a3aa235b7a49f202b4f [id=8242c87c5c8148d58cb3ba7b8a1cdcbc])
I20260928 20:03:23.454530 29168 consensus_queue.cc:1048] T 25512bb19e3c4f78bb917378b10021e5 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.456982 26595 leader_election.cc:304] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.458135 26912 tablet_bootstrap.cc:654] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.458673 26595 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.460237 29171 raft_consensus.cc:2804] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:23.460556 29171 raft_consensus.cc:493] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:23.460863 29171 raft_consensus.cc:3060] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:23.462746 29149 consensus_queue.cc:1048] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.464067 29149 raft_consensus.cc:2749] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.470533 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:23.470978 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:23.472920 29001 tablet_loader.cc:96] loaded metadata for tablet 6c37ee6dd0e14f038c557985ab4c5b0b (table default.Table_66b4fb7dfd10446d99fa01b7f3b019ec [id=639bd5507dc14745860aadffb4b7c94e])
I20260928 20:03:23.480855 29001 tablet_loader.cc:96] loaded metadata for tablet 6e1791bc36c1449ebac8d1cef490be0a (table default.Table_b414add5e6554e31905d7f0162e3abb4 [id=9f809908d5c3416c895ea4d839c956ac])
I20260928 20:03:23.482242 29001 tablet_loader.cc:96] loaded metadata for tablet 6f3566ccc08d42d3a01d567430d1bc4b (table default.Table_a6f405608c6542a6818f887b3abc1129 [id=ef08155a9e7b478a94ef141960781541])
I20260928 20:03:23.483533 29001 tablet_loader.cc:96] loaded metadata for tablet 7053ca61ed6e4f6dbf1f5adb54728792 (table default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f [id=c43f875938fb4105b927b7aee9612a7c])
I20260928 20:03:23.484928 29001 tablet_loader.cc:96] loaded metadata for tablet 71272e843df3472ab06c4bd0be21d884 (table default.Table_22b94739706d4bcabfd2fe1c283c4ab9 [id=8e2065efd25245bfb73bf8fdcb9458af])
I20260928 20:03:23.490311 29171 raft_consensus.cc:515] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.497156 26916 raft_consensus.cc:359] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.497771 26916 raft_consensus.cc:385] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.498003 26916 raft_consensus.cc:740] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.498710 29001 tablet_loader.cc:96] loaded metadata for tablet 718a2abfe21b4a2986b77e14e4e52152 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8])
I20260928 20:03:23.498687 26916 consensus_queue.cc:260] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:23.502925 26594 consensus_peers.cc:597] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:23.506556 29195 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:23.511616 29001 tablet_loader.cc:96] loaded metadata for tablet 727fac90955d49caac8f1fa1567336b5 (table default.Table_a4c5888ebf824ce6934efcc6b4257595 [id=462e52b478724a6eb3ce35b6206673e3])
I20260928 20:03:23.513008 29001 tablet_loader.cc:96] loaded metadata for tablet 72ad5978f7624bcdb63ca9e71d29b2e4 (table default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 [id=62a432d0a82e48efb93877e3c46cb37b])
I20260928 20:03:23.520371 29195 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:23.522868 29001 tablet_loader.cc:96] loaded metadata for tablet 74f9252dd72c46b3acf84be7feb6a4f1 (table default.Table_52834d7c9e064555a1ed3e9cd8b98e34 [id=4e50219ff53c4c6c94eec881bb4cfe75])
I20260928 20:03:23.523988 29001 tablet_loader.cc:96] loaded metadata for tablet 756342f2b9a245c89ad8dbc6089b71d7 (table default.Table_0c6396df18a447838b8edbf495c2f3dd [id=f004ce733e90484faa39955bca33a4fb])
I20260928 20:03:23.529009 29171 leader_election.cc:290] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.446019 26913 raft_consensus.cc:359] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.534468 26913 raft_consensus.cc:385] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.534771 26913 raft_consensus.cc:740] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.536242 29001 tablet_loader.cc:96] loaded metadata for tablet 78c5918f0c05420b8ed8885c18c63907 (table default.Table_92b4d9ef87464f9b9b5582e6d529ac49 [id=57fa893f8f0f41fdb40c0150e9270d37])
I20260928 20:03:23.536962 29152 raft_consensus.cc:493] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.537402 29152 raft_consensus.cc:515] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.539204 29152 leader_election.cc:290] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:23.546917 26916 ts_tablet_manager.cc:1480] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.094s user 0.005s sys 0.000s
W20260928 20:03:23.547622 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 89045.6us
I20260928 20:03:23.548463 26595 leader_election.cc:304] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.550119 29168 raft_consensus.cc:2804] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:23.550455 29168 raft_consensus.cc:493] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:23.550766 29168 raft_consensus.cc:3060] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:23.551985 26912 tablet_bootstrap.cc:492] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:23.552398 26912 ts_tablet_manager.cc:1449] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.120s user 0.017s sys 0.003s
W20260928 20:03:23.554436 26594 leader_election.cc:343] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.555356 26913 consensus_queue.cc:260] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.555691 26912 raft_consensus.cc:359] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.556315 26912 raft_consensus.cc:385] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.556579 26912 raft_consensus.cc:740] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.557204 26912 consensus_queue.cc:260] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.564543 29168 raft_consensus.cc:515] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.570721 29001 tablet_loader.cc:96] loaded metadata for tablet 79967f9c7bf44678b9681449992776c5 (table default.Table_3df208002e624823846e63d97d7d9038 [id=fbd517599006491b92bd6e5869c4212d])
I20260928 20:03:23.572178 29001 tablet_loader.cc:96] loaded metadata for tablet 7b1a8c85b6bc4849b447b6fd048afb2f (table default.Table_c17f6d0dcd96486ca59966415e8978de [id=8b3fd73182f14c10b4a847d1ae537630])
I20260928 20:03:23.573313 29001 tablet_loader.cc:96] loaded metadata for tablet 7c865d2d368847dd9de688bdd65e88b9 (table default.Table_75a90a6806eb4588bfc09ac96125f4df [id=6029f28219a24f429bf99d14baa35339])
I20260928 20:03:23.570854 29168 leader_election.cc:290] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.575333 26912 ts_tablet_manager.cc:1480] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260928 20:03:23.573376 26595 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.585111 29169 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.586386 29001 tablet_loader.cc:96] loaded metadata for tablet 7d694b56de2a4954a367c2efa80aa276 (table default.Table_b620de746d7346efac926837182aa589 [id=18bdc683ddf64bf2a02bb5902f73933a])
I20260928 20:03:23.587488 29001 tablet_loader.cc:96] loaded metadata for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0])
I20260928 20:03:23.589269 29001 tablet_loader.cc:96] loaded metadata for tablet 7e78ac2ae0124b7b859a79bd9f1c203a (table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005])
W20260928 20:03:23.592609 26594 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:23.594640 26594 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:23.595322 29169 raft_consensus.cc:2804] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:23.595678 29169 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:23.596053 29169 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:23.605007 29169 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.606597 28870 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.607149 28870 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.607493 29169 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.608997 28870 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.610693 28870 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:23.610966 26450 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.611074 28870 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.611334 26450 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.612088 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.612753 26515 raft_consensus.cc:2393] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:23.612850 28870 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:23.614689 29001 tablet_loader.cc:96] loaded metadata for tablet 7e86d2d680c545e0b0511dec35ba6c9a (table default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af])
I20260928 20:03:23.614944 29152 raft_consensus.cc:2749] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.615854 29001 tablet_loader.cc:96] loaded metadata for tablet 807f3ef3db0f4319801baf86a331b98d (table default.Table_c628c1a16db34a3fbc9c818e95ad5f7a [id=65d9b7804d5e4d008d31a84cccc3458f])
I20260928 20:03:23.617660 29001 tablet_loader.cc:96] loaded metadata for tablet 8147a650aa614b2fb0af08077e60ddc8 (table default.Table_73bad59d2f45422d9e7f0409bdc4a2f4 [id=cbeeebe708654140b78d52a0bed4c6d0])
I20260928 20:03:23.619518 26912 tablet_bootstrap.cc:492] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:23.620170 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.620841 26515 raft_consensus.cc:2393] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:23.625002 26912 tablet_bootstrap.cc:654] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.652124 29001 tablet_loader.cc:96] loaded metadata for tablet 8536f4a4a0904806b71d4e7bf20c6bce (table default.Table_a343f55509fc4555836efe7503996740 [id=569aa44462c74840b9cd56304974e74e])
I20260928 20:03:23.656702 26912 tablet_bootstrap.cc:492] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:23.657125 26912 ts_tablet_manager.cc:1449] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.001s
I20260928 20:03:23.659637 26912 raft_consensus.cc:359] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.660250 26912 raft_consensus.cc:385] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.660502 26912 raft_consensus.cc:740] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.661088 26912 consensus_queue.cc:260] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.663834 26912 ts_tablet_manager.cc:1480] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260928 20:03:23.664740 26912 tablet_bootstrap.cc:492] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:23.668469 26916 tablet_bootstrap.cc:492] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:23.653952 29001 tablet_loader.cc:96] loaded metadata for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf])
I20260928 20:03:23.676066 29001 tablet_loader.cc:96] loaded metadata for tablet 87718f040f0d4b9d88a551cae4f0d47f (table default.Table_419bbb75ac2d4717b1cb696825cf70dc [id=4ad6473396cd4040b3abda93d38b0428])
I20260928 20:03:23.677953 29001 tablet_loader.cc:96] loaded metadata for tablet 8a3021bc9be24874a6ebee01dfb6d7fa (table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371])
I20260928 20:03:23.679076 29001 tablet_loader.cc:96] loaded metadata for tablet 8a616a7dbd8e4a99bc133f2bd61a4808 (table default.Table_039c27c2317f4d218f78454b1adcde10 [id=30d0193942bb4680bd08e5ed6064b8ac])
I20260928 20:03:23.681595 29001 tablet_loader.cc:96] loaded metadata for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f])
W20260928 20:03:23.686591 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 75655.2us
W20260928 20:03:23.687315 26450 leader_election.cc:343] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.687704 26450 leader_election.cc:304] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.688395 29152 raft_consensus.cc:2749] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:23.689567 26450 leader_election.cc:343] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.689936 26450 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.691728 26739 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:23.695340 26916 tablet_bootstrap.cc:654] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:23.692647 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 82537.2us
W20260928 20:03:23.701016 26594 leader_election.cc:343] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.702068 29001 tablet_loader.cc:96] loaded metadata for tablet 8d556a7736504aa2aa2fe8f868ecf489 (table default.Table_80b7e921026a449aac1078cb8ef22d63 [id=520a43e0bc5d418a9e1e2227a8e65249])
I20260928 20:03:23.694216 26595 leader_election.cc:304] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.703891 29001 tablet_loader.cc:96] loaded metadata for tablet 8eb99b1b34b844b4b6bdbd52c646f087 (table default.Table_6705a1b4132644408979a6ed69958eba [id=b265254a22fd4381a4c8135dda1abcd7])
I20260928 20:03:23.705653 29001 tablet_loader.cc:96] loaded metadata for tablet 90b887f248114c1fbe539769daac776d (table default.Table_0cc6e9ab6483451aadcf7beddfa7058a [id=8c9cbf00a11841bca0bd04b6e73dfdbc])
I20260928 20:03:23.706842 26912 tablet_bootstrap.cc:654] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.707196 29149 raft_consensus.cc:2804] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:23.707358 29203 raft_consensus.cc:493] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.708602 29149 raft_consensus.cc:697] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:23.708636 29203 raft_consensus.cc:515] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.709538 29149 consensus_queue.cc:237] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.723057 29001 tablet_loader.cc:96] loaded metadata for tablet 92397ac1a63a46e591e699e76627d5db (table default.Table_c68f60885a0940f583aa139abd8a834a [id=1fd0e6f7ff6b4552b40c8d2afce48966])
I20260928 20:03:23.728132 26912 tablet_bootstrap.cc:492] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:23.728538 26912 ts_tablet_manager.cc:1449] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.000s
I20260928 20:03:23.734961 26916 tablet_bootstrap.cc:492] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:23.735399 26916 ts_tablet_manager.cc:1449] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.067s user 0.008s sys 0.001s
I20260928 20:03:23.736824 29162 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:23.739351 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 47690.7us
I20260928 20:03:23.746815 26912 raft_consensus.cc:359] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.747484 26912 raft_consensus.cc:385] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.747730 26912 raft_consensus.cc:740] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.748490 26913 ts_tablet_manager.cc:1480] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.305s user 0.009s sys 0.004s
I20260928 20:03:23.717355 29203 leader_election.cc:290] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.750448 26912 consensus_queue.cc:260] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.725879 29001 tablet_loader.cc:96] loaded metadata for tablet 9491e639008c4678814d2f72beb04c3c (table default.Table_43a3511ec731472cb9111882b4c3a9a0 [id=8ba59aca002240cd8e1141423f0e6e68])
I20260928 20:03:23.752241 29001 tablet_loader.cc:96] loaded metadata for tablet 952ccda8ef5d47ceb19b9b5ab6ad8c9a (table default.Table_18c37f8dfcdb47169eb7230ea02b7b2a [id=03435de0a7f1414ca9387b9a6695e4a4])
I20260928 20:03:23.753371 29001 tablet_loader.cc:96] loaded metadata for tablet 9536760eb5114f23acac2918a0cd28bd (table default.Table_850721f396e049e48b48b6a6636ff076 [id=75699f46194e46278a2fa055683b658f])
I20260928 20:03:23.754391 29001 tablet_loader.cc:96] loaded metadata for tablet 95dfce3de1374f7a8c02c6898f6a741c (table default.Table_f9542fb9d4054fec841718053fedb559 [id=4d41cf8ff46f412b8c28cfd2279268e8])
I20260928 20:03:23.759130 26912 ts_tablet_manager.cc:1480] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.030s user 0.004s sys 0.002s
I20260928 20:03:23.760123 26912 tablet_bootstrap.cc:492] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:23.768169 29166 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.768769 29166 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.770622 29001 tablet_loader.cc:96] loaded metadata for tablet 964f7c83a1c048688ea1f3227a88bb8f (table default.Table_0e324d2ffadb4e90871cc056c736bd27 [id=e260025cb2cd435bbb4389922d4a9426])
I20260928 20:03:23.771631 29166 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.772555 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:23.773267 26510 raft_consensus.cc:2393] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:23.773662 29001 tablet_loader.cc:96] loaded metadata for tablet 979f943cd32849f399347f3d9d5b5c18 (table default.Table_8691e84d63084dd38d8988f4311c83c6 [id=5bcb1e3b9dec45df8affc72f783620c1])
I20260928 20:03:23.777697 29001 tablet_loader.cc:96] loaded metadata for tablet 9a6b825af9d04df38aebbb056f174ef7 (table default.Table_3697e383390b4709b95e01cb55f17c34 [id=23a824778def463ebc96837ae1766677])
W20260928 20:03:23.785856 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45918.3us
I20260928 20:03:23.786806 29001 tablet_loader.cc:96] loaded metadata for tablet 9b6d3f0467684127af0fcaa3ddac3fdd (table default.Table_66f34d73b85d4af58844cc7ea97a7866 [id=7915573b0b384fb693d6bdafe1bb095e])
I20260928 20:03:23.787914 29001 tablet_loader.cc:96] loaded metadata for tablet 9b943773d8804b0db0fbed9978461690 (table default.Table_0823e9b9b5284c5bb8c2752223dc68a4 [id=195a25265b964b7382826f865bcc3022])
I20260928 20:03:23.788942 29001 tablet_loader.cc:96] loaded metadata for tablet 9bce47a5ab1a44989abe1761cab0c714 (table default.Table_1a915ed0be934873a38f26d9661704fe [id=3ea7cdba6c2c4775aa2404a40482f3f4])
I20260928 20:03:23.794003 29152 raft_consensus.cc:2749] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:23.794196 26912 tablet_bootstrap.cc:654] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.794874 29152 raft_consensus.cc:493] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.795270 29152 raft_consensus.cc:515] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.797219 29152 leader_election.cc:290] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:23.798331 26916 raft_consensus.cc:359] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.798919 26916 raft_consensus.cc:385] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:23.799165 26916 raft_consensus.cc:740] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.799692 26916 consensus_queue.cc:260] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:23.801864 26916 ts_tablet_manager.cc:1480] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.066s user 0.004s sys 0.000s
I20260928 20:03:23.801916 29001 tablet_loader.cc:96] loaded metadata for tablet 9c4f6c6d4a0a4aada3a17d16c63d3b25 (table default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 [id=6fc28fd5258c423ab0cf022d50525caf])
I20260928 20:03:23.803038 29001 tablet_loader.cc:96] loaded metadata for tablet 9d2a20c1c6464f228baae236015349c5 (table default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080])
W20260928 20:03:23.802974 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 113430us
W20260928 20:03:23.803618 26450 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:23.804149 26450 leader_election.cc:343] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.817239 26913 tablet_bootstrap.cc:492] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:23.822778 29001 tablet_loader.cc:96] loaded metadata for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a])
I20260928 20:03:23.824038 29001 tablet_loader.cc:96] loaded metadata for tablet a0133314d6de46cea61a9260df79bdea (table default.Table_007ea4b1225442a2b70ad99fa3bafe73 [id=0d8dd739f4ba4c9baeccfb6cd40490c3])
W20260928 20:03:23.824218 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 78099.8us
I20260928 20:03:23.835882 26912 tablet_bootstrap.cc:492] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:23.836268 26912 ts_tablet_manager.cc:1449] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.076s user 0.008s sys 0.002s
I20260928 20:03:23.838474 26912 raft_consensus.cc:359] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.839121 26912 raft_consensus.cc:385] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:03:23.839134 26450 leader_election.cc:343] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.839365 26912 raft_consensus.cc:740] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:23.839951 26912 consensus_queue.cc:260] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.841683 26916 tablet_bootstrap.cc:492] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:23.825994 29001 tablet_loader.cc:96] loaded metadata for tablet a3717aae560f428b9cb7cf732dc71497 (table default.Table_b4f6fb24e5d14de3afcb16e1fded33fd [id=2c8fc0970bcb4a83bfd995dcb6ecdf1d])
I20260928 20:03:23.857635 29001 tablet_loader.cc:96] loaded metadata for tablet a6ce8cfd201343029b487dd6581bfb0a (table default.Table_c0cba0a8dbf4476e8c5b101a855ea68b [id=1ba1e6a48ca54423be0f36035c8308b7])
I20260928 20:03:23.850960 29149 consensus_queue.cc:1048] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260928 20:03:23.859894 29001 tablet_loader.cc:96] loaded metadata for tablet a8909dfef9034dcc8e899fac6ae5d8f1 (table default.Table_7cf3f31c382c41328b3bc3b015ec4320 [id=880148005f7949888ad9308950ae5b32])
I20260928 20:03:23.861030 29001 tablet_loader.cc:96] loaded metadata for tablet a8b15d2c55d94e64b75da8089a68b6e1 (table default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f [id=6ded8787f37141558c95545a1da78a73])
I20260928 20:03:23.859844 26595 leader_election.cc:304] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.862337 29202 raft_consensus.cc:2804] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:23.862668 29202 raft_consensus.cc:493] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:23.862974 29202 raft_consensus.cc:3060] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:23.839756 26450 leader_election.cc:343] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:23.868110 26450 leader_election.cc:343] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:23.868657 26450 leader_election.cc:343] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.869360 26912 ts_tablet_manager.cc:1480] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.033s user 0.005s sys 0.001s
I20260928 20:03:23.869608 29152 consensus_queue.cc:1048] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.870223 26912 tablet_bootstrap.cc:492] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:23.879139 26740 consensus_peers.cc:597] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d. This is attempt 6: this message will repeat every 5th retry.
W20260928 20:03:23.889315 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 49970.9us
I20260928 20:03:23.894202 29001 tablet_loader.cc:96] loaded metadata for tablet a9a8177684ed461cbc7bbc4aeb30873c (table default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228])
I20260928 20:03:23.896332 29001 tablet_loader.cc:96] loaded metadata for tablet aaae231bea404219875c82340c09df2b (table default.Table_b535172c333e41bba212d17bbb3a0a13 [id=5c5d5de98b4047919b9ded842e422341])
I20260928 20:03:23.897480 29001 tablet_loader.cc:96] loaded metadata for tablet ab9f9f2f9b96435e983f1ee2679563ff (table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440])
I20260928 20:03:23.899799 26912 tablet_bootstrap.cc:654] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:23.914261 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 44814.9us
W20260928 20:03:23.916460 26450 leader_election.cc:343] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:23.917243 26450 leader_election.cc:343] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:23.918021 29152 consensus_queue.cc:1048] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:23.919697 26450 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:23.920315 26450 leader_election.cc:343] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:23.925235 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 65466.2us
I20260928 20:03:23.930061 29001 tablet_loader.cc:96] loaded metadata for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e])
I20260928 20:03:23.930343 26595 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.931643 26595 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.931924 29203 raft_consensus.cc:2749] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:23.932623 26595 leader_election.cc:304] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:23.932578 29203 consensus_queue.cc:1048] T 5b276f21d85c4bb4bdd777f8f9a43960 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:23.933323 29168 raft_consensus.cc:2804] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:23.933642 29168 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:23.933943 29203 raft_consensus.cc:2804] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:23.934775 29203 raft_consensus.cc:493] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:23.934458 29202 raft_consensus.cc:515] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.935108 29203 raft_consensus.cc:3060] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:23.936322 29202 leader_election.cc:290] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.933959 29168 raft_consensus.cc:3060] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:23.938831 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 48867.1us
I20260928 20:03:23.939493 29001 tablet_loader.cc:96] loaded metadata for tablet af1a7a5ed5914712b8fb3ceb487e03ff (table default.Table_d36ac45737c44b2da07aee540f3e9a13 [id=be5fa7ea994c4cd5a37001168b4ef9f4])
I20260928 20:03:23.956686 29212 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:23.956014 29001 tablet_loader.cc:96] loaded metadata for tablet b13a571f3bd34209b0e6fd9441055eb1 (table default.Table_12847c70617446c79bef47447bba6e7f [id=24710d0e366c44a0b041c457b40e9385])
I20260928 20:03:23.964064 26916 tablet_bootstrap.cc:654] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.966894 29001 tablet_loader.cc:96] loaded metadata for tablet b1dc729477b8405d85c2c4a9c20a3efd (table default.Table_b82018a06c354d9291408f9811be2c33 [id=bcc46b95f2b14748ae012cc7dcf42b42])
I20260928 20:03:23.969440 29001 tablet_loader.cc:96] loaded metadata for tablet b31777af7102483fbcaab35a47d27852 (table default.Table_2a6a2e75f86f4344ba5d2e495190619b [id=e5a58b48db114aa29aca24eec47130d9])
I20260928 20:03:23.970557 29168 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:23.972147 26913 tablet_bootstrap.cc:654] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:23.972747 29168 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:23.989647 29203 raft_consensus.cc:515] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:23.999573 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 78718.4us
W20260928 20:03:24.000255 26450 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.001748 29152 raft_consensus.cc:493] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.002302 29152 raft_consensus.cc:515] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.004477 29152 leader_election.cc:290] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:24.011693 26594 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:24.022746 29001 tablet_loader.cc:96] loaded metadata for tablet b3ee867b0443431ba816ee5309888080 (table default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54])
I20260928 20:03:24.031359 29001 tablet_loader.cc:96] loaded metadata for tablet bba200d6ef33438187dd643fe3ded009 (table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41])
W20260928 20:03:24.000795 26450 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:24.032346 26450 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.033591 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.036427 26515 raft_consensus.cc:2468] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:24.037315 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.042444 29001 tablet_loader.cc:96] loaded metadata for tablet bc58b27db848454196f75b9077a203cb (table default.Table_8fdfcb3717154d7a8da1009ef6e6b13d [id=eecba72bbe4b47d5908cb12d57e2eece])
I20260928 20:03:24.047722 29152 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.048453 29152 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.050637 29152 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.052531 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.053371 26651 raft_consensus.cc:2393] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:24.061847 29001 tablet_loader.cc:96] loaded metadata for tablet c1cb96cab3e647908f3e99981e7147c7 (table default.Table_05c17087f17c40ccaef5290a60a1234d [id=45a830baeeb54dcdb2109f053a9413ac])
I20260928 20:03:24.063386 29212 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.071108 29001 tablet_loader.cc:96] loaded metadata for tablet c2385dd76e6d44319d3cdd4303feaa6b (table default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb [id=cead80ee7d2a408c9112b53b13e41fae])
I20260928 20:03:24.072162 29001 tablet_loader.cc:96] loaded metadata for tablet c3600b2fbb574106b5b13ab837754eb3 (table default.Table_2bd98a3ca12b417aa6115a75f74e752c [id=1967b4ffcea84c8ab364a0e946e5d86b])
I20260928 20:03:24.073228 29001 tablet_loader.cc:96] loaded metadata for tablet c49aa062e7674a47ac68fdadf68980b8 (table default.Table_58732efb3f0e459c8af18aac5919b612 [id=f3479b39c6f7407fbd7b818cddb09f7a])
I20260928 20:03:24.077240 29212 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.078734 26912 tablet_bootstrap.cc:492] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:24.079191 26912 ts_tablet_manager.cc:1449] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.209s user 0.020s sys 0.009s
I20260928 20:03:24.081661 26912 raft_consensus.cc:359] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.082355 26912 raft_consensus.cc:385] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.082605 26912 raft_consensus.cc:740] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.083128 26912 consensus_queue.cc:260] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.084455 26912 ts_tablet_manager.cc:1480] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260928 20:03:24.090382 26912 tablet_bootstrap.cc:492] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:24.101508 29001 tablet_loader.cc:96] loaded metadata for tablet caf030c329e64d208a3f507804edbd54 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8])
I20260928 20:03:24.103551 29001 tablet_loader.cc:96] loaded metadata for tablet cc643a95793d4797afb8889fcb54ef41 (table default.Table_92cd775d03ce43259e1527778a376855 [id=3bc1c712116e4b1bae264afc0f8030ed])
I20260928 20:03:24.104602 29001 tablet_loader.cc:96] loaded metadata for tablet cf1ac58577c345ee817e45b340601185 (table default.Table_4ab8d432c8da4b06acd99f3329549a73 [id=6f52e21fc32e4be58ef89782db2ebd56])
I20260928 20:03:24.105643 29001 tablet_loader.cc:96] loaded metadata for tablet d046e04498494659a96139f051e7bbc9 (table default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 [id=c4fd9da4958c44e19d97f5fb4d1ef9d6])
I20260928 20:03:24.115301 26912 tablet_bootstrap.cc:654] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:24.115477 26711 tablet.cc:2433] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:03:24.122469 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.123389 26651 raft_consensus.cc:2393] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:24.126474 29001 tablet_loader.cc:96] loaded metadata for tablet d0f9b3c3b4c84b19b4325152899e6b26 (table default.Table_8543155fabf44da1970cceef9f13d261 [id=d3d2473850b84badb95103c3973c6cd4])
I20260928 20:03:24.128589 29001 tablet_loader.cc:96] loaded metadata for tablet d1535def17b14663b42b76f3bc27001a (table default.Table_8fd74e2df9b84a1e998370b85625e609 [id=334efebe93f24b3d98e6a649ec121da4])
I20260928 20:03:24.129629 29001 tablet_loader.cc:96] loaded metadata for tablet d1b2dd9c6b864bb68925bf0687fb67d7 (table default.Table_db4ea683c5a44f919cbc94271cd36567 [id=fc063b01e61e4f5987f5a014fc218959])
I20260928 20:03:24.130578 29203 leader_election.cc:290] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.131641 29001 tablet_loader.cc:96] loaded metadata for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b])
I20260928 20:03:24.133592 29001 tablet_loader.cc:96] loaded metadata for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d])
I20260928 20:03:24.136894 26912 tablet_bootstrap.cc:492] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:24.137341 26912 ts_tablet_manager.cc:1449] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.001s
I20260928 20:03:24.139732 26912 raft_consensus.cc:359] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.140401 26912 raft_consensus.cc:385] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.140674 26912 raft_consensus.cc:740] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.141252 26912 consensus_queue.cc:260] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.146373 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:24.146924 26513 raft_consensus.cc:3060] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.148030 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:24.148559 26514 raft_consensus.cc:3060] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.150906 29001 tablet_loader.cc:96] loaded metadata for tablet d3e2de7890874892be6ae5a2008d8a12 (table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152])
I20260928 20:03:24.154754 26513 raft_consensus.cc:2468] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.157045 26514 raft_consensus.cc:2468] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.165920 26912 ts_tablet_manager.cc:1480] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260928 20:03:24.167171 26912 tablet_bootstrap.cc:492] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:24.172732 26912 tablet_bootstrap.cc:654] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.183013 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.183677 26657 raft_consensus.cc:2393] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:24.183965 29152 raft_consensus.cc:493] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.184445 29152 raft_consensus.cc:515] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.185786 29001 tablet_loader.cc:96] loaded metadata for tablet d479a8eabc624569968515684e8acb0c (table default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4])
I20260928 20:03:24.186484 29152 leader_election.cc:290] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.187026 29001 tablet_loader.cc:96] loaded metadata for tablet d4ac199f639c454cbc920012040f52c9 (table default.Table_c2e7429ecbd942bd908a88d634de17c6 [id=4a90001d3d204a01929c3a0d03e0bcc6])
I20260928 20:03:24.188189 29001 tablet_loader.cc:96] loaded metadata for tablet d5b804dcff3d494cad06ba072a082c1b (table default.Table_123669ff3966450d8a3dac4d2c6bd255 [id=bfcf8547a3264fc5868a8cd2635fa723])
I20260928 20:03:24.189406 29001 tablet_loader.cc:96] loaded metadata for tablet d5ed5998a6194061839143c4adf4d3d4 (table default.Table_13971cf4060b47aea813d1ea311e8347 [id=911769c45f044f3b8772d685b79d2e30])
I20260928 20:03:24.196406 26916 tablet_bootstrap.cc:492] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:24.199924 29001 tablet_loader.cc:96] loaded metadata for tablet d8c3346e3db1400c98623724cdf54901 (table default.Table_d3b253774b324f229aed498d392a1514 [id=e370d4e71e194623b62982406b02dfec])
I20260928 20:03:24.203013 26913 tablet_bootstrap.cc:492] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:24.203485 26913 ts_tablet_manager.cc:1449] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.387s user 0.011s sys 0.000s
I20260928 20:03:24.209431 29001 tablet_loader.cc:96] loaded metadata for tablet d9f0f9d65836425f966e9ee4f709915c (table default.Table_a367ac8973bb4ec4a752434bf59cd2a0 [id=bc50bdfe400c42fcbe7487dd842368ab])
I20260928 20:03:24.212253 26912 tablet_bootstrap.cc:492] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:24.212651 26912 ts_tablet_manager.cc:1449] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.007s
I20260928 20:03:24.215117 26912 raft_consensus.cc:359] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.215761 26912 raft_consensus.cc:385] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.215998 26912 raft_consensus.cc:740] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.216542 26912 consensus_queue.cc:260] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:24.217587 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 210473us
I20260928 20:03:24.218873 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.219471 26505 raft_consensus.cc:2468] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:24.220126 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.220808 26507 raft_consensus.cc:2393] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:24.221027 29221 raft_consensus.cc:493] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.221493 29221 raft_consensus.cc:515] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.222291 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:24.223827 29221 leader_election.cc:290] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.224272 29221 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.224637 29221 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.228807 29221 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.235149 26916 ts_tablet_manager.cc:1449] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.394s user 0.008s sys 0.005s
W20260928 20:03:24.249893 26220 leader_election.cc:336] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899): Timed out: RequestConsensusVote RPC to 127.25.129.254:42899 timed out after 0.771s (SENT)
I20260928 20:03:24.250402 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:24.218047 26912 ts_tablet_manager.cc:1480] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260928 20:03:24.260988 29001 tablet_loader.cc:96] loaded metadata for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea])
I20260928 20:03:24.262494 29001 tablet_loader.cc:96] loaded metadata for tablet dc5b576c03794c9287959b5f94f42420 (table default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 [id=1eebb242f3974ae697935ddbe3403669])
I20260928 20:03:24.263422 29238 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:24.265007 29152 raft_consensus.cc:493] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.265491 29152 raft_consensus.cc:515] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.267720 29152 leader_election.cc:290] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.275014 26912 tablet_bootstrap.cc:492] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:24.280937 26912 tablet_bootstrap.cc:654] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.286152 29001 tablet_loader.cc:96] loaded metadata for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c])
I20260928 20:03:24.287385 29001 tablet_loader.cc:96] loaded metadata for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca])
I20260928 20:03:24.294260 29220 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.294812 29220 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.296805 29220 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.298532 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:24.299146 26796 raft_consensus.cc:3060] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.301564 29162 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.301976 29001 tablet_loader.cc:96] loaded metadata for tablet e3e86ccb8c334a54b42913bd5f405942 (table default.Table_ff6225f056a84389992b4f66f946fb3e [id=3749b65af21b404e8a638dfc03035266])
I20260928 20:03:24.302029 29162 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:24.304015 29162 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:24.304714 29001 tablet_loader.cc:96] loaded metadata for tablet e6b8e89ff26a439c8f6d7784cd179698 (table default.Table_8d26e012313e4a30b824a5f081aa548d [id=219bcf821c96465eb48c3199ea6f4237])
I20260928 20:03:24.311025 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:24.311573 26505 raft_consensus.cc:3060] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.316515 29001 tablet_loader.cc:96] loaded metadata for tablet e8de132c03884597a311898f4d427bb1 (table default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4])
I20260928 20:03:24.317034 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:24.317589 26515 raft_consensus.cc:3060] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.317783 29001 tablet_loader.cc:96] loaded metadata for tablet ea01d2ddd91d4a0fa29afaebfbd83528 (table default.Table_9ef30a62591542edab5ee1be742ee4b3 [id=e246baf2b71f4e35811937013e2ff074])
I20260928 20:03:24.320888 26912 tablet_bootstrap.cc:492] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:24.321100 26505 raft_consensus.cc:2468] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.321376 26912 ts_tablet_manager.cc:1449] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.000s
I20260928 20:03:24.324266 26912 raft_consensus.cc:359] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.324965 26912 raft_consensus.cc:385] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.325215 26912 raft_consensus.cc:740] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.325757 26796 raft_consensus.cc:2468] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.330905 26515 raft_consensus.cc:2468] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.334976 26916 raft_consensus.cc:359] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.335745 26916 raft_consensus.cc:385] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.336064 26916 raft_consensus.cc:740] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.336776 29001 tablet_loader.cc:96] loaded metadata for tablet eac9b3e02fb541cab6d0d3c46743ff9e (table default.Table_6655d0a31a0f40f495acbad72c9ccfc9 [id=69cb6b4dc2ac4e47b92be86a394c9929])
I20260928 20:03:24.206033 26913 raft_consensus.cc:359] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.338056 29001 tablet_loader.cc:96] loaded metadata for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10])
I20260928 20:03:24.338274 26913 raft_consensus.cc:385] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.338578 26913 raft_consensus.cc:740] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.339375 29001 tablet_loader.cc:96] loaded metadata for tablet ec76c64607c9425fb5c837cb856c852c (table default.Table_b6e9471784104b748304857c18d1c3c8 [id=37c8252e29f9443bb978a9ee2b863bf2])
I20260928 20:03:24.339272 26913 consensus_queue.cc:260] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.341486 29001 tablet_loader.cc:96] loaded metadata for tablet edc62660134e45f8bc958e95f4e56906 (table default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 [id=41a61dca03a547108d47b214ba83b90f])
I20260928 20:03:24.325776 26912 consensus_queue.cc:260] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.344352 26912 ts_tablet_manager.cc:1480] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.023s user 0.007s sys 0.001s
I20260928 20:03:24.345376 26912 tablet_bootstrap.cc:492] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:24.342701 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 78693.9us
I20260928 20:03:24.364418 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:24.365010 26791 raft_consensus.cc:3060] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.371958 26791 raft_consensus.cc:2468] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.336942 26916 consensus_queue.cc:260] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.374963 26912 tablet_bootstrap.cc:654] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.375960 26916 ts_tablet_manager.cc:1480] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.132s user 0.005s sys 0.000s
I20260928 20:03:24.377413 29001 tablet_loader.cc:96] loaded metadata for tablet ee8db8da5c3a42679d26c22396938fd2 (table default.Table_21a9c8b591bd46a595f6762efcdb8a58 [id=7eeccc44c73f46b88801b8107c5b1cc9])
I20260928 20:03:24.378696 29001 tablet_loader.cc:96] loaded metadata for tablet eec056d6f6b0461da1f0a4525b711c8c (table default.Table_286ac19bf2c94fccacea798394d419c8 [id=b5312b25c2f3437cba1d46c88efad660])
I20260928 20:03:24.380410 29001 tablet_loader.cc:96] loaded metadata for tablet ef3e590ceb1345da99e67e5fa627fa9f (table default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a])
I20260928 20:03:24.381990 29001 tablet_loader.cc:96] loaded metadata for tablet f32d0e469bac4306b719d26290570bf0 (table default.Table_1d04da9e1ce749aaafdc63f86a11535e [id=aa9d03a4e0a840659761ea54cbb4519f])
I20260928 20:03:24.387400 29001 tablet_loader.cc:96] loaded metadata for tablet f376f270145e44b3acb4b8b2437cba33 (table default.Table_e81ad7e3711e4f25a6051f1ce257d20a [id=3da22346865f4613910dedb2fad45dc7])
I20260928 20:03:24.402760 29001 tablet_loader.cc:96] loaded metadata for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0])
I20260928 20:03:24.410759 26913 ts_tablet_manager.cc:1480] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.207s user 0.007s sys 0.000s
I20260928 20:03:24.411804 26913 tablet_bootstrap.cc:492] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:24.389994 29152 raft_consensus.cc:493] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:24.424403 26595 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:24.424851 26595 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.424775 29152 raft_consensus.cc:515] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.425940 29217 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:24.427249 29152 leader_election.cc:290] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.421419 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:24.427914 26502 raft_consensus.cc:3060] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:24.429975 26595 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:24.430500 26595 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.431584 29217 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:24.434453 26916 tablet_bootstrap.cc:492] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:24.440239 29152 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.440455 26502 raft_consensus.cc:2468] T 0fd962ebd7d9413e866b0cfee2cd7134 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.442767 26912 tablet_bootstrap.cc:492] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:24.443240 26912 ts_tablet_manager.cc:1449] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.098s user 0.012s sys 0.005s
I20260928 20:03:24.440948 29152 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.447320 29001 tablet_loader.cc:96] loaded metadata for tablet faefa3535ee54987b76cc6782b988c90 (table default.Table_c909970e41b44433885b634d80002868 [id=2e3160a2ecb54b22a2a543498ec403b0])
I20260928 20:03:24.449910 29001 tablet_loader.cc:96] loaded metadata for tablet fec512104cb6418db320e072476c2874 (table default.Table_28cdbc10adcb4b9da604e5bab2dda740 [id=44c95fceecbd42a38a0e6b240cc4b680])
I20260928 20:03:24.446240 26916 tablet_bootstrap.cc:654] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.447817 29152 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:24.504685 29001 catalog_manager.cc:1525] Time spent T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Loading table and tablet metadata into memory: real 7.292s user 0.677s sys 0.152s
I20260928 20:03:24.505044 29001 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260928 20:03:24.504865 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.506191 26166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47096 (request call id 898) took 4220 ms (client timeout 744 ms). Trace:
W20260928 20:03:24.506608 26166 rpcz_store.cc:269] 0928 20:03:20.285368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:20.285573 (+ 205us) service_pool.cc:224] Handling call
0928 20:03:24.506080 (+4220507us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260928 20:03:24.508087 26166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54510 (request call id 15) took 988 ms (client timeout 700 ms). Trace:
W20260928 20:03:24.508387 26166 rpcz_store.cc:269] 0928 20:03:23.519852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:24.507770 (+987918us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:24.508020 (+ 250us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 20:03:24.509572 26168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 622 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.509799 27792 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Timed out: Call waited in the queue past client deadline [suppressed 4 similar messages]
W20260928 20:03:24.510457 26168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54510 (request call id 12) took 5655 ms (client timeout 659 ms). Trace:
W20260928 20:03:24.510776 26168 rpcz_store.cc:269] 0928 20:03:18.855103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:18.855271 (+ 168us) service_pool.cc:224] Handling call
0928 20:03:24.510373 (+5655102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.512282 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 622 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.513217 26169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54510 (request call id 11) took 6374 ms (client timeout 659 ms). Trace:
W20260928 20:03:24.513608 26169 rpcz_store.cc:269] 0928 20:03:18.138683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:18.138850 (+ 167us) service_pool.cc:224] Handling call
0928 20:03:24.513126 (+6374276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.515133 26164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 622 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.516127 26164 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54510 (request call id 14) took 3172 ms (client timeout 598 ms). Trace:
W20260928 20:03:24.516448 26164 rpcz_store.cc:269] 0928 20:03:21.343619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:21.343835 (+ 216us) service_pool.cc:224] Handling call
0928 20:03:24.516058 (+3172223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.516060 29152 raft_consensus.cc:493] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.517277 29152 raft_consensus.cc:515] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:24.517616 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.518371 26171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47096 (request call id 895) took 6929 ms (client timeout 532 ms). Trace:
W20260928 20:03:24.518673 26171 rpcz_store.cc:269] 0928 20:03:17.589484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:17.589610 (+ 126us) service_pool.cc:224] Handling call
0928 20:03:24.518304 (+6928694us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.519812 29152 leader_election.cc:290] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.519892 26165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 622 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.520874 26165 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54510 (request call id 13) took 3832 ms (client timeout 598 ms). Trace:
W20260928 20:03:24.521370 26165 rpcz_store.cc:269] 0928 20:03:20.688922 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:20.689126 (+ 204us) service_pool.cc:224] Handling call
0928 20:03:24.520798 (+3831672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.531509 26595 leader_election.cc:304] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.522392 26162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.551124 26162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47096 (request call id 900) took 1072 ms (client timeout 771 ms). Trace:
W20260928 20:03:24.551524 26162 rpcz_store.cc:269] 0928 20:03:23.478923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:23.479128 (+ 205us) service_pool.cc:224] Handling call
0928 20:03:24.551046 (+1071918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.523226 26167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.553156 26167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47096 (request call id 897) took 5104 ms (client timeout 744 ms). Trace:
W20260928 20:03:24.553580 26167 rpcz_store.cc:269] 0928 20:03:19.448592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:19.448799 (+ 207us) service_pool.cc:224] Handling call
0928 20:03:24.553085 (+5104286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.523890 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.555181 26170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47096 (request call id 896) took 6380 ms (client timeout 532 ms). Trace:
W20260928 20:03:24.555570 26170 rpcz_store.cc:269] 0928 20:03:18.174466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:18.174662 (+ 196us) service_pool.cc:224] Handling call
0928 20:03:24.555110 (+6380448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.524441 26163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:24.557071 26163 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47096 (request call id 899) took 2307 ms (client timeout 771 ms). Trace:
W20260928 20:03:24.557611 26163 rpcz_store.cc:269] 0928 20:03:22.249401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:22.249617 (+ 216us) service_pool.cc:224] Handling call
0928 20:03:24.557008 (+2307391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260928 20:03:24.570585 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.572865 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.574441 29001 catalog_manager.cc:1308] Loaded cluster ID: b136c9e8aca3413fbbd2c68f6588888b
I20260928 20:03:24.574700 29001 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260928 20:03:24.578562 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.578871 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.579489 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.543861 29202 raft_consensus.cc:2804] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:24.580360 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.583410 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.580549 29202 raft_consensus.cc:493] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:24.586993 29202 raft_consensus.cc:3060] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.586870 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:24.589206 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:24.592864 27792 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 83195.4us
I20260928 20:03:24.595516 29202 raft_consensus.cc:515] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.597309 26913 tablet_bootstrap.cc:654] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.598382 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 622 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:24.600075 29202 leader_election.cc:290] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:24.607064 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 61942.7us
I20260928 20:03:24.607736 26595 leader_election.cc:304] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:24.627858 26595 leader_election.cc:304] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:24.633044 29001 catalog_manager.cc:1553] Loading token signing keys...
I20260928 20:03:24.639217 26595 leader_election.cc:304] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:24.642294 29149 raft_consensus.cc:2804] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:24.644302 29149 raft_consensus.cc:493] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:24.644627 29149 raft_consensus.cc:3060] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.645795 26913 tablet_bootstrap.cc:492] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:24.646221 26913 ts_tablet_manager.cc:1449] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.235s user 0.017s sys 0.000s
I20260928 20:03:24.638484 29202 raft_consensus.cc:2804] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:24.634418 29203 raft_consensus.cc:2804] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:24.657481 29149 raft_consensus.cc:515] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.672669 29149 leader_election.cc:290] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.674705 29202 raft_consensus.cc:697] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:24.675532 29202 consensus_queue.cc:237] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.678584 29203 raft_consensus.cc:697] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:24.679304 26913 raft_consensus.cc:359] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.679382 29203 consensus_queue.cc:237] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.679965 26913 raft_consensus.cc:385] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.680212 26913 raft_consensus.cc:740] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.680794 26913 consensus_queue.cc:260] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.682816 26913 ts_tablet_manager.cc:1480] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.036s user 0.005s sys 0.001s
I20260928 20:03:24.683849 26913 tablet_bootstrap.cc:492] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:24.702710 26913 tablet_bootstrap.cc:654] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:24.708223 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 64785.2us
I20260928 20:03:24.722342 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:24.722615 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 349132us
I20260928 20:03:24.730495 26912 raft_consensus.cc:359] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.731871 26912 raft_consensus.cc:385] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.732309 26912 raft_consensus.cc:740] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.733206 26912 consensus_queue.cc:260] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.736159 28870 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.736956 28870 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.721851 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:24.752701 26912 ts_tablet_manager.cc:1480] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.309s user 0.008s sys 0.000s
I20260928 20:03:24.754942 26912 tablet_bootstrap.cc:492] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:24.644553 29152 raft_consensus.cc:493] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.644366 29221 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.766466 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.769263 29152 raft_consensus.cc:515] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.773546 26916 tablet_bootstrap.cc:492] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:24.773661 29152 leader_election.cc:290] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.773955 26916 ts_tablet_manager.cc:1449] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.340s user 0.029s sys 0.009s
I20260928 20:03:24.774142 29152 raft_consensus.cc:493] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.783389 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.784123 26513 raft_consensus.cc:2393] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:24.757455 29166 raft_consensus.cc:493] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.738763 26791 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:24.790160 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.774536 29152 raft_consensus.cc:515] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.792757 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.792980 29152 leader_election.cc:290] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.793370 29152 raft_consensus.cc:493] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.771967 28870 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.763422 29221 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.793745 26916 raft_consensus.cc:359] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.794443 26916 raft_consensus.cc:385] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.794719 26916 raft_consensus.cc:740] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.794986 29166 raft_consensus.cc:515] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.795535 29221 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.795331 26916 consensus_queue.cc:260] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.776940 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:24.796130 26795 raft_consensus.cc:3060] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.797005 29166 leader_election.cc:290] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.778995 26794 raft_consensus.cc:3060] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.779821 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.780694 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:24.781535 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.783179 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.784420 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.784799 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.787209 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:24.788499 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:24.803360 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 88013us
I20260928 20:03:24.793722 29152 raft_consensus.cc:515] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.807987 29152 leader_election.cc:290] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.809973 29171 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.810425 29171 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.812273 29171 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.813833 29171 raft_consensus.cc:493] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.814934 29171 raft_consensus.cc:515] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.816758 29171 leader_election.cc:290] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:24.818640 26916 ts_tablet_manager.cc:1480] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260928 20:03:24.826565 29221 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.827108 29221 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:24.828109 26450 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.828514 26450 leader_election.cc:304] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.829375 29221 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:24.829497 26450 leader_election.cc:343] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.829972 29221 raft_consensus.cc:2749] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:24.827525 29152 raft_consensus.cc:493] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.830742 29152 raft_consensus.cc:515] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:24.832567 29152 leader_election.cc:290] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.836483 26913 tablet_bootstrap.cc:492] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:24.836951 26913 ts_tablet_manager.cc:1449] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.153s user 0.020s sys 0.015s
I20260928 20:03:24.839290 26913 raft_consensus.cc:359] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.839879 26913 raft_consensus.cc:385] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:24.843874 26802 raft_consensus.cc:3060] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:24.805696 26595 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:24.858323 29249 raft_consensus.cc:2804] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:24.858784 29249 raft_consensus.cc:697] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:24.860522 29249 consensus_queue.cc:237] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:24.873835 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 68210.5us
I20260928 20:03:24.874729 26595 leader_election.cc:304] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:24.875471 29202 raft_consensus.cc:2804] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:24.876161 29202 raft_consensus.cc:697] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:24.876974 29202 consensus_queue.cc:237] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.870540 26791 raft_consensus.cc:2468] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:24.829900 26450 leader_election.cc:304] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.900527 29152 raft_consensus.cc:2749] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:24.901582 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 72105.5us
I20260928 20:03:24.903427 26450 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.904242 29152 raft_consensus.cc:2764] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 20:03:24.905416 26450 leader_election.cc:304] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.906222 29152 raft_consensus.cc:2764] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260928 20:03:24.907320 26450 leader_election.cc:343] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.840129 26913 raft_consensus.cc:740] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:24.912338 26913 consensus_queue.cc:260] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.915942 26795 raft_consensus.cc:2468] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.926602 26450 leader_election.cc:304] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.937580 29152 raft_consensus.cc:2749] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:24.939147 26450 leader_election.cc:343] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.939967 26799 raft_consensus.cc:1240] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 20:03:24.942549 26450 leader_election.cc:304] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.943554 29152 raft_consensus.cc:2749] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:24.944878 26450 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.945629 29152 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:24.946412 26913 ts_tablet_manager.cc:1480] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.109s user 0.005s sys 0.000s
W20260928 20:03:24.946817 26450 leader_election.cc:343] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:24.948344 26450 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:24.950476 29152 raft_consensus.cc:2749] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:24.952363 29152 raft_consensus.cc:493] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:24.952806 29152 raft_consensus.cc:515] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:24.954412 26913 tablet_bootstrap.cc:492] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:24.955130 29152 leader_election.cc:290] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:24.963577 26912 tablet_bootstrap.cc:654] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.985343 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.986171 26505 raft_consensus.cc:2393] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:24.988373 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:24.997373 26913 tablet_bootstrap.cc:654] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:24.998792 26511 raft_consensus.cc:2393] T 39880ebea60d4712a7e4734b100aeb11 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:24.968024 26802 raft_consensus.cc:2468] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:24.969031 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd962ebd7d9413e866b0cfee2cd7134" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:25.017220 29261 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.017699 29261 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:25.019843 29261 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:25.022972 26791 raft_consensus.cc:3060] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.023377 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:25.025309 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:25.027824 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:25.030416 29246 raft_consensus.cc:493] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.030946 29246 raft_consensus.cc:515] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.032897 29246 leader_election.cc:290] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:25.030584 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:25.036732 26787 raft_consensus.cc:3060] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.040129 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:25.038702 29001 catalog_manager.cc:6230] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Loaded TSK: 0
I20260928 20:03:25.045463 29001 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260928 20:03:25.047232 26791 raft_consensus.cc:2468] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.053177 26916 tablet_bootstrap.cc:492] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:25.053387 26802 raft_consensus.cc:3060] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.054600 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.055913 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:25.059038 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 64131.9us
I20260928 20:03:25.060032 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:25.066561 26740 consensus_peers.cc:597] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:25.066974 26916 tablet_bootstrap.cc:654] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.067587 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.078635 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:25.082024 26450 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.082481 26450 leader_election.cc:304] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.083117 29152 raft_consensus.cc:2749] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.092569 29261 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:25.095382 26916 tablet_bootstrap.cc:492] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:25.095817 26916 ts_tablet_manager.cc:1449] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.043s user 0.009s sys 0.000s
I20260928 20:03:25.096064 26450 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.096911 29152 raft_consensus.cc:2749] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.099674 26913 tablet_bootstrap.cc:492] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:25.100114 26913 ts_tablet_manager.cc:1449] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.153s user 0.003s sys 0.016s
W20260928 20:03:25.100924 26450 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.106292 26450 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.101555 26916 raft_consensus.cc:359] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.110463 26916 raft_consensus.cc:385] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.110824 26916 raft_consensus.cc:740] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.111624 26916 consensus_queue.cc:260] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.114250 29246 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.114527 26916 ts_tablet_manager.cc:1480] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260928 20:03:25.114740 29246 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.115500 26916 tablet_bootstrap.cc:492] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:25.112692 26913 raft_consensus.cc:359] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.117151 26913 raft_consensus.cc:385] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.117429 26913 raft_consensus.cc:740] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.117959 29246 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:25.118040 26913 consensus_queue.cc:260] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.118502 29152 raft_consensus.cc:2749] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.119721 26450 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.120095 26913 ts_tablet_manager.cc:1480] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260928 20:03:25.120110 26450 leader_election.cc:304] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.121174 29152 raft_consensus.cc:2749] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.129582 26913 tablet_bootstrap.cc:492] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:25.148352 26570 tablet.cc:2433] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:03:25.163583 26787 raft_consensus.cc:2468] T 28c285483dd7460db934a160c5706d3d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.170996 26913 tablet_bootstrap.cc:654] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.185804 26913 tablet_bootstrap.cc:492] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:25.185804 29246 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.186506 26913 ts_tablet_manager.cc:1449] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.006s
I20260928 20:03:25.186406 29246 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.188436 29246 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:25.189235 26913 raft_consensus.cc:359] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.189927 26913 raft_consensus.cc:385] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.190282 26913 raft_consensus.cc:740] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.190976 26913 consensus_queue.cc:260] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.193605 26913 ts_tablet_manager.cc:1480] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
W20260928 20:03:25.198046 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 51658us
W20260928 20:03:25.202618 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 82918.2us
I20260928 20:03:25.214720 26913 tablet_bootstrap.cc:492] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:25.216775 26450 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.217279 26450 leader_election.cc:304] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.220116 26913 tablet_bootstrap.cc:654] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.226331 26912 tablet_bootstrap.cc:492] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:25.226823 26912 ts_tablet_manager.cc:1449] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.472s user 0.013s sys 0.006s
I20260928 20:03:25.229360 26912 raft_consensus.cc:359] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.232844 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.233544 26658 raft_consensus.cc:2393] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
W20260928 20:03:25.234319 26594 leader_election.cc:343] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.254858 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:25.270939 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.700s (SENT)
I20260928 20:03:25.271492 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:25.280051 29276 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:25.282395 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39880ebea60d4712a7e4734b100aeb11" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.282408 26594 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.283819 29171 raft_consensus.cc:2804] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:25.284242 29171 raft_consensus.cc:697] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:25.284318 26912 raft_consensus.cc:385] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.284615 26912 raft_consensus.cc:740] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.284976 29171 consensus_queue.cc:237] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:25.290356 26853 tablet.cc:2433] T 0fd962ebd7d9413e866b0cfee2cd7134 P b2d286f4404146278f5e0785ed9fcee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:03:25.296671 29152 raft_consensus.cc:2749] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.297892 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 81166.1us
I20260928 20:03:25.299173 26912 consensus_queue.cc:260] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.308179 26916 tablet_bootstrap.cc:654] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.317356 29249 consensus_queue.cc:1048] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:25.349888 29255 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.350555 29255 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.352658 29255 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:25.353616 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 55147.8us
W20260928 20:03:25.354331 26450 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.355882 26450 leader_election.cc:343] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.356527 26450 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.359524 26912 ts_tablet_manager.cc:1480] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.132s user 0.002s sys 0.003s
I20260928 20:03:25.360685 26912 tablet_bootstrap.cc:492] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:25.374491 26594 leader_election.cc:343] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.375077 26594 leader_election.cc:304] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:25.376389 29171 raft_consensus.cc:2804] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:25.376834 29171 raft_consensus.cc:697] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:25.377665 29171 consensus_queue.cc:237] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:25.394526 26450 leader_election.cc:343] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.395198 26450 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.395774 26450 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.396337 26450 leader_election.cc:343] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.396865 26450 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.397375 26450 leader_election.cc:343] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.400271 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.402699 29274 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.403103 29274 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.404997 29274 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:25.438654 29281 log.cc:927] Time spent T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260928 20:03:25.446966 26913 tablet_bootstrap.cc:492] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:25.447418 26913 ts_tablet_manager.cc:1449] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.233s user 0.010s sys 0.039s
I20260928 20:03:25.341130 26160 catalog_manager.cc:5838] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:25.449450 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 2 got 0
I20260928 20:03:25.449838 26913 raft_consensus.cc:359] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.450461 26913 raft_consensus.cc:385] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.450670 26916 tablet_bootstrap.cc:492] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:25.450721 26913 raft_consensus.cc:740] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.451239 26916 ts_tablet_manager.cc:1449] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.336s user 0.008s sys 0.003s
I20260928 20:03:25.451406 26913 consensus_queue.cc:260] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.454041 26913 ts_tablet_manager.cc:1480] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260928 20:03:25.454911 26913 tablet_bootstrap.cc:492] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:25.454459 26916 raft_consensus.cc:359] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.455597 26916 raft_consensus.cc:385] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.456048 26916 raft_consensus.cc:740] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.456880 26916 consensus_queue.cc:260] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.460834 26913 tablet_bootstrap.cc:654] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:25.468310 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 59056.6us
I20260928 20:03:25.469125 26739 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.470211 29206 raft_consensus.cc:3060] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.480108 26912 tablet_bootstrap.cc:654] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.488489 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.494318 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.496209 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.496927 26656 raft_consensus.cc:2468] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:25.515712 26916 ts_tablet_manager.cc:1480] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.064s user 0.004s sys 0.001s
I20260928 20:03:25.516747 26916 tablet_bootstrap.cc:492] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:25.525903 29171 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:25.526484 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 57461.9us
I20260928 20:03:25.526432 29171 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.527207 26739 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.528333 29171 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:25.528514 29222 raft_consensus.cc:3060] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.535198 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.535912 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.538290 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.539036 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.539373 29222 raft_consensus.cc:2749] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.477958 29206 raft_consensus.cc:2749] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.551208 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.552299 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.552379 26739 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.553571 29206 raft_consensus.cc:3060] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.560257 29206 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.571017 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.573462 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.576370 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.577998 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.571832 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.574265 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.577399 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.578565 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.593549 26739 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.595440 28870 raft_consensus.cc:2749] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.599783 26913 tablet_bootstrap.cc:492] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:25.600231 26913 ts_tablet_manager.cc:1449] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.145s user 0.030s sys 0.016s
I20260928 20:03:25.600412 26912 tablet_bootstrap.cc:492] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:25.600821 26912 ts_tablet_manager.cc:1449] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.240s user 0.004s sys 0.004s
I20260928 20:03:25.602994 26913 raft_consensus.cc:359] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.603715 26913 raft_consensus.cc:385] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.603960 26913 raft_consensus.cc:740] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.604630 26913 consensus_queue.cc:260] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.607849 26913 ts_tablet_manager.cc:1480] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260928 20:03:25.608642 26913 tablet_bootstrap.cc:492] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:25.613708 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.614499 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.617081 26656 raft_consensus.cc:1240] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:25.618840 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:25.619410 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.622746 26913 tablet_bootstrap.cc:654] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.628908 26739 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.629712 29212 raft_consensus.cc:2749] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:25.631027 29250 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.631479 29250 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.633008 26739 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.633339 29250 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:25.633961 29212 raft_consensus.cc:3060] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.644173 29212 raft_consensus.cc:2749] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.645131 26912 raft_consensus.cc:359] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.645910 26912 raft_consensus.cc:385] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.646188 26912 raft_consensus.cc:740] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.655789 26913 tablet_bootstrap.cc:492] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:25.656268 26913 ts_tablet_manager.cc:1449] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.002s
I20260928 20:03:25.659175 26913 raft_consensus.cc:359] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.659811 26913 raft_consensus.cc:385] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.659796 26916 tablet_bootstrap.cc:654] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.660066 26913 raft_consensus.cc:740] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.660701 26913 consensus_queue.cc:260] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.663834 29250 raft_consensus.cc:493] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.664358 26913 ts_tablet_manager.cc:1480] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260928 20:03:25.664369 29250 raft_consensus.cc:515] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.665233 26913 tablet_bootstrap.cc:492] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:25.666678 29250 leader_election.cc:290] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:25.670392 26913 tablet_bootstrap.cc:654] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.682269 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:25.683211 26502 raft_consensus.cc:3060] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:25.689680 26739 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.692142 29206 raft_consensus.cc:2749] T 2239c466fa8e471e820173c67bc04cad P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.692492 26739 leader_election.cc:304] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:25.701704 29162 raft_consensus.cc:2749] T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.701159 26912 consensus_queue.cc:260] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.703923 26912 ts_tablet_manager.cc:1480] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.103s user 0.007s sys 0.000s
I20260928 20:03:25.704890 26912 tablet_bootstrap.cc:492] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:25.714143 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c285483dd7460db934a160c5706d3d" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
W20260928 20:03:25.714336 26594 leader_election.cc:343] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.714757 26510 raft_consensus.cc:3060] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:25.715059 26594 leader_election.cc:343] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.715580 26594 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.716578 26594 leader_election.cc:304] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:25.717207 29249 consensus_queue.cc:1048] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:25.718264 29171 raft_consensus.cc:2804] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:25.718986 29171 raft_consensus.cc:697] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:25.719767 29171 consensus_queue.cc:237] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.723891 26510 raft_consensus.cc:2468] T 28c285483dd7460db934a160c5706d3d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.732075 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.732666 26504 raft_consensus.cc:2468] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:25.733292 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.733886 26511 raft_consensus.cc:2468] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:25.768193 26502 raft_consensus.cc:2468] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.770692 29171 raft_consensus.cc:493] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.771101 29171 raft_consensus.cc:515] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.777699 29171 leader_election.cc:290] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:25.779971 26916 tablet_bootstrap.cc:492] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:25.780426 26916 ts_tablet_manager.cc:1449] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.264s user 0.005s sys 0.004s
I20260928 20:03:25.783382 26916 raft_consensus.cc:359] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.784020 26916 raft_consensus.cc:385] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.784284 26916 raft_consensus.cc:740] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.785013 26913 tablet_bootstrap.cc:492] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:25.784876 26916 consensus_queue.cc:260] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.785434 26913 ts_tablet_manager.cc:1449] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.120s user 0.016s sys 0.009s
I20260928 20:03:25.786211 26158 catalog_manager.cc:5838] T 71272e843df3472ab06c4bd0be21d884 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:25.787948 26913 raft_consensus.cc:359] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.788578 26913 raft_consensus.cc:385] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:25.788843 26913 raft_consensus.cc:740] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:25.789109 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.789662 26791 raft_consensus.cc:2468] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.794478 26913 consensus_queue.cc:260] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.796011 26913 ts_tablet_manager.cc:1480] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260928 20:03:25.800800 29250 raft_consensus.cc:493] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.801527 29171 raft_consensus.cc:493] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.801258 29250 raft_consensus.cc:515] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.801960 29171 raft_consensus.cc:515] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.803213 29250 leader_election.cc:290] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:25.805568 29171 leader_election.cc:290] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:25.810595 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.811352 26511 raft_consensus.cc:2468] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:25.826440 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.826977 26791 raft_consensus.cc:2468] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.834599 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.835347 26791 raft_consensus.cc:2468] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.837404 29250 raft_consensus.cc:493] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.837881 29250 raft_consensus.cc:515] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.839893 29250 leader_election.cc:290] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:25.845530 26913 tablet_bootstrap.cc:492] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:25.852771 26912 tablet_bootstrap.cc:654] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.853950 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.857080 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.857592 26799 raft_consensus.cc:2468] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:25.857721 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.858070 26913 tablet_bootstrap.cc:654] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:25.858304 26504 raft_consensus.cc:2468] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.862196 29171 raft_consensus.cc:493] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:25.862630 29171 raft_consensus.cc:515] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:25.864506 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.865047 26504 raft_consensus.cc:2468] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.867494 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.868023 26504 raft_consensus.cc:2468] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:25.870484 29171 leader_election.cc:290] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:25.886153 26594 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:25.887015 29293 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:25.887521 29293 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:25.888018 26594 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:25.888419 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.888909 26511 raft_consensus.cc:2468] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:25.892939 26916 ts_tablet_manager.cc:1480] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.112s user 0.007s sys 0.000s
I20260928 20:03:25.893874 26916 tablet_bootstrap.cc:492] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:25.921304 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.922083 26502 raft_consensus.cc:2468] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:25.922853 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 622 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:25.925637 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:25.926328 26504 raft_consensus.cc:2468] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:25.927161 26450 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.927662 26450 leader_election.cc:304] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.928416 29250 raft_consensus.cc:2749] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.930549 26450 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.931008 26450 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.931684 29250 raft_consensus.cc:2749] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.932633 26450 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.933065 26450 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.933751 29250 raft_consensus.cc:2749] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.937083 26450 leader_election.cc:343] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.937538 26450 leader_election.cc:304] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.938266 29250 raft_consensus.cc:2749] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.939430 26450 leader_election.cc:343] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.939826 26450 leader_election.cc:304] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.940493 29250 raft_consensus.cc:2749] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.941450 26450 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.941864 26450 leader_election.cc:304] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.942515 29250 raft_consensus.cc:2749] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.944630 26450 leader_election.cc:343] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.947131 26450 leader_election.cc:304] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.947817 29250 raft_consensus.cc:2749] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.949039 26450 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.949442 26450 leader_election.cc:304] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.950194 29250 raft_consensus.cc:2749] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:25.951356 26450 leader_election.cc:343] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.953704 26450 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:25.954377 29250 raft_consensus.cc:2749] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:25.958611 29293 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:25.959867 29250 consensus_queue.cc:1059] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:25.961009 29250 raft_consensus.cc:3055] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:25.962745 29250 raft_consensus.cc:740] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:25.963673 29250 consensus_queue.cc:260] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:25.970999 29250 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
W20260928 20:03:25.974057 26450 leader_election.cc:343] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.980618 26450 leader_election.cc:343] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.981297 26450 leader_election.cc:343] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.981930 26450 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.982884 26450 leader_election.cc:343] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.983748 26450 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:25.985075 26450 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:25.997061 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:25.998369 26912 tablet_bootstrap.cc:492] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
W20260928 20:03:26.001319 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 113365us
W20260928 20:03:26.001734 26450 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.002795 26912 ts_tablet_manager.cc:1449] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.298s user 0.009s sys 0.002s
I20260928 20:03:26.005286 26912 raft_consensus.cc:359] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.005968 26912 raft_consensus.cc:385] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:26.006259 26912 raft_consensus.cc:740] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:26.006910 26912 consensus_queue.cc:260] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.009171 26912 ts_tablet_manager.cc:1480] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
W20260928 20:03:26.010360 26450 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.011175 26450 leader_election.cc:343] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.011834 26450 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.005384 29274 raft_consensus.cc:2804] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:26.015342 29274 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 20:03:26.017421 26449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:26.015756 29274 raft_consensus.cc:3060] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.020238 26913 tablet_bootstrap.cc:492] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:26.020843 26913 ts_tablet_manager.cc:1449] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.175s user 0.009s sys 0.009s
I20260928 20:03:26.010095 26912 tablet_bootstrap.cc:492] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:26.034811 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:26.028914 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:26.018422 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:26.022912 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:26.038302 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:26.038466 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:26.038872 26656 raft_consensus.cc:2468] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:26.051891 26916 tablet_bootstrap.cc:654] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:26.068825 29250 raft_consensus.cc:493] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.069353 29250 raft_consensus.cc:515] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.071798 29250 leader_election.cc:290] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.072101 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:26.078325 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:26.080667 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 77006.8us
W20260928 20:03:26.082687 26450 leader_election.cc:343] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.083177 26450 leader_election.cc:304] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.085420 26912 tablet_bootstrap.cc:654] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:26.088012 26594 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:26.090829 29250 raft_consensus.cc:2749] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:26.091882 26450 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.095492 29250 raft_consensus.cc:2804] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.095924 29250 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.096366 29250 raft_consensus.cc:3060] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.106351 29299 raft_consensus.cc:493] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.106841 29299 raft_consensus.cc:515] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.108623 29299 leader_election.cc:290] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.111631 29246 raft_consensus.cc:2804] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:26.111994 29246 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.112326 29246 raft_consensus.cc:3060] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.116008 29250 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.119307 29274 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.121760 29274 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:26.124370 26450 leader_election.cc:343] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.124769 26450 leader_election.cc:304] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.125448 29299 raft_consensus.cc:2749] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.125757 26450 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.128204 26594 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:26.129580 29250 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.131781 26912 tablet_bootstrap.cc:492] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:26.131914 29274 raft_consensus.cc:2804] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:26.132256 29274 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.132570 29274 raft_consensus.cc:3060] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
W20260928 20:03:26.133737 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 114367us
I20260928 20:03:26.134567 29301 consensus_queue.cc:1048] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:26.136931 26450 leader_election.cc:304] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.133006 29162 raft_consensus.cc:493] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.140667 29162 raft_consensus.cc:515] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.142629 29162 leader_election.cc:290] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.132181 26912 ts_tablet_manager.cc:1449] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.122s user 0.010s sys 0.000s
I20260928 20:03:26.150573 26912 raft_consensus.cc:359] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.145176 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:26.151836 26504 raft_consensus.cc:2393] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:26.130157 29246 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:26.153709 29246 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.157624 29171 consensus_queue.cc:1048] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:26.159840 29250 raft_consensus.cc:2749] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.160579 26450 leader_election.cc:343] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.161576 26450 leader_election.cc:304] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.163015 29250 raft_consensus.cc:2749] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.162607 26450 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.163947 26450 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.164609 29250 raft_consensus.cc:2749] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.173717 26450 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.174474 26450 leader_election.cc:304] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.175913 29250 raft_consensus.cc:2749] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.177074 26450 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.177651 26450 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.178566 29250 raft_consensus.cc:2749] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:26.180660 26595 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.178225 29274 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.184926 29274 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:26.186017 26594 leader_election.cc:343] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.186839 26594 leader_election.cc:304] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:26.188463 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:26.189100 26656 raft_consensus.cc:2393] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:26.192060 29202 raft_consensus.cc:2804] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.192437 29202 raft_consensus.cc:493] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.192730 29202 raft_consensus.cc:3060] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.193137 26595 leader_election.cc:304] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.195102 29305 raft_consensus.cc:2804] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.195412 29246 raft_consensus.cc:2804] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.196520 29246 raft_consensus.cc:493] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.196926 29246 raft_consensus.cc:3060] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.196677 26913 raft_consensus.cc:359] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.197598 26913 raft_consensus.cc:385] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:26.197861 26913 raft_consensus.cc:740] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:26.195426 29305 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.202569 29305 raft_consensus.cc:3060] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.204694 29202 raft_consensus.cc:515] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.205102 26913 consensus_queue.cc:260] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.207394 26913 ts_tablet_manager.cc:1480] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.186s user 0.007s sys 0.000s
I20260928 20:03:26.213578 26595 leader_election.cc:304] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.219189 29301 raft_consensus.cc:2804] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:26.221674 29302 consensus_queue.cc:1048] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:26.221179 29301 raft_consensus.cc:697] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:26.224824 29305 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.228193 29305 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:26.228794 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 51757.7us
I20260928 20:03:26.225124 29301 consensus_queue.cc:237] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.231650 26595 leader_election.cc:304] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:26.235227 26450 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.235989 26916 tablet_bootstrap.cc:492] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:26.236464 26916 ts_tablet_manager.cc:1449] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.343s user 0.008s sys 0.000s
I20260928 20:03:26.236392 26450 leader_election.cc:304] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.239777 29246 raft_consensus.cc:515] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.242404 29250 raft_consensus.cc:2749] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.243544 26450 leader_election.cc:343] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.243992 26450 leader_election.cc:304] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.244719 29250 raft_consensus.cc:2749] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.246455 26450 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.246892 26450 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:26.230449 26740 consensus_peers.cc:597] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d13562e920244194969520df564a949d. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:26.247848 26912 raft_consensus.cc:385] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:26.248147 26912 raft_consensus.cc:740] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:03:26.238960 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 51066.7us
I20260928 20:03:26.253297 29309 raft_consensus.cc:2804] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.263759 29309 raft_consensus.cc:493] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.264107 29309 raft_consensus.cc:3060] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:26.270768 26594 leader_election.cc:343] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.280743 26912 consensus_queue.cc:260] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.283365 26912 ts_tablet_manager.cc:1480] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.135s user 0.006s sys 0.000s
I20260928 20:03:26.291671 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:26.292367 26794 raft_consensus.cc:3060] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.307925 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:26.308640 26787 raft_consensus.cc:3060] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.319900 26739 leader_election.cc:304] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:26.320132 26794 raft_consensus.cc:2468] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:26.320726 29284 raft_consensus.cc:3060] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.273818 29311 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.321478 29311 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:26.255810 26595 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:26.326202 26595 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.326982 29274 raft_consensus.cc:2749] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.328284 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 72502.3us
I20260928 20:03:26.329035 29284 raft_consensus.cc:2749] T 309f8fcc50e545178888846ac90afcf2 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:26.330860 29311 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.214648 29202 leader_election.cc:290] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.337281 29246 leader_election.cc:290] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.282390 29250 raft_consensus.cc:493] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.342798 29309 raft_consensus.cc:515] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.343108 29250 raft_consensus.cc:515] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.345119 29309 leader_election.cc:290] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.345177 29250 leader_election.cc:290] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.346131 29250 raft_consensus.cc:2749] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.348296 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 102188us
I20260928 20:03:26.350502 26450 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:26.351671 29250 raft_consensus.cc:2804] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.352070 29250 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.352449 29250 raft_consensus.cc:3060] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.353010 26913 tablet_bootstrap.cc:492] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:26.380479 26706 heartbeater.cc:646] Failed to heartbeat to 127.25.129.254:42899 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.129.254:42899 timed out after 1.000s (SENT)
W20260928 20:03:26.390861 26851 heartbeater.cc:646] Failed to heartbeat to 127.25.129.254:42899 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.129.254:42899 timed out after 1.000s (SENT)
W20260928 20:03:26.402441 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 51993.6us
W20260928 20:03:26.403267 26450 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.408788 26787 raft_consensus.cc:2468] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
W20260928 20:03:26.411679 26450 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.425801 26450 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.426549 29202 consensus_queue.cc:1048] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:26.430439 29202 consensus_queue.cc:1048] T 323a20314a734279a4af64e8b4f0ff0d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:26.430521 29274 consensus_queue.cc:1048] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:26.433318 26595 leader_election.cc:304] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.434547 29202 raft_consensus.cc:2804] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.435279 29202 raft_consensus.cc:493] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.436986 26595 leader_election.cc:304] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.442076 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:26.446669 29305 raft_consensus.cc:2804] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:26.447115 29305 raft_consensus.cc:493] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:26.447464 29305 raft_consensus.cc:3060] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.302615 26916 raft_consensus.cc:359] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.451018 26916 raft_consensus.cc:385] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:26.451367 26916 raft_consensus.cc:740] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:26.452183 26916 consensus_queue.cc:260] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.460283 29305 raft_consensus.cc:515] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:26.462769 29305 leader_election.cc:290] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.416322 29250 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.469161 29250 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.473955 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:26.442426 29202 raft_consensus.cc:3060] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.450162 26912 tablet_bootstrap.cc:492] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:26.464429 29320 log.cc:927] Time spent T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260928 20:03:26.488612 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a31001f85b44bfcb35a29675f177b9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:26.495486 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:26.508044 26787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:26.515933 26158 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 385) took 869 ms (client timeout 1000 ms). Trace:
W20260928 20:03:26.516347 26158 rpcz_store.cc:269] 0928 20:03:25.646677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:25.646896 (+ 219us) service_pool.cc:224] Handling call
0928 20:03:26.515850 (+868954us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:26.120893 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:26.121731 (+ 838us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:26.121767 (+ 36us) write_op.cc:435] Acquired schema lock
0928 20:03:26.121791 (+ 24us) tablet.cc:662] Decoding operations
0928 20:03:26.122139 (+ 348us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:26.122211 (+ 72us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:26.122243 (+ 32us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:26.122458 (+ 215us) tablet.cc:701] Row locks acquired
0928 20:03:26.122487 (+ 29us) write_op.cc:260] PREPARE: finished
0928 20:03:26.122630 (+ 143us) write_op.cc:270] Start()
0928 20:03:26.122751 (+ 121us) write_op.cc:276] Timestamp: P: 1790625806122549 usec, L: 0
0928 20:03:26.122783 (+ 32us) op_driver.cc:348] REPLICATION: starting
0928 20:03:26.123431 (+ 648us) log.cc:844] Serialized 536 byte log entry
0928 20:03:26.167724 (+ 44293us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5400020ba0. stack: 00007fe59c081373 00007fe59c081270 00007fe59bc24574 0000000000516a24 00000000005169b9 00007fe5a31815d0 00007fe5a318ecb8 00007fe5a318e8fa 00007fe5a32131f5 00007fe5a3213699 00007fe5a36a4eb1 00007fe5a36a4688 00007fe5a36a9321 00007fe5a36a92d9 00007fe5a36a9269 00007fe5a36a9231
0928 20:03:26.363116 (+195392us) op_driver.cc:464] REPLICATION: finished
0928 20:03:26.502071 (+138955us) write_op.cc:301] APPLY: starting
0928 20:03:26.502687 (+ 616us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:26.502806 (+ 119us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:26.502834 (+ 28us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:26.503046 (+ 212us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:26.503225 (+ 179us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:26.503286 (+ 61us) write_op.cc:312] APPLY: finished
0928 20:03:26.503555 (+ 269us) log.cc:844] Serialized 23 byte log entry
0928 20:03:26.504273 (+ 718us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:26.504578 (+ 305us) write_op.cc:454] Released schema lock
0928 20:03:26.504621 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"dns_us":439,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":138480,"num_ops":1,"prepare.queue_time_us":13021,"prepare.run_cpu_time_us":5495,"prepare.run_wall_time_us":48712,"raft.queue_time_us":191,"raft.run_cpu_time_us":805,"raft.run_wall_time_us":805,"replication_time_us":240183,"spinlock_wait_cycles":45715200,"thread_start_us":35786,"threads_started":3,"wal-append.queue_time_us":20274}]]}
W20260928 20:03:26.521700 26450 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.523171 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:26.524595 26450 leader_election.cc:304] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:26.525792 26450 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.526203 26450 leader_election.cc:304] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.529269 29299 raft_consensus.cc:2749] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:26.529935 29299 raft_consensus.cc:2749] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.531409 26450 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.531791 26450 leader_election.cc:304] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:26.536554 29250 raft_consensus.cc:2749] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:26.537689 26450 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.546868 26450 leader_election.cc:343] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.547482 26450 leader_election.cc:343] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.567441 26450 leader_election.cc:343] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:26.567973 26160 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 350) took 1251 ms (client timeout 1000 ms). Trace:
W20260928 20:03:26.568280 26450 leader_election.cc:343] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:26.572211 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.572852 26506 raft_consensus.cc:3060] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.572726 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.573276 26504 raft_consensus.cc:3060] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.579824 26510 raft_consensus.cc:1275] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260928 20:03:26.583444 26160 rpcz_store.cc:269] 0928 20:03:25.316683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:25.316781 (+ 98us) service_pool.cc:224] Handling call
0928 20:03:26.567907 (+1251126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:26.169718 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:26.170191 (+ 473us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:26.170218 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:03:26.170232 (+ 14us) tablet.cc:662] Decoding operations
0928 20:03:26.171894 (+ 1662us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:26.171957 (+ 63us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:26.171997 (+ 40us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:26.172228 (+ 231us) tablet.cc:701] Row locks acquired
0928 20:03:26.172248 (+ 20us) write_op.cc:260] PREPARE: finished
0928 20:03:26.172430 (+ 182us) write_op.cc:270] Start()
0928 20:03:26.172548 (+ 118us) write_op.cc:276] Timestamp: P: 1790625806172324 usec, L: 0
0928 20:03:26.172569 (+ 21us) op_driver.cc:348] REPLICATION: starting
0928 20:03:26.173264 (+ 695us) log.cc:844] Serialized 536 byte log entry
0928 20:03:26.521552 (+348288us) op_driver.cc:464] REPLICATION: finished
0928 20:03:26.548654 (+ 27102us) write_op.cc:301] APPLY: starting
0928 20:03:26.548713 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:26.548807 (+ 94us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:26.549037 (+ 230us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:26.549238 (+ 201us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:26.549372 (+ 134us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:26.549418 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:03:26.549640 (+ 222us) log.cc:844] Serialized 23 byte log entry
0928 20:03:26.557464 (+ 7824us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:26.557579 (+ 115us) write_op.cc:454] Released schema lock
0928 20:03:26.557630 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"dns_us":179,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":26902,"num_ops":1,"prepare.queue_time_us":25887,"prepare.run_cpu_time_us":2557,"prepare.run_wall_time_us":3816,"replication_time_us":348841,"thread_start_us":61014,"threads_started":1}]]}
I20260928 20:03:26.599035 26916 ts_tablet_manager.cc:1480] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.362s user 0.007s sys 0.001s
I20260928 20:03:26.603641 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a31001f85b44bfcb35a29675f177b9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:26.607344 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 123613us
I20260928 20:03:26.608495 26594 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:26.610420 26594 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:26.610548 29171 raft_consensus.cc:2804] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:26.611008 29171 raft_consensus.cc:697] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:26.611799 29171 consensus_queue.cc:237] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:26.612972 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:26.613510 26649 raft_consensus.cc:3060] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.614256 29309 raft_consensus.cc:2804] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:26.614691 29309 raft_consensus.cc:697] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:26.615492 29309 consensus_queue.cc:237] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.624838 29317 raft_consensus.cc:493] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.625290 29317 raft_consensus.cc:515] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.627599 29317 leader_election.cc:290] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.628080 29317 raft_consensus.cc:493] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.628463 29317 raft_consensus.cc:515] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:26.633492 29274 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.634243 29274 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.636701 29274 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.644970 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:26.650774 29317 leader_election.cc:290] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.662565 29202 raft_consensus.cc:515] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.606762 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.665664 26510 raft_consensus.cc:3060] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:26.667603 29202 leader_election.cc:290] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.607407 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.670456 26502 raft_consensus.cc:3060] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.642963 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.646687 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.678591 26513 raft_consensus.cc:3060] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.647787 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.679601 26505 raft_consensus.cc:3060] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.658732 29250 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.680678 29250 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.660540 26504 raft_consensus.cc:2468] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:26.672415 26649 raft_consensus.cc:2468] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:26.687397 29274 raft_consensus.cc:493] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.688110 29274 raft_consensus.cc:515] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.691202 29274 leader_election.cc:290] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:26.691659 26913 tablet_bootstrap.cc:654] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:26.698200 26515 raft_consensus.cc:2393] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:26.699450 26510 raft_consensus.cc:2468] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:26.783447 29250 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:26.787945 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.788627 26507 raft_consensus.cc:3060] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.798518 26913 tablet_bootstrap.cc:492] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:26.799095 26913 ts_tablet_manager.cc:1449] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.446s user 0.018s sys 0.000s
I20260928 20:03:26.803982 26913 raft_consensus.cc:359] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.804862 26913 raft_consensus.cc:385] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:26.805194 26913 raft_consensus.cc:740] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:26.806267 26913 consensus_queue.cc:260] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:26.813585 26916 tablet_bootstrap.cc:492] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:26.827548 26916 tablet_bootstrap.cc:654] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:26.841528 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:26.843755 26159 catalog_manager.cc:5838] T 5b276f21d85c4bb4bdd777f8f9a43960 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:26.791764 26502 raft_consensus.cc:2468] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:26.868419 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:26.869423 26501 raft_consensus.cc:2468] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:26.873224 26507 raft_consensus.cc:2468] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:26.876937 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a31001f85b44bfcb35a29675f177b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:26.885205 26505 raft_consensus.cc:2468] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:26.890806 26506 raft_consensus.cc:2468] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:26.896498 29343 tablet_replica.cc:333] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:26.939189 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:26.939981 26511 raft_consensus.cc:2468] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:26.945376 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:26.947247 26506 raft_consensus.cc:3060] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:26.954514 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:26.956111 26514 raft_consensus.cc:2468] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:26.701297 29212 raft_consensus.cc:493] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:26.978087 29212 raft_consensus.cc:515] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:27.008742 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 306286us
I20260928 20:03:27.012948 26513 raft_consensus.cc:2468] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:27.007902 29309 raft_consensus.cc:493] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:27.015542 29309 raft_consensus.cc:515] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.018539 29212 leader_election.cc:290] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.019682 26912 tablet_bootstrap.cc:654] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:27.022341 29309 leader_election.cc:290] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.026626 26913 ts_tablet_manager.cc:1480] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.227s user 0.008s sys 0.000s
I20260928 20:03:27.033236 26161 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 2 got 0
I20260928 20:03:27.034519 26161 catalog_manager.cc:5838] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:27.035606 26916 tablet_bootstrap.cc:492] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:27.036015 26916 ts_tablet_manager.cc:1449] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.244s user 0.012s sys 0.000s
I20260928 20:03:27.036368 26161 catalog_manager.cc:5838] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:27.046074 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:27.046823 26503 raft_consensus.cc:2468] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:27.056182 29212 raft_consensus.cc:493] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.056887 29212 raft_consensus.cc:515] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.038069 26161 catalog_manager.cc:5838] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:27.059871 29212 leader_election.cc:290] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.060166 26161 catalog_manager.cc:5838] T ea01d2ddd91d4a0fa29afaebfbd83528 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:27.068414 26161 catalog_manager.cc:5838] T 39880ebea60d4712a7e4734b100aeb11 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
W20260928 20:03:27.087679 26159 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7e09ad691ec3444d938a04a5c572b0cb consensus state has no leader
I20260928 20:03:27.098930 26506 raft_consensus.cc:2468] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:27.100576 29341 log.cc:927] Time spent T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: Append to log took a long time: real 0.140s user 0.001s sys 0.000s
I20260928 20:03:27.104928 29343 raft_consensus.cc:2243] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260928 20:03:27.112805 26146 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e09ad691ec3444d938a04a5c572b0cb consensus state has no leader
I20260928 20:03:27.105865 29343 raft_consensus.cc:2272] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:27.144692 29343 ts_tablet_manager.cc:1962] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:27.151221 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.151784 26794 raft_consensus.cc:3060] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:27.154745 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.155288 26791 raft_consensus.cc:3060] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:27.161441 26913 tablet_bootstrap.cc:492] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:27.164909 29309 raft_consensus.cc:493] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:27.165409 29309 raft_consensus.cc:515] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.168895 26913 tablet_bootstrap.cc:654] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:27.169405 29171 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:27.170183 29171 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.172868 29171 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.174480 29309 leader_election.cc:290] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.176087 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:27.180336 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.611s (SENT)
I20260928 20:03:27.180994 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:27.178902 26916 raft_consensus.cc:359] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:27.185032 26159 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 335) took 1802 ms (client timeout 1000 ms). Trace:
I20260928 20:03:27.185370 26916 raft_consensus.cc:385] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:27.192853 26913 tablet_bootstrap.cc:492] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:27.193315 26913 ts_tablet_manager.cc:1449] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.000s
I20260928 20:03:27.185704 26916 raft_consensus.cc:740] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:27.199090 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:27.201560 26916 consensus_queue.cc:260] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.205646 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:27.185428 26159 rpcz_store.cc:269] 0928 20:03:25.382199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:25.386679 (+ 4480us) service_pool.cc:224] Handling call
0928 20:03:27.027307 (+1640628us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:27.027344 (+ 37us) write_op.cc:454] Released schema lock
0928 20:03:27.184958 (+157614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:26.940704 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:26.941740 (+ 1036us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:26.941801 (+ 61us) write_op.cc:435] Acquired schema lock
0928 20:03:26.941844 (+ 43us) tablet.cc:662] Decoding operations
0928 20:03:26.947545 (+ 5701us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:26.947657 (+ 112us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:26.947754 (+ 97us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:26.948077 (+ 323us) tablet.cc:701] Row locks acquired
0928 20:03:26.948102 (+ 25us) write_op.cc:260] PREPARE: finished
0928 20:03:26.948463 (+ 361us) write_op.cc:270] Start()
0928 20:03:26.948663 (+ 200us) write_op.cc:276] Timestamp: P: 1790625806948029 usec, L: 0
0928 20:03:26.948721 (+ 58us) op_driver.cc:348] REPLICATION: starting
0928 20:03:26.950008 (+ 1287us) log.cc:844] Serialized 536 byte log entry
0928 20:03:26.969552 (+ 19544us) op_driver.cc:464] REPLICATION: finished
0928 20:03:26.970797 (+ 1245us) write_op.cc:301] APPLY: starting
0928 20:03:26.971000 (+ 203us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:26.971218 (+ 218us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:26.971468 (+ 250us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:26.971707 (+ 239us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:26.971867 (+ 160us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:26.971914 (+ 47us) write_op.cc:312] APPLY: finished
0928 20:03:26.972410 (+ 496us) log.cc:844] Serialized 23 byte log entry
0928 20:03:26.972694 (+ 284us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:26.972768 (+ 74us) write_op.cc:454] Released schema lock
0928 20:03:26.972800 (+ 32us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"dns_us":381,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":926,"apply.run_cpu_time_us":1849,"apply.run_wall_time_us":2313,"num_ops":1,"prepare.queue_time_us":8515,"prepare.run_cpu_time_us":4983,"prepare.run_wall_time_us":19878,"raft.queue_time_us":614,"raft.run_cpu_time_us":1105,"raft.run_wall_time_us":1105,"replication_time_us":20338,"thread_start_us":95120,"threads_started":1}]]}
I20260928 20:03:27.211419 26913 raft_consensus.cc:359] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.212771 26913 raft_consensus.cc:385] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:27.213092 26913 raft_consensus.cc:740] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:27.213632 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.214262 26798 raft_consensus.cc:3060] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:27.214046 26795 raft_consensus.cc:1275] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 20:03:27.214879 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:27.215611 26649 raft_consensus.cc:2393] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:27.217561 29202 consensus_queue.cc:1048] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:27.226395 29337 raft_consensus.cc:493] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.216085 26913 consensus_queue.cc:260] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.229269 26791 raft_consensus.cc:2468] T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:27.231950 26912 tablet_bootstrap.cc:492] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:27.232442 26912 ts_tablet_manager.cc:1449] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.783s user 0.013s sys 0.003s
I20260928 20:03:27.235167 26913 ts_tablet_manager.cc:1480] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.042s user 0.008s sys 0.000s
I20260928 20:03:27.239063 26913 tablet_bootstrap.cc:492] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:27.242121 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:27.250849 29171 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.251444 29171 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.259770 29171 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.260370 29337 raft_consensus.cc:515] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.261893 26912 raft_consensus.cc:359] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.262428 29337 leader_election.cc:290] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.262593 26912 raft_consensus.cc:385] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:27.262840 26912 raft_consensus.cc:740] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:27.263410 26912 consensus_queue.cc:260] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.265604 26912 ts_tablet_manager.cc:1480] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20260928 20:03:27.280292 26794 raft_consensus.cc:2468] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:27.286192 26916 ts_tablet_manager.cc:1480] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.250s user 0.008s sys 0.000s
I20260928 20:03:27.296149 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.298436 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.298535 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.303551 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29dd1355039e4bca952f13a9d174813e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.307729 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb8870dce541a2afb3be09bcb3c701" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.304598 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.311250 29361 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:27.312839 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.313078 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.314129 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.314639 26792 raft_consensus.cc:3060] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:27.315146 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 134863us
I20260928 20:03:27.316418 26912 tablet_bootstrap.cc:492] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:27.318720 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.319360 26794 raft_consensus.cc:2468] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:27.320568 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.329234 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:27.329963 26648 raft_consensus.cc:2393] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:27.322799 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.335628 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:27.336493 26648 raft_consensus.cc:2393] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:27.336298 26798 raft_consensus.cc:2468] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:27.343190 26916 tablet_bootstrap.cc:492] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:27.347430 26792 raft_consensus.cc:2468] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:27.351969 26912 tablet_bootstrap.cc:654] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:27.352029 29202 consensus_queue.cc:1048] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:27.353197 29202 consensus_queue.cc:1048] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:27.354290 29202 consensus_queue.cc:1048] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:27.355713 29202 consensus_queue.cc:1048] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:27.368094 26916 tablet_bootstrap.cc:654] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:27.376152 26161 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 351) took 904 ms (client timeout 1000 ms). Trace:
I20260928 20:03:27.395843 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:27.396741 26502 raft_consensus.cc:2393] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
W20260928 20:03:27.399526 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 47862.6us
I20260928 20:03:27.401021 26594 leader_election.cc:304] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:27.404254 29309 raft_consensus.cc:2804] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:27.404690 29309 raft_consensus.cc:697] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:27.405491 29309 consensus_queue.cc:237] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.410211 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.412120 26594 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:27.409791 26450 leader_election.cc:343] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.417589 26450 leader_election.cc:304] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.345467 26160 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:27.420138 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.432550 29337 raft_consensus.cc:2749] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.420296 26916 tablet_bootstrap.cc:492] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:27.424005 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:27.435277 26514 raft_consensus.cc:2393] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:27.435843 26916 ts_tablet_manager.cc:1449] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.093s user 0.007s sys 0.003s
W20260928 20:03:27.439575 26450 leader_election.cc:343] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.440076 26450 leader_election.cc:304] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:27.440833 26450 raft_consensus.cc:2686] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:03:27.442363 29309 consensus_queue.cc:1048] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260928 20:03:27.445173 26594 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:27.446409 29370 raft_consensus.cc:2804] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:27.448101 29370 raft_consensus.cc:697] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
W20260928 20:03:27.450603 26594 leader_election.cc:343] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:27.453562 26594 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:27.441725 26450 leader_election.cc:343] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.449764 29370 consensus_queue.cc:237] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.460146 26450 leader_election.cc:304] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.463079 29337 raft_consensus.cc:2749] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.464422 26450 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.465301 29337 raft_consensus.cc:2804] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:03:27.455441 26595 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:27.468158 26595 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.470604 29337 raft_consensus.cc:697] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:27.471485 29337 consensus_queue.cc:237] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:27.472180 29366 log.cc:927] Time spent T 39880ebea60d4712a7e4734b100aeb11 P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
W20260928 20:03:27.478226 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44323.7us
I20260928 20:03:27.478345 26916 raft_consensus.cc:359] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.479363 26916 raft_consensus.cc:385] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:27.479699 26916 raft_consensus.cc:740] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:27.480499 26916 consensus_queue.cc:260] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.456264 29309 consensus_queue.cc:1048] T 0fd962ebd7d9413e866b0cfee2cd7134 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:27.460659 29343 ts_tablet_manager.cc:1975] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:27.485867 29343 log.cc:1199] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-0/wal/wals/6a31001f85b44bfcb35a29675f177b9e
I20260928 20:03:27.486999 29343 ts_tablet_manager.cc:1996] T 6a31001f85b44bfcb35a29675f177b9e P 9b44798af33f4733ba9cde0a1b541f54: Deleting consensus metadata
I20260928 20:03:27.490451 26160 catalog_manager.cc:5838] T 26797990cec14e87a4a30a3bbd2ff7c2 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:27.491194 26148 catalog_manager.cc:5063] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): tablet 6a31001f85b44bfcb35a29675f177b9e (table default.Table_6161480f563f4672a8ae27fe327141a4 [id=0c3ea0c89425460887cce9fd3d245eec]) successfully deleted
I20260928 20:03:27.492188 26160 catalog_manager.cc:5838] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
W20260928 20:03:27.499375 26450 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.511718 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f7b05e756f4a4db5031ff1e14c6ff6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.516076 26916 ts_tablet_manager.cc:1480] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.046s user 0.004s sys 0.002s
I20260928 20:03:27.517088 26916 tablet_bootstrap.cc:492] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:27.521039 26160 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]). Expected version 1 got 0
W20260928 20:03:27.422986 26161 rpcz_store.cc:269] 0928 20:03:26.471940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:26.472185 (+ 245us) service_pool.cc:224] Handling call
0928 20:03:26.523441 (+ 51256us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54000203d4. stack: 00007fe59c081373 00007fe59c081270 00007fe59bc24574 0000000000516a24 00000000005169b9 00007fe5a31815d0 00007fe5a32207ca 00007fe5a4f95e3c 00007fe5a50940ce 00007fe5a2c34fb4 00007fe5a2c34f42 00007fe5a2c34e71 00007fe5a2c34dec 00007fe5a2c340a2 00007fe5a0ee615c 00007fe5a0ee5596
0928 20:03:27.376094 (+852653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:27.114498 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:27.115219 (+ 721us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:27.115249 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:03:27.115266 (+ 17us) tablet.cc:662] Decoding operations
0928 20:03:27.116213 (+ 947us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:27.116267 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:27.116309 (+ 42us) tablet.cc:685] Acquiring locks for 5 operations
0928 20:03:27.117141 (+ 832us) tablet.cc:701] Row locks acquired
0928 20:03:27.117168 (+ 27us) write_op.cc:260] PREPARE: finished
0928 20:03:27.117338 (+ 170us) write_op.cc:270] Start()
0928 20:03:27.117457 (+ 119us) write_op.cc:276] Timestamp: P: 1790625807116933 usec, L: 0
0928 20:03:27.117480 (+ 23us) op_driver.cc:348] REPLICATION: starting
0928 20:03:27.118533 (+ 1053us) log.cc:844] Serialized 2069 byte log entry
0928 20:03:27.132622 (+ 14089us) op_driver.cc:464] REPLICATION: finished
0928 20:03:27.132925 (+ 303us) write_op.cc:301] APPLY: starting
0928 20:03:27.132983 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:27.133153 (+ 170us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:27.133248 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:27.133694 (+ 446us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:27.133841 (+ 147us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0928 20:03:27.133887 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:03:27.134091 (+ 204us) log.cc:844] Serialized 47 byte log entry
0928 20:03:27.134245 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:27.134329 (+ 84us) write_op.cc:454] Released schema lock
0928 20:03:27.134366 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0928 20:03:27.134604 (+ 238us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:27.134628 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"spinlock_wait_cycles":94927616,"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":1633,"apply.run_wall_time_us":1633,"num_ops":5,"prepare.queue_time_us":13835,"prepare.run_cpu_time_us":4489,"prepare.run_wall_time_us":7670,"raft.queue_time_us":96,"raft.run_cpu_time_us":903,"raft.run_wall_time_us":905,"replication_time_us":14927}]]}
I20260928 20:03:27.529697 29171 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:27.532572 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet fa49943f465f47778ac985cb5f4e6c0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.535212 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.536768 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f7b05e756f4a4db5031ff1e14c6ff6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:27.546784 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.549413 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.550426 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.550997 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.562556 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.564271 29379 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:27.564982 29372 log.cc:927] Time spent T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.051s user 0.000s sys 0.001s
I20260928 20:03:27.564877 29379 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:03:27.484184 26594 leader_election.cc:343] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.568676 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:27.568634 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:27.557652 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 72168.4us
I20260928 20:03:27.574563 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:27.578778 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.581061 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.581715 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:51492
W20260928 20:03:27.570058 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 85900.5us
I20260928 20:03:27.607316 26913 tablet_bootstrap.cc:700] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent opening tablet: real 0.178s user 0.004s sys 0.000s
I20260928 20:03:27.608062 26913 tablet_bootstrap.cc:654] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:27.609722 29379 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:27.610268 29379 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:27.614933 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 105455us
W20260928 20:03:27.615612 26450 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.616000 26450 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.616742 29337 raft_consensus.cc:2749] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.619580 29363 consensus_queue.cc:1048] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:27.620065 26450 leader_election.cc:343] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.620532 26450 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.621287 29337 raft_consensus.cc:2749] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:27.621943 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 49316.7us
W20260928 20:03:27.639699 26450 leader_election.cc:343] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.642853 29202 consensus_queue.cc:1048] T 2239c466fa8e471e820173c67bc04cad P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:27.643744 26916 tablet_bootstrap.cc:654] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:27.644584 26595 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:27.654132 26594 leader_election.cc:343] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:27.654822 26594 leader_election.cc:343] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.656268 29370 raft_consensus.cc:2749] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.661031 26595 leader_election.cc:304] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.666905 29363 raft_consensus.cc:2804] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:27.667440 29363 raft_consensus.cc:697] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:27.668371 29363 consensus_queue.cc:237] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.674896 26594 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:27.669160 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:27.677029 29337 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.682613 29171 raft_consensus.cc:2804] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:27.683156 29171 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:27.683662 29171 raft_consensus.cc:3060] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:27.689157 29337 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.690665 26595 leader_election.cc:304] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:27.691340 29337 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.691927 26514 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:27.692910 29309 raft_consensus.cc:2804] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:27.693290 29309 raft_consensus.cc:493] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:27.693660 29309 raft_consensus.cc:3060] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:27.696589 26450 leader_election.cc:343] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.696941 26450 leader_election.cc:304] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:27.697621 26594 leader_election.cc:343] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.703369 29376 raft_consensus.cc:2749] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.709530 26595 leader_election.cc:304] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:27.715432 29202 raft_consensus.cc:2804] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:27.716166 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:27.716737 26646 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:27.717527 29202 raft_consensus.cc:697] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:27.718601 26450 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:27.718513 29202 consensus_queue.cc:237] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:27.711843 26594 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.722870 26916 tablet_bootstrap.cc:492] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:27.723381 26916 ts_tablet_manager.cc:1449] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.206s user 0.013s sys 0.000s
I20260928 20:03:27.723909 29376 raft_consensus.cc:2804] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:27.724596 29376 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:27.724896 29376 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:27.726999 26594 leader_election.cc:304] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:27.727689 29370 consensus_queue.cc:1048] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:27.732084 29376 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.733994 29376 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.735692 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:27.736274 26646 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:27.738214 26595 leader_election.cc:304] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.744762 26646 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:27.746191 26450 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:27.747076 29376 raft_consensus.cc:2804] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:27.747799 29376 raft_consensus.cc:697] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:27.748849 29337 raft_consensus.cc:493] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.748859 29171 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.749475 29337 raft_consensus.cc:515] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.751655 29309 raft_consensus.cc:515] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.752127 29337 leader_election.cc:290] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.752714 29376 consensus_queue.cc:237] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.759133 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:27.761752 26450 leader_election.cc:343] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:27.762272 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 187775us
I20260928 20:03:27.766745 29363 raft_consensus.cc:2804] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:27.776119 29375 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.776647 29375 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.779680 29375 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.762429 26916 raft_consensus.cc:359] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.782022 26916 raft_consensus.cc:385] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:27.782552 26916 raft_consensus.cc:740] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:27.771314 29202 raft_consensus.cc:2804] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:27.786791 29202 raft_consensus.cc:493] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:27.783423 29376 raft_consensus.cc:493] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.787220 29202 raft_consensus.cc:3060] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:27.788829 26916 consensus_queue.cc:260] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.787569 29376 raft_consensus.cc:515] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.794209 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:27.797089 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 58969.7us
I20260928 20:03:27.797554 26916 ts_tablet_manager.cc:1480] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.062s user 0.005s sys 0.000s
W20260928 20:03:27.801309 26450 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.804072 29309 leader_election.cc:290] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.805488 29376 leader_election.cc:290] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.811942 26595 leader_election.cc:304] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.826491 26916 tablet_bootstrap.cc:492] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:27.823485 29375 raft_consensus.cc:2804] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:27.835634 29375 raft_consensus.cc:493] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:27.835954 29375 raft_consensus.cc:3060] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:27.807814 29171 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:27.850754 29363 raft_consensus.cc:697] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
W20260928 20:03:27.853864 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 252461us
I20260928 20:03:27.855654 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:27.857757 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.857963 29370 consensus_queue.cc:1048] T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:27.861323 29363 consensus_queue.cc:237] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.869685 26916 tablet_bootstrap.cc:654] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:27.866839 26595 leader_election.cc:304] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.871387 29171 raft_consensus.cc:2804] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:27.871948 29171 raft_consensus.cc:697] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:27.872941 29171 consensus_queue.cc:237] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.881429 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:27.870503 26450 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:27.885094 26450 leader_election.cc:343] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.885480 26450 leader_election.cc:304] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:27.886883 26450 leader_election.cc:343] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.887699 29337 raft_consensus.cc:2749] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.890661 26740 leader_election.cc:304] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:27.897058 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:27.893581 26595 leader_election.cc:304] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.900095 26740 leader_election.cc:304] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:27.899303 29171 raft_consensus.cc:2749] T 29dd1355039e4bca952f13a9d174813e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:27.902072 29376 raft_consensus.cc:493] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:27.902510 29376 raft_consensus.cc:515] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.905877 29376 leader_election.cc:290] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:27.905936 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a658eaaedb4432a4dc2e1f5df6cc58" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:27.907797 26450 leader_election.cc:343] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.914846 29389 consensus_queue.cc:1048] T 309f8fcc50e545178888846ac90afcf2 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:27.916184 26450 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.916589 26450 leader_election.cc:304] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.917824 29337 raft_consensus.cc:2749] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:27.919112 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 63820.4us
I20260928 20:03:27.924878 26796 raft_consensus.cc:1275] T 979f943cd32849f399347f3d9d5b5c18 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:27.922925 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:27.926635 29355 raft_consensus.cc:2749] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.928408 29162 raft_consensus.cc:2749] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.930439 26913 tablet_bootstrap.cc:492] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:27.930905 26913 ts_tablet_manager.cc:1449] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.692s user 0.012s sys 0.000s
W20260928 20:03:27.934276 26740 consensus_peers.cc:597] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542. This is attempt 11: this message will repeat every 5th retry.
I20260928 20:03:27.950712 26595 leader_election.cc:304] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.954664 26595 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.956979 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:27.965720 26916 tablet_bootstrap.cc:492] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:27.960605 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a658eaaedb4432a4dc2e1f5df6cc58" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:27.968506 26450 leader_election.cc:343] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:27.971458 26916 ts_tablet_manager.cc:1449] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.007s
I20260928 20:03:27.971385 26450 leader_election.cc:304] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.958542 29390 raft_consensus.cc:2749] T 5bdb8870dce541a2afb3be09bcb3c701 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:27.972911 29376 raft_consensus.cc:2749] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:27.944422 26913 raft_consensus.cc:359] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:27.974951 26913 raft_consensus.cc:385] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:27.976137 26913 raft_consensus.cc:740] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:27.979701 29389 raft_consensus.cc:2749] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:27.977783 26913 consensus_queue.cc:260] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.009271 26595 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:27.821779 29202 raft_consensus.cc:515] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:27.977644 26916 raft_consensus.cc:359] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.018486 26916 raft_consensus.cc:385] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.019155 26916 raft_consensus.cc:740] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.023522 26913 ts_tablet_manager.cc:1480] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.092s user 0.008s sys 0.000s
I20260928 20:03:28.020326 29376 raft_consensus.cc:493] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.027190 26502 raft_consensus.cc:1275] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:28.028615 26505 raft_consensus.cc:1275] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:28.035115 29376 raft_consensus.cc:515] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.036217 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:28.036813 26505 raft_consensus.cc:2468] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:28.037554 29376 leader_election.cc:290] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.038853 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:28.039587 26505 raft_consensus.cc:3060] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:28.039852 26916 consensus_queue.cc:260] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.045989 26916 ts_tablet_manager.cc:1480] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.074s user 0.006s sys 0.000s
I20260928 20:03:28.049433 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:28.050040 26514 raft_consensus.cc:3060] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:28.057577 26514 raft_consensus.cc:2468] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
W20260928 20:03:28.076875 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45250.7us
I20260928 20:03:28.078267 26916 tablet_bootstrap.cc:492] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:28.044818 29390 raft_consensus.cc:2764] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 20:03:28.092504 26913 tablet_bootstrap.cc:492] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:28.093542 29202 leader_election.cc:290] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.099265 26505 raft_consensus.cc:2468] T c1cb96cab3e647908f3e99981e7147c7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:28.105871 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.076416 29162 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.111863 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.111151 29162 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.113674 29162 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:28.116608 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b11022fc774d18b92e0c694f834375 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.116708 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.117389 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.118283 29376 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.118909 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.118999 29376 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.120954 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:28.121311 29376 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:28.136123 26774 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.603s user 0.004s sys 0.015s
I20260928 20:03:28.144315 26916 tablet_bootstrap.cc:654] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:28.146417 29375 raft_consensus.cc:515] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.148468 29375 leader_election.cc:290] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:28.149966 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:28.150749 26649 raft_consensus.cc:2393] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
W20260928 20:03:28.156467 26774 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.623s user 0.004s sys 0.015s
W20260928 20:03:28.124270 26912 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.647s user 0.014s sys 0.006s
W20260928 20:03:28.157045 26912 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.680s user 0.015s sys 0.006s
W20260928 20:03:28.139539 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 203782us
I20260928 20:03:28.184737 29421 tablet.cc:1751] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:28.191262 26916 tablet_bootstrap.cc:492] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:28.192890 26912 tablet_bootstrap.cc:492] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:28.193388 26912 ts_tablet_manager.cc:1449] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.877s user 0.023s sys 0.007s
I20260928 20:03:28.194001 26916 ts_tablet_manager.cc:1449] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.116s user 0.014s sys 0.000s
I20260928 20:03:28.197353 26916 raft_consensus.cc:359] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.215274 26916 raft_consensus.cc:385] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.216634 26916 raft_consensus.cc:740] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.218415 26916 consensus_queue.cc:260] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.220853 26916 ts_tablet_manager.cc:1480] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260928 20:03:28.226864 26916 tablet_bootstrap.cc:492] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:28.229931 26146 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e09ad691ec3444d938a04a5c572b0cb consensus state has no leader
I20260928 20:03:28.230448 26913 tablet_bootstrap.cc:654] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:28.232019 29418 log.cc:927] Time spent T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54: Append to log took a long time: real 0.101s user 0.001s sys 0.000s
I20260928 20:03:28.195273 29382 tablet_replica.cc:333] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:28.247916 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:28.252314 26916 tablet_bootstrap.cc:654] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:28.262260 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:28.262346 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:28.267078 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:28.245874 29382 raft_consensus.cc:2243] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:28.270879 29382 raft_consensus.cc:2272] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:28.272125 26916 tablet_bootstrap.cc:492] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:28.272508 26916 ts_tablet_manager.cc:1449] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.001s
I20260928 20:03:28.272473 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:28.275236 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:28.276234 26796 raft_consensus.cc:3060] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:28.277779 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:28.281754 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:28.282366 26801 raft_consensus.cc:2468] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:28.281339 26916 raft_consensus.cc:359] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.288759 29382 ts_tablet_manager.cc:1962] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:28.285152 26916 raft_consensus.cc:385] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.290473 26916 raft_consensus.cc:740] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.291147 26916 consensus_queue.cc:260] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.297405 26916 ts_tablet_manager.cc:1480] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.025s user 0.002s sys 0.005s
I20260928 20:03:28.298314 26916 tablet_bootstrap.cc:492] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:28.285986 26786 raft_consensus.cc:1275] T 8a3021bc9be24874a6ebee01dfb6d7fa P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:28.310410 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:28.312012 29370 raft_consensus.cc:493] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.312600 29370 raft_consensus.cc:515] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:28.315989 29370 leader_election.cc:290] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.318540 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:28.323223 26916 tablet_bootstrap.cc:654] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:28.337663 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:28.338124 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:28.363426 26916 tablet_bootstrap.cc:492] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:28.363955 26916 ts_tablet_manager.cc:1449] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.066s user 0.015s sys 0.001s
I20260928 20:03:28.367722 26916 raft_consensus.cc:359] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.380995 26916 raft_consensus.cc:385] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.381353 26916 raft_consensus.cc:740] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.382028 26916 consensus_queue.cc:260] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.387254 26916 ts_tablet_manager.cc:1480] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260928 20:03:28.388237 26916 tablet_bootstrap.cc:492] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:28.391000 29417 tablet.cc:1751] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:28.398963 26595 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:28.400972 26595 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:28.403678 26916 tablet_bootstrap.cc:654] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:28.415062 29376 raft_consensus.cc:493] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.415565 29376 raft_consensus.cc:515] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.417747 29376 leader_election.cc:290] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.444547 26740 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:28.432476 26595 leader_election.cc:304] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:28.452075 29389 raft_consensus.cc:2804] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:28.459091 29389 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:28.459478 29389 raft_consensus.cc:3060] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:28.452457 29396 raft_consensus.cc:2804] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:28.391032 29375 consensus_queue.cc:1048] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.079s
I20260928 20:03:28.432859 29171 consensus_queue.cc:1048] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260928 20:03:28.474813 29396 raft_consensus.cc:697] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:28.509799 29396 consensus_queue.cc:237] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.529534 29405 raft_consensus.cc:2804] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:28.540512 29405 raft_consensus.cc:697] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:28.541399 29405 consensus_queue.cc:237] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.531373 29431 tablet_replica.cc:333] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:28.536094 29389 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:28.550887 29389 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:28.553268 29420 log.cc:927] Time spent T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.336s user 0.001s sys 0.000s
I20260928 20:03:28.570852 26804 raft_consensus.cc:3060] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:28.574278 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 115516us
W20260928 20:03:28.575258 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 130775us
I20260928 20:03:28.578536 29437 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:28.579097 29437 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:28.579734 26912 raft_consensus.cc:359] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.580602 26912 raft_consensus.cc:385] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.580881 26912 raft_consensus.cc:740] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.583081 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:28.583395 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 150978us
W20260928 20:03:28.584275 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 114342us
I20260928 20:03:28.584235 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 627 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:28.568660 26796 raft_consensus.cc:2468] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:28.601181 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:28.606315 26912 consensus_queue.cc:260] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.608191 29389 consensus_queue.cc:1048] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:28.620867 26566 heartbeater.cc:646] Failed to heartbeat to 127.25.129.254:42899 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.129.254:42899 timed out after 1.000s (SENT)
I20260928 20:03:28.621474 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:28.628216 26916 tablet_bootstrap.cc:492] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:28.628638 26916 ts_tablet_manager.cc:1449] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.241s user 0.022s sys 0.024s
I20260928 20:03:28.632052 29376 raft_consensus.cc:493] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.632218 29382 ts_tablet_manager.cc:1975] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:28.632478 29376 raft_consensus.cc:515] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.634243 29376 leader_election.cc:290] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.637112 29382 log.cc:1199] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:28.642189 26916 raft_consensus.cc:359] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.642805 26916 raft_consensus.cc:385] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.643097 26916 raft_consensus.cc:740] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.643788 26916 consensus_queue.cc:260] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.644202 29382 ts_tablet_manager.cc:1996] T fa49943f465f47778ac985cb5f4e6c0f P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:28.645684 29334 raft_consensus.cc:2749] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:28.653200 26594 leader_election.cc:343] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:28.653826 26594 leader_election.cc:343] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:28.641778 26160 catalog_manager.cc:5838] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:28.660493 29437 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:28.665625 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 2 got 0
I20260928 20:03:28.667243 26913 tablet_bootstrap.cc:492] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:28.667768 26913 ts_tablet_manager.cc:1449] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.575s user 0.008s sys 0.005s
I20260928 20:03:28.669939 26160 catalog_manager.cc:5838] T 979f943cd32849f399347f3d9d5b5c18 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:28.671936 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:28.672518 26516 raft_consensus.cc:3060] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:28.681533 26516 raft_consensus.cc:2468] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:28.695190 26594 leader_election.cc:343] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:28.695626 29162 raft_consensus.cc:493] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.696084 29162 raft_consensus.cc:515] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.698449 29162 leader_election.cc:290] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:28.689504 26160 catalog_manager.cc:5838] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:28.699174 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]). Expected version 1 got 0
I20260928 20:03:28.700623 29442 consensus_queue.cc:1048] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:28.702260 26912 ts_tablet_manager.cc:1480] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.509s user 0.003s sys 0.005s
I20260928 20:03:28.702395 26916 ts_tablet_manager.cc:1480] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.074s user 0.009s sys 0.006s
W20260928 20:03:28.702566 26912 ts_tablet_manager.cc:1513] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: Tablet startup took 508ms
W20260928 20:03:28.702834 26912 ts_tablet_manager.cc:1515] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4: Trace:
0928 20:02:52.845902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.922367 (+ 76465us) service_pool.cc:224] Handling call
0928 20:02:52.923754 (+ 1387us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:52.923912 (+ 158us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:52.979677 (+ 55765us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.065005 (+ 85328us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:53.086200 (+ 21195us) inbound_call.cc:177] Queueing success response
0928 20:03:27.316094 (+34229894us) ts_tablet_manager.cc:1425] Bootstrapping tablet
0928 20:03:28.193651 (+877557us) ts_tablet_manager.cc:1481] Starting tablet replica
0928 20:03:28.404188 (+210537us) tablet_replica.cc:261] Starting instrumentation
0928 20:03:28.404680 (+ 492us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":145852,"raft.queue_time_us":87,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"tablet-open.queue_time_us":34229956}
I20260928 20:03:28.708238 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]). Expected version 1 got 0
I20260928 20:03:28.711895 26160 catalog_manager.cc:5838] T 8a3021bc9be24874a6ebee01dfb6d7fa P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:28.719965 29417 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33616 (request call id 0) took 1954 ms. Trace:
I20260928 20:03:28.744616 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
W20260928 20:03:28.756649 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 51991.2us
I20260928 20:03:28.748708 29376 raft_consensus.cc:493] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.758136 29376 raft_consensus.cc:515] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.760010 29376 leader_election.cc:290] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.760556 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:28.761230 26516 raft_consensus.cc:3060] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:28.771504 29441 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.772718 29441 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.775167 29441 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:28.720371 29417 rpcz_store.cc:276] 0928 20:03:26.765875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:26.766085 (+ 210us) service_pool.cc:224] Handling call
0928 20:03:28.719880 (+1953795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:26.767281 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:26.767752 (+ 471us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:26.767794 (+ 42us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:26.767855 (+ 61us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:03:26.768004 (+ 149us) alter_schema_op.cc:128] START. Timestamp: 1790625806767756
0928 20:03:26.768030 (+ 26us) op_driver.cc:348] REPLICATION: starting
0928 20:03:26.768790 (+ 760us) log.cc:844] Serialized 173 byte log entry
0928 20:03:28.045215 (+1276425us) op_driver.cc:464] REPLICATION: finished
0928 20:03:28.390848 (+345633us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:28.397624 (+ 6776us) log.cc:844] Serialized 5 byte log entry
0928 20:03:28.717996 (+320372us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:28.718896 (+ 900us) log.cc:844] Serialized 14 byte log entry
0928 20:03:28.719731 (+ 835us) alter_schema_op.cc:73] Released schema lock
0928 20:03:28.719759 (+ 28us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":343883,"mutex_wait_us":24,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":10971,"prepare.run_wall_time_us":43477,"raft.queue_time_us":333,"raft.run_cpu_time_us":2127,"raft.run_wall_time_us":2126,"replication_time_us":1245912,"spinlock_wait_cycles":136960,"thread_start_us":452350,"threads_started":3,"wal-append.queue_time_us":209402,"wal-append.run_cpu_time_us":2457,"wal-append.run_wall_time_us":1203511}]]}
I20260928 20:03:28.791635 29431 raft_consensus.cc:2243] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Raft consensus shutting down.
I20260928 20:03:28.792308 29431 raft_consensus.cc:2272] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:28.794739 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:28.795408 26506 raft_consensus.cc:2468] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:28.801164 29451 log.cc:927] Time spent T 28c285483dd7460db934a160c5706d3d P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260928 20:03:28.821223 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:28.821779 26796 raft_consensus.cc:3060] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:28.836797 26792 raft_consensus.cc:1275] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:28.836876 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:28.844974 26913 raft_consensus.cc:359] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:28.845978 26913 raft_consensus.cc:385] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:28.846396 26913 raft_consensus.cc:740] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:28.852581 29376 raft_consensus.cc:493] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.853180 29376 raft_consensus.cc:515] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.855373 29376 leader_election.cc:290] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:28.857051 29171 raft_consensus.cc:493] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:28.857481 29171 raft_consensus.cc:515] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:28.859196 29171 leader_election.cc:290] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:28.863709 29431 ts_tablet_manager.cc:1962] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:28.864351 26516 raft_consensus.cc:2468] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:28.871263 26796 raft_consensus.cc:2468] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:28.877440 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 0) took 1347 ms. Trace:
I20260928 20:03:28.877820 29382 rpcz_store.cc:276] 0928 20:03:27.530490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.532294 (+ 1804us) service_pool.cc:224] Handling call
0928 20:03:28.170439 (+638145us) ts_tablet_manager.cc:1197] Deleting tablet fa49943f465f47778ac985cb5f4e6c0f
0928 20:03:28.182332 (+ 11893us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:28.385071 (+202739us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:28.632085 (+247014us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:28.877362 (+245277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56,"tablet-delete.queue_time_us":637177,"thread_start_us":623453,"threads_started":1}
I20260928 20:03:28.881587 29382 tablet_replica.cc:333] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:28.882377 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet fa49943f465f47778ac985cb5f4e6c0f (table default.Table_65cffcfc7e34435cba2424c5d150d38c [id=1d18dd75f3d34be3a2e195cf8bed408b]) successfully deleted
I20260928 20:03:28.883178 26912 tablet_bootstrap.cc:492] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:28.892606 29469 tablet.cc:1751] T 3ed3cd78c90c42f6a99a92bae2cd5491 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260928 20:03:28.893553 29382 raft_consensus.cc:2243] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:28.894635 29382 raft_consensus.cc:2272] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:28.897249 29382 ts_tablet_manager.cc:1962] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:03:28.910247 26594 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:28.911942 29309 consensus_queue.cc:1048] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260928 20:03:28.947481 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet ed48087b59c744f9a928c8d529b69211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:59 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:28.948223 29431 ts_tablet_manager.cc:1975] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260928 20:03:28.988257 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:28.948781 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:28.960923 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:28.847975 26913 consensus_queue.cc:260] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:28.996241 26913 ts_tablet_manager.cc:1480] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.328s user 0.006s sys 0.002s
W20260928 20:03:29.000550 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 77338.4us
I20260928 20:03:29.006479 29431 log.cc:1199] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/1dde3191a52b4254944ae1f8556e1632
I20260928 20:03:29.008072 29431 ts_tablet_manager.cc:1996] T 1dde3191a52b4254944ae1f8556e1632 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:29.029623 26912 tablet_bootstrap.cc:654] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:29.031538 26913 tablet_bootstrap.cc:492] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:29.036440 29431 tablet_replica.cc:333] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:29.036535 26147 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 1dde3191a52b4254944ae1f8556e1632 (table default.Table_3e3854f997f64d7d910310d5a64f929d [id=fc4bea74df184fe5bab194471bd93657]) successfully deleted
I20260928 20:03:29.041414 29431 raft_consensus.cc:2243] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:29.044044 29431 raft_consensus.cc:2272] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:28.986040 26594 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:29.048162 29309 raft_consensus.cc:2804] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:29.048681 29309 raft_consensus.cc:697] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:29.049441 29309 consensus_queue.cc:237] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:29.058693 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 72756.2us
W20260928 20:03:29.071238 26594 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:29.087257 29431 ts_tablet_manager.cc:1962] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:29.094602 26913 tablet_bootstrap.cc:654] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:29.115939 29389 consensus_queue.cc:1048] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:29.117789 29417 tablet.cc:1751] T 01e47444ae914b07a7e3e64711423635 P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:03:29.120712 26594 consensus_peers.cc:597] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:29.174369 29408 consensus_queue.cc:1048] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:29.198480 29472 log.cc:927] Time spent T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.071s user 0.000s sys 0.001s
I20260928 20:03:29.210515 29408 consensus_queue.cc:1048] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:29.211897 26594 leader_election.cc:343] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:29.241706 26913 tablet_bootstrap.cc:492] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:29.242254 26913 ts_tablet_manager.cc:1449] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.211s user 0.008s sys 0.003s
I20260928 20:03:29.244874 26913 raft_consensus.cc:359] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:29.283685 26146 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e09ad691ec3444d938a04a5c572b0cb consensus state has no leader
I20260928 20:03:29.279383 26913 raft_consensus.cc:385] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:29.287026 26913 raft_consensus.cc:740] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:29.288952 26913 consensus_queue.cc:260] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.294792 26796 raft_consensus.cc:3060] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:29.301301 29469 tablet.cc:1751] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:29.312813 26912 tablet_bootstrap.cc:492] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:29.313247 26912 ts_tablet_manager.cc:1449] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.430s user 0.009s sys 0.005s
I20260928 20:03:29.320254 29382 ts_tablet_manager.cc:1975] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:29.328702 29431 ts_tablet_manager.cc:1975] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:29.337458 29431 log.cc:1199] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/bd3fa371924149fb814c8458488aea61
I20260928 20:03:29.338204 29438 consensus_queue.cc:1048] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:29.341200 29431 ts_tablet_manager.cc:1996] T bd3fa371924149fb814c8458488aea61 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
I20260928 20:03:29.335563 26913 ts_tablet_manager.cc:1480] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.093s user 0.005s sys 0.000s
I20260928 20:03:29.348891 26913 tablet_bootstrap.cc:492] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:29.359915 29431 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33616 (request call id 2) took 1022 ms. Trace:
I20260928 20:03:29.360841 29431 rpcz_store.cc:276] 0928 20:03:28.337608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.337804 (+ 196us) service_pool.cc:224] Handling call
0928 20:03:29.036186 (+698382us) ts_tablet_manager.cc:1197] Deleting tablet bd3fa371924149fb814c8458488aea61
0928 20:03:29.036240 (+ 54us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:29.214867 (+178627us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:29.291587 (+ 76720us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:29.359852 (+ 68265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":697568}
I20260928 20:03:29.375239 26147 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet bd3fa371924149fb814c8458488aea61 (table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]) successfully deleted
I20260928 20:03:29.394821 29405 raft_consensus.cc:493] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.395298 29405 raft_consensus.cc:515] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:29.397970 29405 leader_election.cc:290] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.399710 29431 tablet_replica.cc:333] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:29.400365 26913 tablet_bootstrap.cc:654] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:29.400849 29431 raft_consensus.cc:2243] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:29.401718 29431 raft_consensus.cc:2272] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:29.410833 29431 ts_tablet_manager.cc:1962] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:29.383137 26912 raft_consensus.cc:359] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:29.385983 29478 log.cc:927] Time spent T 3b0694e341d64cdea99bb462beb1150b P b2d286f4404146278f5e0785ed9fcee4: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260928 20:03:29.428072 26913 tablet_bootstrap.cc:492] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:29.428604 26913 ts_tablet_manager.cc:1449] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.080s user 0.010s sys 0.000s
I20260928 20:03:29.431989 26913 raft_consensus.cc:359] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.438203 26913 raft_consensus.cc:385] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:29.438620 26913 raft_consensus.cc:740] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:29.439639 26913 consensus_queue.cc:260] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.457541 26913 ts_tablet_manager.cc:1480] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.029s user 0.003s sys 0.003s
I20260928 20:03:29.458554 26913 tablet_bootstrap.cc:492] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:29.399765 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:29.427402 26912 raft_consensus.cc:385] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:29.479496 26912 raft_consensus.cc:740] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:29.480546 26913 tablet_bootstrap.cc:654] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:29.480918 26594 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:29.485412 29431 ts_tablet_manager.cc:1975] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:29.486663 29431 log.cc:1199] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/ed48087b59c744f9a928c8d529b69211
I20260928 20:03:29.487514 29431 ts_tablet_manager.cc:1996] T ed48087b59c744f9a928c8d529b69211 P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:03:29.489152 26450 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.25.129.194:41109 dropped due to backpressure: service queue is full with 50 items
I20260928 20:03:29.490784 26147 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet ed48087b59c744f9a928c8d529b69211 (table default.Table_51d3ebaa7ade42cb81c42d1ff48266b9 [id=0599e8ff6ce546c8aab3a9b26b632e06]) successfully deleted
I20260928 20:03:29.492059 29431 tablet_replica.cc:333] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:29.489557 26450 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.25.129.194:41109 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.25.129.194:41109 (request call id 1113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.25.129.194:41109 (request call id 1123)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1458)
Call kudu.consensus.ConsensusService.StartTabletCopy from 127.25.129.195:56993 (request call id 1459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1460)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1468)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1469)
Call kudu.consensus.ConsensusService.StartTabletCopy from 127.25.129.195:56993 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1472)
Call kudu.consensus.ConsensusService.StartTabletCopy from 127.25.129.195:56993 (request call id 1473)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1474)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1475)
Call kudu.consensus.ConsensusService.StartTabletCopy from 127.25.129.195:56993 (request call id 1476)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1477)
Call kudu.consensus.ConsensusService.StartTabletCopy from 127.25.129.195:56993 (request call id 1478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.195:56993 (request call id 1483)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1114)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1118)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1128)
I20260928 20:03:29.493652 29431 raft_consensus.cc:2243] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:29.494143 29431 raft_consensus.cc:2272] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:29.494634 26912 consensus_queue.cc:260] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:29.497834 26793 raft_consensus.cc:1275] T a0133314d6de46cea61a9260df79bdea P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:29.498584 29431 ts_tablet_manager.cc:1962] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:29.501036 29382 log.cc:1199] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/b667a45712c1449384e1a288f55fd062
I20260928 20:03:29.502027 29382 ts_tablet_manager.cc:1996] T b667a45712c1449384e1a288f55fd062 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:29.502409 26913 tablet_bootstrap.cc:492] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:29.502821 26913 ts_tablet_manager.cc:1449] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.003s
I20260928 20:03:29.506848 29171 consensus_queue.cc:1048] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260928 20:03:29.528787 29417 tablet.cc:1751] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:29.516043 29484 raft_consensus.cc:493] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.530751 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:29.622576 26497 raft_consensus.cc:3060] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:29.623389 26913 raft_consensus.cc:359] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:29.624090 26913 raft_consensus.cc:385] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:29.624339 26913 raft_consensus.cc:740] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:29.622602 29484 raft_consensus.cc:515] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:29.628063 26594 consensus_peers.cc:597] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:29.628722 29484 leader_election.cc:290] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.559435 26511 raft_consensus.cc:1275] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:29.570292 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ce8cfd201343029b487dd6581bfb0a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:29.630304 26512 raft_consensus.cc:2393] T a6ce8cfd201343029b487dd6581bfb0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:29.635617 26497 raft_consensus.cc:2468] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
W20260928 20:03:29.682807 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 110564us
I20260928 20:03:29.691512 29469 tablet.cc:1751] T 046ed3ac8b6b46afbc1e1bde4b2365ef P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:29.705051 29484 raft_consensus.cc:493] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.714643 26913 consensus_queue.cc:260] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:29.719465 29484 raft_consensus.cc:515] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.739106 26913 ts_tablet_manager.cc:1480] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.236s user 0.006s sys 0.000s
I20260928 20:03:29.740398 26913 tablet_bootstrap.cc:492] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:29.775540 29431 ts_tablet_manager.cc:1975] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260928 20:03:29.776069 29431 log.cc:1199] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-1/wal/wals/030f48d0d716450aaa4248d9fb1397ba
I20260928 20:03:29.776913 29431 ts_tablet_manager.cc:1996] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting consensus metadata
W20260928 20:03:29.800247 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 85580.1us
I20260928 20:03:29.814532 26147 catalog_manager.cc:5063] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): tablet 030f48d0d716450aaa4248d9fb1397ba (table default.Table_a47e5f225c19417296342e60482d31d1 [id=4b0f8fae05494c8087442a15e25109aa]) successfully deleted
I20260928 20:03:29.822762 26912 ts_tablet_manager.cc:1480] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.509s user 0.007s sys 0.001s
W20260928 20:03:29.823091 26912 ts_tablet_manager.cc:1513] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: Tablet startup took 509ms
I20260928 20:03:29.828445 26913 tablet_bootstrap.cc:654] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:29.798698 29360 raft_consensus.cc:493] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:29.823329 26912 ts_tablet_manager.cc:1515] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4: Trace:
0928 20:02:52.844926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:02:52.898382 (+ 53456us) service_pool.cc:224] Handling call
0928 20:02:52.899927 (+ 1545us) ts_tablet_manager.cc:715] Acquired tablet manager lock
0928 20:02:52.900102 (+ 175us) ts_tablet_manager.cc:728] Creating new metadata...
0928 20:02:52.921797 (+ 21695us) tablet_metadata.cc:665] Metadata flushed
0928 20:02:53.084230 (+162433us) tablet_replica.cc:206] Creating consensus instance
0928 20:02:53.176790 (+ 92560us) inbound_call.cc:177] Queueing success response
0928 20:03:28.882850 (+35706060us) ts_tablet_manager.cc:1425] Bootstrapping tablet
0928 20:03:29.313485 (+430635us) ts_tablet_manager.cc:1481] Starting tablet replica
0928 20:03:29.313983 (+ 498us) tablet_replica.cc:261] Starting instrumentation
0928 20:03:29.361730 (+ 47747us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":207821,"raft.queue_time_us":208072,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"tablet-open.queue_time_us":35706136}
W20260928 20:03:29.841161 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.568s (SENT)
I20260928 20:03:29.841626 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
W20260928 20:03:29.851152 26595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:29.861270 26912 tablet_bootstrap.cc:492] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:29.897703 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 1) took 2366 ms. Trace:
I20260928 20:03:29.727762 29484 leader_election.cc:290] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.898123 29382 rpcz_store.cc:276] 0928 20:03:27.531016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.534413 (+ 3397us) service_pool.cc:224] Handling call
0928 20:03:28.881422 (+1347009us) ts_tablet_manager.cc:1197] Deleting tablet b667a45712c1449384e1a288f55fd062
0928 20:03:28.881471 (+ 49us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:29.146034 (+264563us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:29.320142 (+174108us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:29.897636 (+577494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10605,"tablet-delete.queue_time_us":1345631}
I20260928 20:03:29.905310 26913 tablet_bootstrap.cc:492] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:29.905793 26913 ts_tablet_manager.cc:1449] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.166s user 0.012s sys 0.000s
I20260928 20:03:29.906407 29506 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:29.908357 26913 raft_consensus.cc:359] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:29.909989 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 68868.1us
I20260928 20:03:29.933568 26913 raft_consensus.cc:385] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:29.933943 26913 raft_consensus.cc:740] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:29.934688 26913 consensus_queue.cc:260] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.935501 29438 raft_consensus.cc:493] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.935952 29438 raft_consensus.cc:515] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:29.936359 26913 ts_tablet_manager.cc:1480] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.030s user 0.005s sys 0.000s
I20260928 20:03:29.937322 26913 tablet_bootstrap.cc:492] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:29.937949 29438 leader_election.cc:290] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.939335 29500 raft_consensus.cc:493] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.903924 29484 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.940131 29484 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.940037 29500 raft_consensus.cc:515] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.942479 29376 raft_consensus.cc:493] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:29.943055 29376 raft_consensus.cc:515] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:29.943887 29500 leader_election.cc:290] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.944754 29484 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.945011 29376 leader_election.cc:290] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:29.949204 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:29.854090 29360 raft_consensus.cc:515] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:29.955487 29360 leader_election.cc:290] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:29.967152 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 165572us
W20260928 20:03:29.994728 26593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:30.000648 26916 tablet_bootstrap.cc:492] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:29.987504 26497 raft_consensus.cc:2468] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:30.014161 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 54413.3us
I20260928 20:03:30.026302 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.027094 26649 raft_consensus.cc:2393] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:30.028057 26912 tablet_bootstrap.cc:654] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.043833 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet b667a45712c1449384e1a288f55fd062 (table default.Table_31b3759a2ab04669a085898c9806347b [id=e2819060d01546218e8b53248ca6decd]) successfully deleted
I20260928 20:03:30.048996 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.050004 26516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.129.194:41109 (request call id 1109) took 1179 ms. Trace:
I20260928 20:03:30.050410 26516 rpcz_store.cc:276] 0928 20:03:29.480515 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:29.537151 (+ 56636us) service_pool.cc:224] Handling call
0928 20:03:29.558264 (+ 21113us) raft_consensus.cc:1471] Updating replica for 1 ops
0928 20:03:29.618826 (+ 60562us) raft_consensus.cc:1534] Early marking committed up to index 0
0928 20:03:29.618852 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0928 20:03:29.660122 (+ 41270us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b2c00004d28. stack: 00007f6548674373 00007f6548674270 00007f6548217574 0000000000516a24 00000000005169b9 00007f654ea16cf1 00007f654ea26652 00007f654f846291 00007f654f80acca 00007f654f80a0ce 00007f655086d9c9 00007f654eee6d34 00007f654eee6cc2 00007f654eee6bf1 00007f654eee6b6c 00007f654eee5e22
0928 20:03:29.660738 (+ 616us) log.cc:844] Serialized 26 byte log entry
0928 20:03:29.902341 (+241603us) raft_consensus.cc:1645] Marking committed up to 0
0928 20:03:29.902395 (+ 54us) raft_consensus.cc:1697] Filling consensus response to leader.
0928 20:03:29.902489 (+ 94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0928 20:03:30.049617 (+147128us) raft_consensus.cc:1685] finished
0928 20:03:30.049631 (+ 14us) raft_consensus.cc:1691] UpdateReplicas() finished
0928 20:03:30.049829 (+ 198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144564,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":338,"spinlock_wait_cycles":90048512,"thread_start_us":286806,"threads_started":2,"wal-append.queue_time_us":372379}
I20260928 20:03:30.056062 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:30.056763 26497 raft_consensus.cc:2468] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:30.059072 26504 raft_consensus.cc:1275] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:30.059290 29514 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.059053 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:30.059831 29514 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.060261 26502 raft_consensus.cc:2468] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:30.062839 29514 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:30.034014 29382 tablet_replica.cc:333] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:30.071861 29382 raft_consensus.cc:2243] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:30.072729 29382 raft_consensus.cc:2272] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:30.081071 26912 tablet_bootstrap.cc:492] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:30.081548 26912 ts_tablet_manager.cc:1449] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.220s user 0.009s sys 0.002s
I20260928 20:03:30.063930 29424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.25.129.194:41109 (request call id 1092) took 1320 ms. Trace:
I20260928 20:03:30.082485 29424 rpcz_store.cc:276] 0928 20:03:28.743829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.743977 (+ 148us) service_pool.cc:224] Handling call
0928 20:03:30.063694 (+1319717us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-copy.queue_time_us":131}
I20260928 20:03:30.096138 29509 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.096891 29509 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:30.107973 26146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.252:44461, user_credentials={real_user=slave}} blocked reactor thread for 189712us
I20260928 20:03:30.123785 29382 ts_tablet_manager.cc:1962] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:30.126693 26912 raft_consensus.cc:359] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:30.132335 26913 tablet_bootstrap.cc:654] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:30.135293 26594 leader_election.cc:343] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:30.135216 26450 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:30.136001 26450 leader_election.cc:343] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.141270 29509 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.142899 26916 tablet_bootstrap.cc:654] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.155761 29494 raft_consensus.cc:493] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.156308 29494 raft_consensus.cc:515] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.158774 29494 leader_election.cc:290] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.159996 29376 raft_consensus.cc:493] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.160414 29376 raft_consensus.cc:515] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:30.161284 26450 leader_election.cc:343] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:30.162689 26450 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.163077 26450 leader_election.cc:304] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.163590 29509 consensus_queue.cc:1048] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:30.164291 26450 leader_election.cc:343] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.164696 26450 leader_election.cc:304] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.168879 29509 raft_consensus.cc:2749] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:30.169747 29376 leader_election.cc:290] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.172595 29494 raft_consensus.cc:2749] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:30.172750 26450 leader_election.cc:343] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.173292 26450 leader_election.cc:304] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.180266 29376 raft_consensus.cc:2749] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:30.194300 29494 raft_consensus.cc:493] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.194900 29494 raft_consensus.cc:515] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.196662 26595 leader_election.cc:304] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.199471 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:30.200186 26511 raft_consensus.cc:2393] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:30.202196 29441 raft_consensus.cc:2804] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:30.202702 29441 raft_consensus.cc:697] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:30.203503 29441 consensus_queue.cc:237] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:30.206816 29376 consensus_queue.cc:1048] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.210852 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.212850 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.199489 29494 leader_election.cc:290] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.222677 26913 tablet_bootstrap.cc:492] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
W20260928 20:03:30.231140 26593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260928 20:03:30.129705 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 102065us
I20260928 20:03:30.236552 26916 tablet_bootstrap.cc:492] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:30.236578 26740 leader_election.cc:304] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:30.237135 26916 ts_tablet_manager.cc:1449] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.237s user 0.013s sys 0.007s
I20260928 20:03:30.237758 29401 raft_consensus.cc:2749] T a6ce8cfd201343029b487dd6581bfb0a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:30.152490 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:30.156471 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.171331 26792 raft_consensus.cc:1275] T 7e78ac2ae0124b7b859a79bd9f1c203a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260928 20:03:30.193773 26737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:30.196347 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.197724 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.223529 26913 ts_tablet_manager.cc:1449] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.286s user 0.012s sys 0.000s
I20260928 20:03:30.245625 26740 leader_election.cc:304] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:30.250279 29401 raft_consensus.cc:3060] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:30.253372 26594 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.254087 29171 consensus_queue.cc:1048] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.259989 29401 raft_consensus.cc:2749] T e8de132c03884597a311898f4d427bb1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:30.262962 29494 raft_consensus.cc:493] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.263474 29494 raft_consensus.cc:515] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.266180 29494 leader_election.cc:290] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.251619 26913 raft_consensus.cc:359] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.271590 26913 raft_consensus.cc:385] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.271891 26913 raft_consensus.cc:740] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.272660 26913 consensus_queue.cc:260] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.275051 26913 ts_tablet_manager.cc:1480] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260928 20:03:30.283118 29494 raft_consensus.cc:493] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.283661 29494 raft_consensus.cc:515] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.285550 29494 leader_election.cc:290] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.294915 26916 raft_consensus.cc:359] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.297076 26912 raft_consensus.cc:385] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.297948 26912 raft_consensus.cc:740] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.313874 26912 consensus_queue.cc:260] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:30.317906 26913 tablet_bootstrap.cc:492] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:30.336906 26912 ts_tablet_manager.cc:1480] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.255s user 0.005s sys 0.001s
I20260928 20:03:30.344288 29513 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.344758 29513 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.346908 29513 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:30.353852 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.356446 26912 tablet_bootstrap.cc:492] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:30.356699 29382 ts_tablet_manager.cc:1975] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:30.359790 26913 tablet_bootstrap.cc:654] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.301183 26916 raft_consensus.cc:385] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.360251 26916 raft_consensus.cc:740] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.360945 26916 consensus_queue.cc:260] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.372625 26916 ts_tablet_manager.cc:1480] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.135s user 0.005s sys 0.000s
I20260928 20:03:30.379110 26916 tablet_bootstrap.cc:492] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:30.373373 26594 leader_election.cc:343] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.389384 29171 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.389807 29171 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.393330 26595 leader_election.cc:304] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.394884 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ac199f639c454cbc920012040f52c9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:30.393923 26595 raft_consensus.cc:2686] T 030f48d0d716450aaa4248d9fb1397ba P 92fd8074a7df4bba87a73c0d84ed00c8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260928 20:03:30.398053 26595 leader_election.cc:304] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.398947 29309 raft_consensus.cc:2804] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:30.399410 29309 raft_consensus.cc:697] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:30.400151 29309 consensus_queue.cc:237] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.401577 26916 tablet_bootstrap.cc:654] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.403789 29171 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:30.395148 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ac199f639c454cbc920012040f52c9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.424187 29382 log.cc:1199] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/292eef7bab904a7ea5ef6dbdaba1d37d
W20260928 20:03:30.406744 26740 consensus_peers.cc:597] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46. This is attempt 11: this message will repeat every 5th retry.
I20260928 20:03:30.424988 29382 ts_tablet_manager.cc:1996] T 292eef7bab904a7ea5ef6dbdaba1d37d P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:30.427947 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 2) took 2896 ms. Trace:
I20260928 20:03:30.428242 29382 rpcz_store.cc:276] 0928 20:03:27.531495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.546227 (+ 14732us) service_pool.cc:224] Handling call
0928 20:03:30.033818 (+2487591us) ts_tablet_manager.cc:1197] Deleting tablet 292eef7bab904a7ea5ef6dbdaba1d37d
0928 20:03:30.033875 (+ 57us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:30.261794 (+227919us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:30.356579 (+ 94785us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:30.427895 (+ 71316us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2486489}
I20260928 20:03:30.428757 29534 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:30.429411 29534 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:30.430212 29382 tablet_replica.cc:333] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:30.431041 29382 raft_consensus.cc:2243] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:30.431807 29382 raft_consensus.cc:2272] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:30.437934 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.438485 26797 raft_consensus.cc:2468] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:30.439494 26786 raft_consensus.cc:3060] T 6393d0583a9a47ec9eb455b30a548fc3 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:30.455154 26913 tablet_bootstrap.cc:492] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:30.459857 29534 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:30.460806 26913 ts_tablet_manager.cc:1449] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.143s user 0.003s sys 0.007s
I20260928 20:03:30.463899 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 292eef7bab904a7ea5ef6dbdaba1d37d (table default.Table_29313cec5adc47e1af7bd7a25a0ce4ef [id=073a59d0af1e49fdb2b47f2530f7f65f]) successfully deleted
I20260928 20:03:30.464165 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 628 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:30.458724 26594 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:30.465755 29171 raft_consensus.cc:2804] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:30.466176 29171 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:30.466567 29171 raft_consensus.cc:3060] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:30.479744 29494 raft_consensus.cc:493] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.480257 29494 raft_consensus.cc:515] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:30.483901 29494 leader_election.cc:290] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.484712 29536 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.488047 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ddf1201784a93ada93e629befa030" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.489688 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.491204 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.485210 29536 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:30.433995 29382 ts_tablet_manager.cc:1962] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:30.499154 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:30.499624 26912 tablet_bootstrap.cc:654] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:30.486030 26595 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.25.129.194:41109 dropped due to backpressure: service queue is full with 50 items
I20260928 20:03:30.487833 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ddf1201784a93ada93e629befa030" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.489323 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.506539 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:30.490185 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.490236 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.507938 26657 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:30.495131 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.473440 29171 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.543853 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.544770 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.545763 29494 raft_consensus.cc:493] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.546288 29494 raft_consensus.cc:515] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.548137 29494 leader_election.cc:290] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.558125 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.558768 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.559067 29171 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:30.527478 26913 raft_consensus.cc:359] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.507983 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:30.501168 29536 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:30.570251 26913 raft_consensus.cc:385] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.571708 26913 raft_consensus.cc:740] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.572796 26913 consensus_queue.cc:260] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:30.574589 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 88588.1us
I20260928 20:03:30.571091 29536 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:30.581410 26595 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:30.583990 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:30.584486 26797 raft_consensus.cc:3060] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:30.582950 26595 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.590957 26797 raft_consensus.cc:2468] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:30.593284 29438 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:30.602784 26913 ts_tablet_manager.cc:1480] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.139s user 0.006s sys 0.001s
I20260928 20:03:30.603713 26913 tablet_bootstrap.cc:492] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
W20260928 20:03:30.613637 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 105719us
I20260928 20:03:30.623176 26916 tablet_bootstrap.cc:492] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:30.623625 26916 ts_tablet_manager.cc:1449] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.245s user 0.006s sys 0.005s
I20260928 20:03:30.529953 26161 catalog_manager.cc:5838] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 1 to 3, leader changed from 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194) to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 3 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:30.629251 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.636961 29513 consensus_queue.cc:1048] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.638612 26594 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:30.639856 29441 raft_consensus.cc:2804] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:30.640893 29441 raft_consensus.cc:697] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:30.641664 29441 consensus_queue.cc:237] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.646481 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.648568 26913 tablet_bootstrap.cc:654] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.651249 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.660120 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.663545 26912 tablet_bootstrap.cc:492] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:30.665177 26912 ts_tablet_manager.cc:1449] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.309s user 0.009s sys 0.004s
I20260928 20:03:30.668579 29494 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.669063 29494 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.669559 29492 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.670210 29492 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.671207 29494 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.672147 29492 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.681231 26648 raft_consensus.cc:1240] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 20:03:30.684518 29492 raft_consensus.cc:493] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.684986 29492 raft_consensus.cc:515] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.686054 26161 catalog_manager.cc:5838] T 90b887f248114c1fbe539769daac776d P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.686877 29492 leader_election.cc:290] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.687680 26161 catalog_manager.cc:5838] T ee8db8da5c3a42679d26c22396938fd2 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 1 to 2, leader changed from 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193) to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 2 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } }
I20260928 20:03:30.690900 29492 raft_consensus.cc:493] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.691421 29492 raft_consensus.cc:515] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.693504 29492 leader_election.cc:290] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.694327 26913 tablet_bootstrap.cc:492] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:30.694770 26913 ts_tablet_manager.cc:1449] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.003s
I20260928 20:03:30.697134 26913 raft_consensus.cc:359] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.697768 26913 raft_consensus.cc:385] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.700466 26916 raft_consensus.cc:359] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.701207 26916 raft_consensus.cc:385] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.701465 26916 raft_consensus.cc:740] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.702380 26916 consensus_queue.cc:260] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.703860 26916 ts_tablet_manager.cc:1480] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.080s user 0.007s sys 0.000s
I20260928 20:03:30.709834 29494 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.709898 29376 raft_consensus.cc:493] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.710337 29494 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.710518 29376 raft_consensus.cc:515] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.712195 29494 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.712607 29494 raft_consensus.cc:493] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.713081 29494 raft_consensus.cc:515] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.712541 29376 leader_election.cc:290] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.715075 29494 leader_election.cc:290] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.718667 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:30.719247 26500 raft_consensus.cc:2468] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:30.720986 26500 raft_consensus.cc:1275] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:30.698602 29524 consensus_queue.cc:1048] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.702265 29405 raft_consensus.cc:493] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:30.723990 29405 raft_consensus.cc:515] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.703115 29441 consensus_queue.cc:1048] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.703949 29171 consensus_queue.cc:1048] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.726013 29405 leader_election.cc:290] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:30.727447 26912 raft_consensus.cc:359] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.728084 26912 raft_consensus.cc:385] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:30.728020 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.707700 26595 leader_election.cc:304] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:30.733419 26594 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:30.727972 26913 raft_consensus.cc:740] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.748616 26913 consensus_queue.cc:260] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.751579 26913 ts_tablet_manager.cc:1480] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.057s user 0.004s sys 0.003s
I20260928 20:03:30.752640 26913 tablet_bootstrap.cc:492] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:30.758599 29405 raft_consensus.cc:2804] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:30.759138 29405 raft_consensus.cc:493] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:30.759586 29405 raft_consensus.cc:3060] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:30.771183 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 63563.4us
I20260928 20:03:30.773044 29171 consensus_queue.cc:1048] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.777436 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:30.778112 26497 raft_consensus.cc:2468] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:30.779464 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:30.782399 26916 tablet_bootstrap.cc:492] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:30.794266 26161 catalog_manager.cc:5838] T 5bdb8870dce541a2afb3be09bcb3c701 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.801311 26161 catalog_manager.cc:5838] T aec2497f4eac4408a37eb2a40122a672 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.728451 26912 raft_consensus.cc:740] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:30.803140 26912 consensus_queue.cc:260] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.808511 29171 consensus_queue.cc:1048] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.814320 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:30.818864 26595 leader_election.cc:304] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.819442 26912 ts_tablet_manager.cc:1480] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.154s user 0.005s sys 0.000s
I20260928 20:03:30.819859 29171 raft_consensus.cc:2804] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:30.820266 29171 raft_consensus.cc:493] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:30.820636 29171 raft_consensus.cc:3060] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:30.834404 26912 tablet_bootstrap.cc:492] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:30.842352 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:30.843245 26161 catalog_manager.cc:5838] T 09bd74bc45d14e789567df6019f6d99b P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 1 to 2, leader changed from 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193) to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 2 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.847761 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.850049 29441 consensus_queue.cc:1048] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:30.852110 26595 leader_election.cc:304] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:30.853013 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.854542 29441 raft_consensus.cc:2804] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:30.854946 29441 raft_consensus.cc:493] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:30.855409 29441 raft_consensus.cc:3060] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:30.866808 26161 catalog_manager.cc:5838] T d479a8eabc624569968515684e8acb0c P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } }
I20260928 20:03:30.878823 29546 tablet.cc:1751] T 01e47444ae914b07a7e3e64711423635 P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:30.895375 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.895959 26648 raft_consensus.cc:2468] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:30.882079 26912 tablet_bootstrap.cc:654] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.886389 26786 raft_consensus.cc:1240] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 20:03:30.887769 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.888638 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.883524 29382 ts_tablet_manager.cc:1975] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:30.900755 29382 log.cc:1199] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/d13562e920244194969520df564a949d
I20260928 20:03:30.889689 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.901585 29382 ts_tablet_manager.cc:1996] T d13562e920244194969520df564a949d P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:30.903883 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 4) took 3371 ms. Trace:
I20260928 20:03:30.767642 29405 raft_consensus.cc:515] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:30.910895 29405 leader_election.cc:290] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:30.914425 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 62402.6us
I20260928 20:03:30.920619 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.922017 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.864054 29441 raft_consensus.cc:515] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:30.941196 29441 leader_election.cc:290] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.869820 26161 catalog_manager.cc:5838] T 16796100116a4fe4a64893f49fb1cad4 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.942663 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:30.943961 26161 catalog_manager.cc:5838] T 41ac9772778c4fe8afc272f98eee2999 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:30.945731 26161 catalog_manager.cc:5838] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 1 to 2, leader changed from 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193) to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.911077 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:30.923995 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.954339 29382 rpcz_store.cc:276] 0928 20:03:27.532371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.549181 (+ 16810us) service_pool.cc:224] Handling call
0928 20:03:30.429241 (+2880060us) ts_tablet_manager.cc:1197] Deleting tablet d13562e920244194969520df564a949d
0928 20:03:30.429284 (+ 43us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:30.695812 (+266528us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:30.883384 (+187572us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:30.903824 (+ 20440us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2879424}
I20260928 20:03:30.941411 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:30.958665 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.959981 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.959834 29171 raft_consensus.cc:515] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:30.961213 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:30.961737 29171 leader_election.cc:290] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:30.976176 29382 tablet_replica.cc:333] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:30.977422 29382 raft_consensus.cc:2243] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:30.982450 29382 raft_consensus.cc:2272] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:30.914068 26916 tablet_bootstrap.cc:654] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:30.955875 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet d13562e920244194969520df564a949d (table default.Table_a47e5f225c19417296342e60482d31d1 [id=4b0f8fae05494c8087442a15e25109aa]) successfully deleted
I20260928 20:03:30.993166 26161 catalog_manager.cc:5838] T 2d1c8e5a49db49f39e90c3737c33e8fc P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.994853 26161 catalog_manager.cc:5838] T 87024e1a4f184c669ff78efc918a9eef P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.995831 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:31.022382 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]). Expected version 1 got 0
I20260928 20:03:31.023216 26161 catalog_manager.cc:5838] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.025574 26161 catalog_manager.cc:5838] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:30.987485 26912 tablet_bootstrap.cc:492] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:31.005926 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:31.038532 26912 ts_tablet_manager.cc:1449] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.204s user 0.004s sys 0.007s
I20260928 20:03:31.022908 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.023936 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.024894 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.025180 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.041953 26912 raft_consensus.cc:359] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.042802 26912 raft_consensus.cc:385] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.043157 26912 raft_consensus.cc:740] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.043495 29382 ts_tablet_manager.cc:1962] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:31.043817 26912 consensus_queue.cc:260] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.046392 26912 ts_tablet_manager.cc:1480] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260928 20:03:31.047386 26912 tablet_bootstrap.cc:492] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:30.962458 26913 tablet_bootstrap.cc:700] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent opening tablet: real 0.205s user 0.004s sys 0.000s
I20260928 20:03:30.964617 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:30.972154 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.057673 26649 raft_consensus.cc:2468] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:30.973244 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.058686 26657 raft_consensus.cc:2468] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:30.974364 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.060155 26913 tablet_bootstrap.cc:654] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:30.993079 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 73128.7us
W20260928 20:03:30.994513 26594 leader_election.cc:343] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.063091 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 68621.3us
W20260928 20:03:31.063695 26594 leader_election.cc:343] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.064272 26594 leader_election.cc:343] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.052023 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.053015 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.053974 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.054943 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:31.087882 29494 raft_consensus.cc:493] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.088440 29494 raft_consensus.cc:515] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.027420 26161 catalog_manager.cc:5838] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.089900 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:31.090963 29494 leader_election.cc:290] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.090750 26161 catalog_manager.cc:5838] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } }
W20260928 20:03:31.091704 26450 leader_election.cc:343] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.092113 26161 catalog_manager.cc:5838] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.093098 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:31.097954 26913 tablet_bootstrap.cc:492] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:31.098459 26913 ts_tablet_manager.cc:1449] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.346s user 0.011s sys 0.001s
I20260928 20:03:31.101089 26913 raft_consensus.cc:359] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.101835 26913 raft_consensus.cc:385] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:03:31.102628 26450 leader_election.cc:343] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.104872 26450 consensus_peers.cc:597] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:31.105504 26450 leader_election.cc:343] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.106165 26450 leader_election.cc:343] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.091898 26916 tablet_bootstrap.cc:492] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
W20260928 20:03:31.108769 27822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.675s (SENT) [suppressed 3 similar messages]
I20260928 20:03:31.108913 26916 ts_tablet_manager.cc:1449] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.327s user 0.011s sys 0.000s
I20260928 20:03:31.124562 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:31.125521 26161 catalog_manager.cc:5838] T e3e86ccb8c334a54b42913bd5f405942 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.126798 26161 catalog_manager.cc:5838] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.128090 26161 catalog_manager.cc:5838] T 8cbffea517e2438d90ca234b9f72f733 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } }
W20260928 20:03:31.130695 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 68124.7us
I20260928 20:03:31.135653 29376 raft_consensus.cc:493] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.139012 26913 raft_consensus.cc:740] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.130273 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:31.144480 26161 catalog_manager.cc:5838] T 647a383938f947108890ae2042e3edc3 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.150462 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:31.151690 26913 consensus_queue.cc:260] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.159444 26161 catalog_manager.cc:5838] T 9db52eb6b080457583b0a59291995843 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.160938 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:31.166910 26161 catalog_manager.cc:5838] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.169934 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]). Expected version 1 got 0
I20260928 20:03:31.174557 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:31.175366 26912 tablet_bootstrap.cc:654] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:31.176690 26161 catalog_manager.cc:5838] T d9f0f9d65836425f966e9ee4f709915c P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.182315 26161 catalog_manager.cc:5838] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } }
W20260928 20:03:31.106976 26450 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.185375 26595 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.186491 29441 raft_consensus.cc:2804] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:31.186860 29441 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:31.187208 29441 raft_consensus.cc:3060] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:31.188660 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:31.195042 26913 ts_tablet_manager.cc:1480] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.096s user 0.003s sys 0.002s
I20260928 20:03:31.200451 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:31.201711 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 2 got 0
I20260928 20:03:31.203958 29405 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:31.204528 29405 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.205574 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:31.206647 29405 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.214811 29494 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.215368 29494 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.217259 29494 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.184368 29376 raft_consensus.cc:515] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.217955 29171 consensus_queue.cc:1048] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:31.219094 29376 leader_election.cc:290] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.227130 26595 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.227941 29513 raft_consensus.cc:2804] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:31.228294 29513 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:31.228605 29513 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:31.235625 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:31.240545 29513 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.243304 29513 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.247144 26913 tablet_bootstrap.cc:492] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:31.238669 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:31.254277 26916 raft_consensus.cc:359] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.254921 26916 raft_consensus.cc:385] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.255167 26916 raft_consensus.cc:740] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.255908 26161 catalog_manager.cc:5838] T fec512104cb6418db320e072476c2874 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.255740 26916 consensus_queue.cc:260] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.258620 29441 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.261644 29171 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.262130 29171 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.267375 26916 ts_tablet_manager.cc:1480] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.158s user 0.004s sys 0.001s
I20260928 20:03:31.268409 26916 tablet_bootstrap.cc:492] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:31.269801 29171 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:31.184945 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 77989.5us
W20260928 20:03:31.273167 26450 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.273893 26450 leader_election.cc:343] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.274611 26450 leader_election.cc:343] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.284795 26161 catalog_manager.cc:5838] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.302176 29376 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.302762 29376 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.305032 29376 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:31.305655 26450 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.306464 26450 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.305579 26161 catalog_manager.cc:5838] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
W20260928 20:03:31.307076 26450 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.307615 26450 leader_election.cc:343] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.307466 26161 catalog_manager.cc:5838] T e1d6dcd913394d4ca2e4b9f5be5ea069 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.308307 29376 consensus_queue.cc:1059] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:31.309123 29376 raft_consensus.cc:3055] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:31.309489 29376 raft_consensus.cc:740] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:31.310376 29376 consensus_queue.cc:260] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.311250 29376 raft_consensus.cc:3060] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:31.312611 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:31.315462 29405 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:31.316026 29405 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.318423 29405 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.324726 26916 tablet_bootstrap.cc:654] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:31.328227 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 196764us
I20260928 20:03:31.329890 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:31.347457 26161 catalog_manager.cc:5838] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:31.328172 29171 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:31.351173 29171 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.353574 29171 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:31.359571 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 51422us
W20260928 20:03:31.360373 26450 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.360981 26450 leader_election.cc:343] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.361675 26450 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.362478 26450 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.356595 26146 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e09ad691ec3444d938a04a5c572b0cb consensus state has no leader
I20260928 20:03:31.369733 26161 catalog_manager.cc:5838] T 1d945be7bea449ba8c5541b60eb18334 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195). New cstate: current_term: 1 leader_uuid: "b2d286f4404146278f5e0785ed9fcee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } }
I20260928 20:03:31.371662 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
W20260928 20:03:31.372117 26451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:31.386076 29441 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:31.363344 26450 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.399048 26450 leader_election.cc:343] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.399715 26450 leader_election.cc:343] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.401304 26450 leader_election.cc:343] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.401937 26450 leader_election.cc:343] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.402763 26450 leader_election.cc:343] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.408774 26161 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:31.349874 26913 tablet_bootstrap.cc:654] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:31.420389 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:31.420850 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:31.422397 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.422974 26790 raft_consensus.cc:2468] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:31.423401 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.438283 26912 tablet_bootstrap.cc:492] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:31.438810 26912 ts_tablet_manager.cc:1449] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.392s user 0.021s sys 0.001s
I20260928 20:03:31.441148 26912 raft_consensus.cc:359] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.425730 26916 tablet_bootstrap.cc:492] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:31.442597 26916 ts_tablet_manager.cc:1449] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.174s user 0.012s sys 0.002s
I20260928 20:03:31.445271 26916 raft_consensus.cc:359] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.466382 29376 raft_consensus.cc:493] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.466948 29376 raft_consensus.cc:515] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.469578 29376 leader_election.cc:290] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:31.442556 26450 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.486959 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 44434.1us
I20260928 20:03:31.487890 29376 consensus_queue.cc:1048] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:31.498570 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
W20260928 20:03:31.501402 26450 leader_election.cc:343] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.501844 26450 leader_election.cc:304] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.506516 29171 consensus_queue.cc:1048] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:31.497017 29551 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.508059 29551 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.510011 29551 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.510569 26912 raft_consensus.cc:385] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.510905 26912 raft_consensus.cc:740] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.511520 26912 consensus_queue.cc:260] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.514451 29494 raft_consensus.cc:2749] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:31.515856 26450 leader_election.cc:343] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.516345 26450 leader_election.cc:304] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.517048 29376 raft_consensus.cc:2749] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:31.518170 26916 raft_consensus.cc:385] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.518594 26916 raft_consensus.cc:740] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.519569 26913 tablet_bootstrap.cc:492] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:31.519343 26916 consensus_queue.cc:260] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.520155 26913 ts_tablet_manager.cc:1449] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.273s user 0.008s sys 0.003s
I20260928 20:03:31.522172 26916 ts_tablet_manager.cc:1480] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
I20260928 20:03:31.523113 26916 tablet_bootstrap.cc:492] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:31.527168 26913 raft_consensus.cc:359] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.527911 26913 raft_consensus.cc:385] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.528301 26913 raft_consensus.cc:740] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.529088 26913 consensus_queue.cc:260] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.530907 26913 ts_tablet_manager.cc:1480] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260928 20:03:31.540122 26913 tablet_bootstrap.cc:492] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:31.543860 29405 raft_consensus.cc:493] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.544457 29405 raft_consensus.cc:515] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.547483 29405 leader_election.cc:290] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.548383 26912 ts_tablet_manager.cc:1480] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.109s user 0.003s sys 0.001s
I20260928 20:03:31.549348 26912 tablet_bootstrap.cc:492] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:31.550379 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 44588us
W20260928 20:03:31.552343 26594 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:31.554237 26594 leader_election.cc:343] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.556651 26594 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:31.558434 26594 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
I20260928 20:03:31.558918 29171 raft_consensus.cc:2804] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:31.559363 29171 raft_consensus.cc:493] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:31.559744 29171 raft_consensus.cc:3060] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:31.567154 29171 raft_consensus.cc:515] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:31.580981 26594 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:31.606829 29441 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:31.607362 29441 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.609380 29441 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.554801 29382 ts_tablet_manager.cc:1975] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:31.611465 29382 log.cc:1199] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/7775ad91c86840c49a902b059a0ff74d
I20260928 20:03:31.612239 29382 ts_tablet_manager.cc:1996] T 7775ad91c86840c49a902b059a0ff74d P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:31.621795 29171 leader_election.cc:290] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.628022 29376 raft_consensus.cc:493] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.639253 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 3) took 4107 ms. Trace:
I20260928 20:03:31.650213 29382 rpcz_store.cc:276] 0928 20:03:27.531861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.550219 (+ 18358us) service_pool.cc:224] Handling call
0928 20:03:30.955546 (+3405327us) ts_tablet_manager.cc:1197] Deleting tablet 7775ad91c86840c49a902b059a0ff74d
0928 20:03:30.975112 (+ 19566us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:31.417817 (+442705us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:31.554669 (+136852us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:31.639181 (+ 84512us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3404731}
I20260928 20:03:31.652009 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 7775ad91c86840c49a902b059a0ff74d (table default.Table_c3320acca4da439bb957f8a82adbd8a2 [id=c241df12dd55497985910321fa8f03c5]) successfully deleted
W20260928 20:03:31.648896 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 46070.9us
I20260928 20:03:31.653209 26912 tablet_bootstrap.cc:654] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:31.659071 26913 tablet_bootstrap.cc:700] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent opening tablet: real 0.114s user 0.003s sys 0.000s
W20260928 20:03:31.663347 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 147504us
I20260928 20:03:31.663627 26913 tablet_bootstrap.cc:654] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:31.663995 26450 leader_election.cc:343] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.664345 26450 leader_election.cc:304] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.669267 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:31.634383 29494 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.670369 29494 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.672089 29494 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.679273 26797 raft_consensus.cc:1275] T 03bd721cb5b34b9288fad286290db847 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:31.684576 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.688373 29382 tablet_replica.cc:333] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:31.631693 29376 raft_consensus.cc:515] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.689407 29382 raft_consensus.cc:2243] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:31.690995 29382 raft_consensus.cc:2272] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:31.697142 29376 leader_election.cc:290] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.703945 26912 tablet_bootstrap.cc:492] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:31.704689 26912 ts_tablet_manager.cc:1449] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.156s user 0.011s sys 0.006s
I20260928 20:03:31.707325 26912 raft_consensus.cc:359] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:31.707937 26912 raft_consensus.cc:385] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.708175 26912 raft_consensus.cc:740] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.708707 26912 consensus_queue.cc:260] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:31.711100 26912 ts_tablet_manager.cc:1480] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260928 20:03:31.712208 26912 tablet_bootstrap.cc:492] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:31.718626 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 54652.4us
W20260928 20:03:31.719434 26450 leader_election.cc:343] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.719848 26450 leader_election.cc:304] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.693037 29382 ts_tablet_manager.cc:1962] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:31.725976 29494 raft_consensus.cc:2749] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:31.731928 26450 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.735144 26450 leader_election.cc:304] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:31.736737 26450 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.737155 26450 leader_election.cc:304] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.734961 29494 raft_consensus.cc:2749] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:31.742177 26913 tablet_bootstrap.cc:492] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:31.742601 26913 ts_tablet_manager.cc:1449] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.203s user 0.009s sys 0.001s
I20260928 20:03:31.742449 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:31.743026 26786 raft_consensus.cc:3060] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 2
I20260928 20:03:31.738138 29376 raft_consensus.cc:2749] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:31.751377 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.753139 26786 raft_consensus.cc:2468] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:31.760030 26792 raft_consensus.cc:3060] T bc58b27db848454196f75b9077a203cb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:31.783586 26913 raft_consensus.cc:359] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.784258 26913 raft_consensus.cc:385] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.784507 26913 raft_consensus.cc:740] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.789434 26913 consensus_queue.cc:260] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.791478 26913 ts_tablet_manager.cc:1480] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260928 20:03:31.805871 26916 tablet_bootstrap.cc:654] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:31.809484 29570 log.cc:927] Time spent T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: Append to log took a long time: real 0.069s user 0.000s sys 0.002s
I20260928 20:03:31.818964 29494 raft_consensus.cc:493] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:31.826229 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.675s (SENT)
I20260928 20:03:31.826658 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:31.829540 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:31.803547 29376 raft_consensus.cc:2749] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:31.832864 29171 raft_consensus.cc:493] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.833460 29171 raft_consensus.cc:515] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.836072 29171 leader_election.cc:290] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.844887 29376 raft_consensus.cc:493] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.850855 26913 tablet_bootstrap.cc:492] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:31.836688 29494 raft_consensus.cc:515] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.853801 29494 leader_election.cc:290] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.859726 29494 raft_consensus.cc:493] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.862488 29494 raft_consensus.cc:515] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:03:31.863656 26740 consensus_peers.cc:597] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a. This is attempt 11: this message will repeat every 5th retry.
W20260928 20:03:31.875563 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 49372us
I20260928 20:03:31.876662 29171 raft_consensus.cc:493] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.877182 29171 raft_consensus.cc:515] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.884027 29494 leader_election.cc:290] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
W20260928 20:03:31.861896 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 125176us
I20260928 20:03:31.884699 26912 tablet_bootstrap.cc:654] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:31.884860 26450 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:31.876441 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 51139.8us
I20260928 20:03:31.886464 29171 leader_election.cc:290] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.889967 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.894434 26916 tablet_bootstrap.cc:492] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:31.894922 26916 ts_tablet_manager.cc:1449] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.372s user 0.007s sys 0.004s
I20260928 20:03:31.897106 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:31.897398 26916 raft_consensus.cc:359] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.897748 26790 raft_consensus.cc:2468] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:31.898263 29574 raft_consensus.cc:2804] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:31.898630 29574 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:31.898958 29574 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:31.901631 29576 raft_consensus.cc:493] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:31.902076 29576 raft_consensus.cc:515] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.904073 29576 leader_election.cc:290] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.904574 29576 raft_consensus.cc:493] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.882222 29575 raft_consensus.cc:493] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.845335 29376 raft_consensus.cc:515] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:31.926054 26450 leader_election.cc:343] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:31.926558 26450 leader_election.cc:304] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:31.929342 26912 tablet_bootstrap.cc:492] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:31.890049 26913 tablet_bootstrap.cc:654] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:31.931406 29382 ts_tablet_manager.cc:1975] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:31.931882 29382 log.cc:1199] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:31.932711 29382 ts_tablet_manager.cc:1996] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:31.933544 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 5) took 4400 ms. Trace:
I20260928 20:03:31.938207 29577 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:31.898010 26916 raft_consensus.cc:385] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:31.947229 26916 raft_consensus.cc:740] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:31.939379 29400 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.973848 29400 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.976060 29400 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:31.976616 29382 rpcz_store.cc:276] 0928 20:03:27.532992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.549937 (+ 16945us) service_pool.cc:224] Handling call
0928 20:03:31.653010 (+4103073us) ts_tablet_manager.cc:1197] Deleting tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6
0928 20:03:31.688225 (+ 35215us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:31.837786 (+149561us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:31.931279 (+ 93493us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:31.933491 (+ 2212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4101590}
I20260928 20:03:31.920579 29575 raft_consensus.cc:515] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.978415 29382 tablet_replica.cc:333] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:31.979020 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 (table default.Table_7a934c9d12fa42cd818bc13a48bfd4ea [id=b4e172d4e9864aaf844a0dcf07165e22]) successfully deleted
W20260928 20:03:31.981575 26740 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:31.983529 29376 leader_election.cc:290] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.984987 29376 raft_consensus.cc:2749] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:31.986373 26912 ts_tablet_manager.cc:1449] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.274s user 0.010s sys 0.000s
I20260928 20:03:31.943264 29494 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.985846 26913 tablet_bootstrap.cc:492] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:31.987226 26913 ts_tablet_manager.cc:1449] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.137s user 0.006s sys 0.005s
I20260928 20:03:31.987015 29494 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.988811 29494 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:31.904958 29576 raft_consensus.cc:515] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.995721 29576 leader_election.cc:290] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:31.997548 26916 consensus_queue.cc:260] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:31.999547 26916 ts_tablet_manager.cc:1480] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.104s user 0.007s sys 0.000s
I20260928 20:03:32.000408 26916 tablet_bootstrap.cc:492] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:32.012986 29575 leader_election.cc:290] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.013517 29575 raft_consensus.cc:493] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:31.989675 26913 raft_consensus.cc:359] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.022447 26913 raft_consensus.cc:385] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.022738 26913 raft_consensus.cc:740] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.022718 29576 raft_consensus.cc:493] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.023157 29576 raft_consensus.cc:515] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:32.023475 26913 consensus_queue.cc:260] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.024906 29576 leader_election.cc:290] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.026252 26913 ts_tablet_manager.cc:1480] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260928 20:03:32.027163 26913 tablet_bootstrap.cc:492] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:32.013935 29575 raft_consensus.cc:515] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:32.029034 29575 leader_election.cc:290] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.037235 29574 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.039229 29574 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.055331 29171 consensus_queue.cc:1048] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:32.056520 26916 tablet_bootstrap.cc:654] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:32.058368 26594 consensus_peers.cc:597] T 7775ad91c86840c49a902b059a0ff74d P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7775ad91c86840c49a902b059a0ff74d. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:32.024892 26912 raft_consensus.cc:359] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.062844 26912 raft_consensus.cc:385] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.063223 26912 raft_consensus.cc:740] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.064098 26912 consensus_queue.cc:260] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.065721 26912 ts_tablet_manager.cc:1480] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
W20260928 20:03:32.072219 26594 leader_election.cc:343] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.109162 26913 tablet_bootstrap.cc:654] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:32.126335 26594 leader_election.cc:304] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:32.128186 29405 raft_consensus.cc:2804] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:32.128754 29405 raft_consensus.cc:697] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:32.129675 29405 consensus_queue.cc:237] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.146543 29171 consensus_queue.cc:1048] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:32.148494 26913 tablet_bootstrap.cc:492] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:32.150049 26913 ts_tablet_manager.cc:1449] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.123s user 0.009s sys 0.001s
W20260928 20:03:32.155324 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 269181us
W20260928 20:03:32.156050 26450 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.156455 26450 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.177552 26913 raft_consensus.cc:359] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:32.178821 26450 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.186426 26913 raft_consensus.cc:385] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.187217 26913 raft_consensus.cc:740] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.188298 26913 consensus_queue.cc:260] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.195854 29583 raft_consensus.cc:2749] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:32.202865 29589 log.cc:927] Time spent T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260928 20:03:32.201393 26913 ts_tablet_manager.cc:1480] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260928 20:03:32.207648 26913 tablet_bootstrap.cc:492] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:32.179278 26450 leader_election.cc:304] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.222924 29583 raft_consensus.cc:2749] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:32.223073 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44284.1us
W20260928 20:03:32.215032 26594 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.235512 26594 leader_election.cc:304] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:32.236344 29513 raft_consensus.cc:2804] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:32.236739 29513 raft_consensus.cc:493] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:32.237106 29513 raft_consensus.cc:3060] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.249107 26913 tablet_bootstrap.cc:654] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:32.254863 26450 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.270231 26450 leader_election.cc:304] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.271045 29583 raft_consensus.cc:2749] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:32.272553 26450 leader_election.cc:343] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.273175 26450 leader_election.cc:304] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.274223 26450 leader_election.cc:304] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.281759 26913 tablet_bootstrap.cc:492] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:32.287346 26912 tablet_bootstrap.cc:492] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:32.280200 26916 tablet_bootstrap.cc:492] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:32.301419 26916 ts_tablet_manager.cc:1449] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.301s user 0.008s sys 0.008s
I20260928 20:03:32.290288 29583 raft_consensus.cc:2749] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:32.304960 26913 ts_tablet_manager.cc:1449] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.097s user 0.010s sys 0.000s
I20260928 20:03:32.304751 26916 raft_consensus.cc:359] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.305493 26916 raft_consensus.cc:385] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.305795 26916 raft_consensus.cc:740] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.306663 26916 consensus_queue.cc:260] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.307613 26913 raft_consensus.cc:359] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.308298 26916 ts_tablet_manager.cc:1480] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260928 20:03:32.308300 26913 raft_consensus.cc:385] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.308574 26913 raft_consensus.cc:740] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.309324 29584 raft_consensus.cc:2804] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:32.309523 26912 tablet_bootstrap.cc:654] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:32.309177 26913 consensus_queue.cc:260] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.309674 29584 raft_consensus.cc:493] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:32.310003 29584 raft_consensus.cc:3060] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:32.318451 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44286.3us
W20260928 20:03:32.319641 26450 leader_election.cc:343] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.320183 26450 leader_election.cc:304] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.321077 29583 raft_consensus.cc:2749] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:32.321403 26450 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.344426 29382 raft_consensus.cc:2243] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:32.345333 29382 raft_consensus.cc:2272] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:32.347436 29382 ts_tablet_manager.cc:1962] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:32.358285 26450 leader_election.cc:304] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.321892 29584 raft_consensus.cc:515] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:32.360000 26450 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.362166 26450 leader_election.cc:304] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.383831 29513 raft_consensus.cc:515] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:32.405732 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 45748.2us
I20260928 20:03:32.406884 26450 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.411659 26450 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:32.412714 26450 leader_election.cc:343] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.413115 26450 leader_election.cc:304] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.398237 29574 raft_consensus.cc:2749] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:32.414579 29494 raft_consensus.cc:2804] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:32.414920 29494 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:32.398681 29584 leader_election.cc:290] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.415232 29494 raft_consensus.cc:3060] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.410123 29376 raft_consensus.cc:2749] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:32.416882 29575 raft_consensus.cc:2804] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:32.417222 29575 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:32.417513 29575 raft_consensus.cc:3060] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.425818 29376 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.426499 29376 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.428627 29376 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.440201 29494 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.441234 29376 raft_consensus.cc:2749] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:32.442049 26450 leader_election.cc:343] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.445503 29584 raft_consensus.cc:493] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.447389 29584 raft_consensus.cc:515] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.449168 29584 leader_election.cc:290] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.449791 26450 leader_election.cc:304] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.435060 29575 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.452035 29575 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.392195 29598 raft_consensus.cc:493] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.458487 29598 raft_consensus.cc:515] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.396588 29171 raft_consensus.cc:493] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.444156 26913 ts_tablet_manager.cc:1480] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.139s user 0.009s sys 0.000s
I20260928 20:03:32.462285 29171 raft_consensus.cc:515] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.462998 26913 tablet_bootstrap.cc:492] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:32.464047 29171 leader_election.cc:290] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.464560 29598 leader_election.cc:290] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.458400 29584 raft_consensus.cc:2749] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:32.460770 26450 leader_election.cc:343] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.481163 26450 leader_election.cc:304] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.481966 29584 raft_consensus.cc:2749] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:32.441663 26912 tablet_bootstrap.cc:492] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:32.487126 26912 ts_tablet_manager.cc:1449] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.200s user 0.006s sys 0.004s
I20260928 20:03:32.462829 29494 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:32.483481 26450 leader_election.cc:343] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.496209 26450 leader_election.cc:304] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:32.498847 26450 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:32.501147 26450 leader_election.cc:304] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:32.493602 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.494715 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.506795 29575 raft_consensus.cc:2749] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:32.499280 29494 raft_consensus.cc:2749] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:32.514351 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.517504 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.503680 29513 leader_election.cc:290] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.507074 29598 consensus_queue.cc:1048] T 3b0694e341d64cdea99bb462beb1150b P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:32.518750 26801 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.522419 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.523149 26916 tablet_bootstrap.cc:492] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:32.515127 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13a571f3bd34209b0e6fd9441055eb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.516654 29171 raft_consensus.cc:493] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:32.516799 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.526539 29171 raft_consensus.cc:515] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.528353 29171 leader_election.cc:290] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.495951 26786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:32.529906 26786 raft_consensus.cc:3060] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.530732 26916 tablet_bootstrap.cc:654] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:32.531596 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.532948 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.534029 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.535166 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.535686 26652 raft_consensus.cc:2468] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:32.537355 29494 raft_consensus.cc:493] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.537931 29494 raft_consensus.cc:515] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:32.540117 29494 leader_election.cc:290] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.540642 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a658eaaedb4432a4dc2e1f5df6cc58" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.541668 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:32.545903 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48083.6us
I20260928 20:03:32.546434 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.548156 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.549280 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.552378 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.554394 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.558866 29494 raft_consensus.cc:493] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.560873 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.561887 29575 raft_consensus.cc:493] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.562091 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.562341 29575 raft_consensus.cc:515] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.564334 29575 leader_election.cc:290] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.561105 29494 raft_consensus.cc:515] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.571560 29494 leader_election.cc:290] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:32.497584 26739 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 1dde3191a52b4254944ae1f8556e1632
I20260928 20:03:32.572217 26739 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:32.574489 26916 tablet_bootstrap.cc:492] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:32.571899 26913 tablet_bootstrap.cc:654] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:32.574916 26916 ts_tablet_manager.cc:1449] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.006s
I20260928 20:03:32.579272 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.580422 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:32.580999 26649 raft_consensus.cc:3060] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.582484 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a658eaaedb4432a4dc2e1f5df6cc58" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.584604 29575 raft_consensus.cc:493] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.585232 29575 raft_consensus.cc:515] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.586586 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.587661 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9b3e02fb541cab6d0d3c46743ff9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.588124 29575 leader_election.cc:290] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:32.588506 26740 consensus_peers.cc:597] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f. This is attempt 11: this message will repeat every 5th retry.
I20260928 20:03:32.588567 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:32.588680 29575 raft_consensus.cc:493] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.589144 26655 raft_consensus.cc:2393] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:32.589227 29382 ts_tablet_manager.cc:1975] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:32.589051 29575 raft_consensus.cc:515] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.589561 29382 log.cc:1199] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:32.589814 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:32.590337 26648 raft_consensus.cc:3060] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.590427 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.591737 29575 leader_election.cc:290] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.592125 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534674440ee649e4afbc87b3cce5c43e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.592057 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.593428 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25512bb19e3c4f78bb917378b10021e5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.594360 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756342f2b9a245c89ad8dbc6089b71d7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.594655 29584 raft_consensus.cc:493] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.595207 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6393d0583a9a47ec9eb455b30a548fc3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.595288 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03509d3602b345f69f059ae11c461920" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.595108 29584 raft_consensus.cc:515] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.596200 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:32.597538 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de132c03884597a311898f4d427bb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.597656 29584 leader_election.cc:290] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.598186 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:32.598093 29584 raft_consensus.cc:493] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.598681 26658 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.598872 29584 raft_consensus.cc:515] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.601565 29584 leader_election.cc:290] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.602083 29584 raft_consensus.cc:493] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.602530 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:32.602481 29584 raft_consensus.cc:515] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.604202 29584 leader_election.cc:290] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.604830 26649 raft_consensus.cc:2468] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:32.609112 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.611598 29376 raft_consensus.cc:493] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.612020 29376 raft_consensus.cc:515] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.619220 29583 raft_consensus.cc:493] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.608438 26648 raft_consensus.cc:2468] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:32.619673 29583 raft_consensus.cc:515] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.621685 29583 leader_election.cc:290] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.621585 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:32.614022 29376 leader_election.cc:290] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.631402 26912 raft_consensus.cc:359] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.632105 26912 raft_consensus.cc:385] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.632372 26912 raft_consensus.cc:740] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.633014 26912 consensus_queue.cc:260] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.636924 26786 raft_consensus.cc:2468] T c49aa062e7674a47ac68fdadf68980b8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:32.638267 29171 raft_consensus.cc:493] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:32.644906 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 147339us
I20260928 20:03:32.638753 29171 raft_consensus.cc:515] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.647084 29600 raft_consensus.cc:2749] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:32.650132 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:32.650815 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.652431 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9b3e02fb541cab6d0d3c46743ff9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.653285 26788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.654546 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13a571f3bd34209b0e6fd9441055eb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:32.659912 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:32.659987 29376 raft_consensus.cc:493] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.660501 29376 raft_consensus.cc:515] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:32.662528 29376 leader_election.cc:290] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:32.663638 29376 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.662961 29583 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.664255 29583 raft_consensus.cc:515] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.666754 29583 leader_election.cc:290] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.667300 29376 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.669087 29376 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.674216 29494 raft_consensus.cc:493] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.676199 29494 raft_consensus.cc:515] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.686779 26912 ts_tablet_manager.cc:1480] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.184s user 0.005s sys 0.001s
I20260928 20:03:32.688546 26912 tablet_bootstrap.cc:492] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:32.674746 29584 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.693316 29584 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.696687 29584 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:32.762401 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 52783.3us
W20260928 20:03:32.770181 26739 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:32.621901 26658 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:32.787894 26739 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:32.791522 29171 leader_election.cc:290] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.637667 29382 ts_tablet_manager.cc:1996] T 78d5de4a82bd41c1a8b2af2ba7417c46 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:32.814384 29594 raft_consensus.cc:2749] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:32.643406 26916 raft_consensus.cc:359] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:32.843541 26916 raft_consensus.cc:385] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:32.843895 26916 raft_consensus.cc:740] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:32.706264 29376 raft_consensus.cc:493] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.706501 29583 raft_consensus.cc:493] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.707999 29494 leader_election.cc:290] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.710018 29574 raft_consensus.cc:493] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.849957 29574 raft_consensus.cc:515] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.852555 29574 leader_election.cc:290] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.736900 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:32.853677 26512 raft_consensus.cc:2393] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:32.845775 29583 raft_consensus.cc:515] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.856369 29583 leader_election.cc:290] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:32.846324 29376 raft_consensus.cc:515] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.864292 29376 leader_election.cc:290] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.847987 26916 consensus_queue.cc:260] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:32.865964 26916 ts_tablet_manager.cc:1480] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.291s user 0.007s sys 0.000s
I20260928 20:03:32.866878 26916 tablet_bootstrap.cc:492] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:32.894472 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:32.895071 26511 raft_consensus.cc:3060] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:32.898584 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 53837.3us
I20260928 20:03:32.776851 26912 tablet_bootstrap.cc:654] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:32.799646 29513 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
W20260928 20:03:32.914711 26740 consensus_peers.cc:597] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c. This is attempt 11: this message will repeat every 5th retry.
I20260928 20:03:32.919051 29513 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.923112 29513 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.935169 29600 raft_consensus.cc:493] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:32.935642 29600 raft_consensus.cc:515] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.939132 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:32.940733 26508 raft_consensus.cc:3060] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.945252 29494 raft_consensus.cc:493] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.948179 29494 raft_consensus.cc:515] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:32.950163 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:32.946988 29600 leader_election.cc:290] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:32.949335 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:32.962810 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:32.963500 26506 raft_consensus.cc:3060] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:32.970500 29584 raft_consensus.cc:493] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.970940 29584 raft_consensus.cc:515] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:32.943409 29620 raft_consensus.cc:493] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:32.977697 29584 leader_election.cc:290] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:32.979125 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:32.979333 29494 leader_election.cc:290] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:32.950783 26498 raft_consensus.cc:2468] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:32.979892 26916 tablet_bootstrap.cc:654] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:32.980805 26511 raft_consensus.cc:2468] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:32.981415 26508 raft_consensus.cc:2468] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:32.983363 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:32.985803 26504 raft_consensus.cc:2393] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:32.989041 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:32.961419 26509 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:33.004057 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.004640 26498 raft_consensus.cc:2468] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:32.985105 29620 raft_consensus.cc:515] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:33.014648 26506 raft_consensus.cc:2468] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:33.019847 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:33.022792 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 49182.1us
I20260928 20:03:33.028031 29620 leader_election.cc:290] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.068747 26912 tablet_bootstrap.cc:492] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:33.081957 26912 ts_tablet_manager.cc:1449] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.394s user 0.000s sys 0.015s
I20260928 20:03:33.078091 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 6) took 5544 ms. Trace:
I20260928 20:03:33.086339 29382 rpcz_store.cc:276] 0928 20:03:27.533665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.562315 (+ 28650us) service_pool.cc:224] Handling call
0928 20:03:31.978272 (+4415957us) ts_tablet_manager.cc:1197] Deleting tablet 78d5de4a82bd41c1a8b2af2ba7417c46
0928 20:03:31.978313 (+ 41us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:32.377029 (+398716us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:32.589108 (+212079us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:33.078019 (+488911us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365239,"tablet-delete.queue_time_us":4415283}
I20260928 20:03:33.088286 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 78d5de4a82bd41c1a8b2af2ba7417c46 (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]) successfully deleted
I20260928 20:03:33.089560 29382 tablet_replica.cc:333] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:33.090626 29382 raft_consensus.cc:2243] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:33.091619 29382 raft_consensus.cc:2272] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:33.109854 29600 raft_consensus.cc:493] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.110342 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762cb728cc574a36a68fbe9033544b04" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:33.111691 26506 raft_consensus.cc:3060] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:33.113920 29382 ts_tablet_manager.cc:1962] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:33.125483 26912 raft_consensus.cc:359] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.133610 26912 raft_consensus.cc:385] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.133924 26912 raft_consensus.cc:740] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.138577 26912 consensus_queue.cc:260] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.110702 29600 raft_consensus.cc:515] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:33.154712 26912 ts_tablet_manager.cc:1480] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.071s user 0.009s sys 0.000s
I20260928 20:03:33.172467 29600 leader_election.cc:290] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:33.230769 29597 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.231266 29597 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.233422 29597 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:33.271250 26913 tablet_bootstrap.cc:492] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:33.272106 26913 ts_tablet_manager.cc:1449] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.809s user 0.010s sys 0.011s
I20260928 20:03:33.285333 26913 raft_consensus.cc:359] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.307121 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:33.310066 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:33.113997 29620 raft_consensus.cc:493] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:33.114629 29584 raft_consensus.cc:493] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.114259 29494 raft_consensus.cc:493] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:33.340821 29583 raft_consensus.cc:493] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.351011 29583 raft_consensus.cc:515] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.343611 29620 raft_consensus.cc:515] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.358811 29618 raft_consensus.cc:493] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.331575 29376 raft_consensus.cc:493] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.365535 26515 raft_consensus.cc:1275] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 20:03:33.365859 26515 pending_rounds.cc:85] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: Aborting all ops after (but not including) 0
I20260928 20:03:33.366062 26515 pending_rounds.cc:107] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 20:03:33.366333 26515 raft_consensus.cc:2889] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 20:03:33.368342 26506 raft_consensus.cc:2468] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:33.286792 26913 raft_consensus.cc:385] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.348958 29633 tablet.cc:1751] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:33.370564 26913 raft_consensus.cc:740] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.372151 26913 consensus_queue.cc:260] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.359545 29618 raft_consensus.cc:515] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:33.377403 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 111631us
I20260928 20:03:33.371595 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.379076 26516 raft_consensus.cc:2468] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:33.372871 29620 leader_election.cc:290] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.374969 29376 raft_consensus.cc:515] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.371635 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.389925 26510 raft_consensus.cc:2393] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:33.373692 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.391767 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.393018 26502 raft_consensus.cc:2393] T b3ee867b0443431ba816ee5309888080 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:33.394840 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.395505 26515 raft_consensus.cc:2468] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:33.386921 29376 leader_election.cc:290] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.390727 26506 raft_consensus.cc:2468] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:33.402927 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.403520 26512 raft_consensus.cc:2468] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:33.409667 26916 tablet_bootstrap.cc:492] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:33.410143 26916 ts_tablet_manager.cc:1449] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.543s user 0.020s sys 0.016s
I20260928 20:03:33.370087 29494 raft_consensus.cc:515] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.381901 29575 raft_consensus.cc:493] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.341782 29584 raft_consensus.cc:515] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.426573 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:33.434242 29400 raft_consensus.cc:493] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:33.435060 29400 raft_consensus.cc:515] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.439218 29400 leader_election.cc:290] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:33.444875 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:33.445439 29494 leader_election.cc:290] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.445798 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]). Expected version 1 got 0
I20260928 20:03:33.447178 29575 raft_consensus.cc:515] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:33.448571 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:33.451004 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:33.454964 26916 raft_consensus.cc:359] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.455716 26916 raft_consensus.cc:385] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.456007 26916 raft_consensus.cc:740] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.457304 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:33.457861 26506 raft_consensus.cc:3060] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:33.461404 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:33.405158 26509 raft_consensus.cc:2468] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:33.466512 29584 leader_election.cc:290] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.467470 29583 leader_election.cc:290] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.468650 26916 consensus_queue.cc:260] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:33.470749 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 92132.3us
I20260928 20:03:33.470772 29618 leader_election.cc:290] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.471140 26913 ts_tablet_manager.cc:1480] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.199s user 0.003s sys 0.006s
I20260928 20:03:33.472731 26913 tablet_bootstrap.cc:492] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:33.475584 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:33.476358 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:33.478428 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:33.479658 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:33.480242 26503 raft_consensus.cc:2468] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:33.482636 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.485600 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ef26307b9a459f8634d59b1ca373ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.486370 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:33.488490 26737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:33.488616 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87718f040f0d4b9d88a551cae4f0d47f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.490716 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.491463 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.491947 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea01d2ddd91d4a0fa29afaebfbd83528" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.492846 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 3ed3cd78c90c42f6a99a92bae2cd5491 (table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]). Expected version 2 got 0
I20260928 20:03:33.494688 26498 raft_consensus.cc:1275] T 762cb728cc574a36a68fbe9033544b04 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:33.496210 26916 ts_tablet_manager.cc:1480] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.086s user 0.005s sys 0.001s
I20260928 20:03:33.497151 26916 tablet_bootstrap.cc:492] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:33.497650 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]). Expected version 1 got 0
I20260928 20:03:33.500634 29575 leader_election.cc:290] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.508982 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f7c83a1c048688ea1f3227a88bb8f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.509194 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76c64607c9425fb5c837cb856c852c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.510416 26913 tablet_bootstrap.cc:654] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:33.521457 26594 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:33.498595 26159 catalog_manager.cc:5838] T 323a20314a734279a4af64e8b4f0ff0d P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
W20260928 20:03:33.522722 26594 leader_election.cc:343] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:33.524923 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.524976 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f7b05e756f4a4db5031ff1e14c6ff6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.525338 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.523350 26159 catalog_manager.cc:5838] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } }
I20260928 20:03:33.526382 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76c64607c9425fb5c837cb856c852c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.526477 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:33.526760 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.527988 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f7b05e756f4a4db5031ff1e14c6ff6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.534412 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.534874 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.539351 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:33.540371 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.540963 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:33.544263 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775ad91c86840c49a902b059a0ff74d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.545872 26506 raft_consensus.cc:2468] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:33.547703 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f943cd32849f399347f3d9d5b5c18" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.549233 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4d7f4ee1a4e77aaf5190a550c56a8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.550473 26912 tablet_bootstrap.cc:492] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:33.551146 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.551708 26790 raft_consensus.cc:2468] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 2.
I20260928 20:03:33.548846 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.554557 26594 leader_election.cc:304] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:33.555218 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:33.556156 29608 raft_consensus.cc:2804] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:33.556618 29608 raft_consensus.cc:697] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:33.556927 26912 tablet_bootstrap.cc:654] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.557330 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:33.558075 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:33.557627 29608 consensus_queue.cc:237] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.561457 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:33.562682 29598 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.562839 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.563154 29598 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.564769 26159 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:33.565193 29598 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:33.580746 26913 tablet_bootstrap.cc:492] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:33.581137 26916 tablet_bootstrap.cc:654] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.581213 26913 ts_tablet_manager.cc:1449] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.008s
I20260928 20:03:33.582613 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2239c466fa8e471e820173c67bc04cad" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:33.584544 26740 consensus_peers.cc:597] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8. This is attempt 11: this message will repeat every 5th retry.
W20260928 20:03:33.585110 26740 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211
I20260928 20:03:33.589690 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.594969 26913 raft_consensus.cc:359] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.601517 26913 raft_consensus.cc:385] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.606930 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.601794 26913 raft_consensus.cc:740] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.611047 26913 consensus_queue.cc:260] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.618877 26916 tablet_bootstrap.cc:492] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:33.619797 26916 ts_tablet_manager.cc:1449] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.123s user 0.007s sys 0.004s
I20260928 20:03:33.632257 26916 raft_consensus.cc:359] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.633383 26916 raft_consensus.cc:385] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.633893 26916 raft_consensus.cc:740] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.639182 29513 raft_consensus.cc:493] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.639715 26913 ts_tablet_manager.cc:1480] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.058s user 0.001s sys 0.006s
I20260928 20:03:33.639689 29513 raft_consensus.cc:515] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.640220 26916 consensus_queue.cc:260] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.641821 29513 leader_election.cc:290] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:33.646616 26916 ts_tablet_manager.cc:1480] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260928 20:03:33.646842 29575 raft_consensus.cc:493] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.647560 26916 tablet_bootstrap.cc:492] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:33.647269 29575 raft_consensus.cc:515] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.649053 29575 leader_election.cc:290] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:33.652400 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.653898 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.667268 26916 tablet_bootstrap.cc:654] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.690908 26913 tablet_bootstrap.cc:492] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:33.692585 26912 tablet_bootstrap.cc:492] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:33.699939 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b15d2c55d94e64b75da8089a68b6e1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.705817 26912 ts_tablet_manager.cc:1449] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.156s user 0.008s sys 0.003s
I20260928 20:03:33.706588 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311f004a7acc4d43b4b88564b57efa74" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.708523 26912 raft_consensus.cc:359] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.709136 26912 raft_consensus.cc:385] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.709403 26912 raft_consensus.cc:740] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.709571 26913 tablet_bootstrap.cc:654] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.712275 26916 tablet_bootstrap.cc:492] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:33.712752 26916 ts_tablet_manager.cc:1449] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.000s
I20260928 20:03:33.715451 26916 raft_consensus.cc:359] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.716183 26916 raft_consensus.cc:385] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.716455 26916 raft_consensus.cc:740] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.717129 26916 consensus_queue.cc:260] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.721473 26912 consensus_queue.cc:260] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.725760 26912 ts_tablet_manager.cc:1480] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260928 20:03:33.729795 26912 tablet_bootstrap.cc:492] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:33.733230 26916 ts_tablet_manager.cc:1480] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.020s user 0.008s sys 0.000s
I20260928 20:03:33.737576 26916 tablet_bootstrap.cc:492] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:33.754071 26916 tablet_bootstrap.cc:654] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.762039 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:33.765054 26223 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b2e2b9af466b474bb4bda5d4b246aa45 (table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet b2e2b9af466b474bb4bda5d4b246aa45 consensus state has no leader
I20260928 20:03:33.765288 26912 tablet_bootstrap.cc:654] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.777665 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.778587 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cb34c5e33544c9875e7babf4830164" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:33.782371 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 196696us
I20260928 20:03:33.786811 29382 ts_tablet_manager.cc:1975] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:33.794165 29382 log.cc:1199] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/626a876a51d04095b5dd54726bb995f3
I20260928 20:03:33.799436 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e2de7890874892be6ae5a2008d8a12" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.801039 29382 ts_tablet_manager.cc:1996] T 626a876a51d04095b5dd54726bb995f3 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:33.805907 26595 leader_election.cc:304] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:33.808151 26595 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:33.808552 26595 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:33.809372 29651 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.809854 29651 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.810649 29645 raft_consensus.cc:2749] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:33.812273 29651 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:33.813048 29648 raft_consensus.cc:2749] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:33.815685 26916 tablet_bootstrap.cc:492] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:33.816097 26916 ts_tablet_manager.cc:1449] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.010s
I20260928 20:03:33.818511 26916 raft_consensus.cc:359] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.819819 29650 consensus_queue.cc:1048] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:33.820156 26916 raft_consensus.cc:385] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.821352 26916 raft_consensus.cc:740] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.821924 26916 consensus_queue.cc:260] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.823413 26916 ts_tablet_manager.cc:1480] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260928 20:03:33.824268 26916 tablet_bootstrap.cc:492] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:33.831161 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:33.833604 26912 tablet_bootstrap.cc:492] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:33.834051 26912 ts_tablet_manager.cc:1449] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.002s
I20260928 20:03:33.839666 26793 raft_consensus.cc:1275] T 762cb728cc574a36a68fbe9033544b04 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:33.844741 26916 tablet_bootstrap.cc:654] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.852018 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 7) took 6273 ms. Trace:
I20260928 20:03:33.851528 26160 catalog_manager.cc:5838] T 7e78ac2ae0124b7b859a79bd9f1c203a P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:33.852378 29382 rpcz_store.cc:276] 0928 20:03:27.578510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.578606 (+ 96us) service_pool.cc:224] Handling call
0928 20:03:33.089376 (+5510770us) ts_tablet_manager.cc:1197] Deleting tablet 626a876a51d04095b5dd54726bb995f3
0928 20:03:33.089425 (+ 49us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:33.420921 (+331496us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:33.786654 (+365733us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:33.851938 (+ 65284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25469,"tablet-delete.queue_time_us":5510162}
I20260928 20:03:33.853871 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 626a876a51d04095b5dd54726bb995f3 (table default.Table_487262bf721f4183a8850da9cac26908 [id=285085385d554cffa937cbcaa74294a1]) successfully deleted
I20260928 20:03:33.855557 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:33.858619 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:33.860837 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:33.861646 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:33.863379 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:33.864457 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.864483 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.871441 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309f8fcc50e545178888846ac90afcf2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.872206 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]). Expected version 1 got 0
I20260928 20:03:33.886196 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:33.879421 26916 tablet_bootstrap.cc:492] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:33.888067 26916 ts_tablet_manager.cc:1449] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.064s user 0.011s sys 0.000s
I20260928 20:03:33.888670 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.895198 26916 raft_consensus.cc:359] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.895849 26916 raft_consensus.cc:385] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.896111 26916 raft_consensus.cc:740] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.896626 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.896682 26916 consensus_queue.cc:260] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.899438 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:33.902915 26916 ts_tablet_manager.cc:1480] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260928 20:03:33.904325 26916 tablet_bootstrap.cc:492] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:33.910728 26912 raft_consensus.cc:359] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.911394 26912 raft_consensus.cc:385] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.919202 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ed5998a6194061839143c4adf4d3d4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.923413 26595 leader_election.cc:304] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:33.927099 26916 tablet_bootstrap.cc:654] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:33.927219 26913 tablet_bootstrap.cc:492] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:33.927675 26913 ts_tablet_manager.cc:1449] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.287s user 0.006s sys 0.015s
I20260928 20:03:33.900792 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:33.911639 26912 raft_consensus.cc:740] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.940659 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:33.942581 26916 tablet_bootstrap.cc:492] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:33.943060 26916 ts_tablet_manager.cc:1449] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.004s
I20260928 20:03:33.946939 29653 raft_consensus.cc:2804] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:33.947829 29653 raft_consensus.cc:697] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:33.948601 26916 raft_consensus.cc:359] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.948740 29653 consensus_queue.cc:237] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:33.951079 29668 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:33.951694 26916 raft_consensus.cc:385] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:33.952078 26916 raft_consensus.cc:740] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:33.939468 26912 consensus_queue.cc:260] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.963852 26160 catalog_manager.cc:5838] T a0133314d6de46cea61a9260df79bdea P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:33.965377 26916 consensus_queue.cc:260] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:33.967556 26916 ts_tablet_manager.cc:1480] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260928 20:03:33.966282 29668 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:03:33.970429 26740 consensus_peers.cc:597] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375. This is attempt 11: this message will repeat every 5th retry.
I20260928 20:03:33.973822 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:33.973580 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:33.976118 26916 tablet_bootstrap.cc:492] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:33.977305 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:33.983525 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]). Expected version 1 got 0
I20260928 20:03:33.985517 26912 ts_tablet_manager.cc:1480] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.151s user 0.005s sys 0.000s
I20260928 20:03:33.980883 29668 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:33.988637 29668 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:33.988636 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:33.994717 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:33.996753 26916 tablet_bootstrap.cc:654] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:33.998185 26740 consensus_peers.cc:597] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 -> Peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Couldn't send request to peer 9b44798af33f4733ba9cde0a1b541f54. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1. This is attempt 6: this message will repeat every 5th retry.
I20260928 20:03:33.988390 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:34.003611 26160 catalog_manager.cc:5838] T 6393d0583a9a47ec9eb455b30a548fc3 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:34.019914 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:34.022397 26916 tablet_bootstrap.cc:492] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:34.022835 26916 ts_tablet_manager.cc:1449] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.001s
W20260928 20:03:34.024384 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 101106us
I20260928 20:03:34.025147 26916 raft_consensus.cc:359] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.025450 26595 leader_election.cc:304] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.025784 26916 raft_consensus.cc:385] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.026026 26916 raft_consensus.cc:740] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.026633 26916 consensus_queue.cc:260] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.029862 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:34.032011 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.032712 26659 raft_consensus.cc:2393] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:34.028117 26916 ts_tablet_manager.cc:1480] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 20:03:34.034909 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ee867b0443431ba816ee5309888080" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.035135 26916 tablet_bootstrap.cc:492] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:34.034250 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:34.035624 26648 raft_consensus.cc:2393] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:34.036500 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.037182 26657 raft_consensus.cc:2393] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:34.036878 26160 catalog_manager.cc:5838] T c1cb96cab3e647908f3e99981e7147c7 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:34.039211 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:34.041786 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3021bc9be24874a6ebee01dfb6d7fa" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.050333 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.052752 26916 tablet_bootstrap.cc:654] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.053658 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323a20314a734279a4af64e8b4f0ff0d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.053808 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:34.054807 29645 raft_consensus.cc:2804] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:34.054879 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:34.056120 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:34.056779 29645 raft_consensus.cc:697] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:34.057823 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:34.057605 29645 consensus_queue.cc:237] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.060133 26160 catalog_manager.cc:5838] T a6ce8cfd201343029b487dd6581bfb0a P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:34.063055 26160 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:34.071602 26913 raft_consensus.cc:359] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.072394 26913 raft_consensus.cc:385] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:03:34.085161 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 59790us
W20260928 20:03:34.086342 26595 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
I20260928 20:03:34.086817 26595 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:34.092692 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 89664.9us
I20260928 20:03:34.097570 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.097848 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc58b27db848454196f75b9077a203cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.100327 29645 raft_consensus.cc:2749] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.102993 26595 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.103708 29382 tablet_replica.cc:333] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:34.104864 29382 raft_consensus.cc:2243] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:34.108983 29382 raft_consensus.cc:2272] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:34.111626 29382 ts_tablet_manager.cc:1962] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:34.121151 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.110234 29645 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:34.120467 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f6c6d4a0a4aada3a17d16c63d3b25" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.072664 26913 raft_consensus.cc:740] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.154395 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.176393 26912 tablet_bootstrap.cc:492] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:34.183637 26916 tablet_bootstrap.cc:492] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:34.184207 26916 ts_tablet_manager.cc:1449] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.149s user 0.024s sys 0.036s
I20260928 20:03:34.186838 26916 raft_consensus.cc:359] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.195175 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.205673 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7053ca61ed6e4f6dbf1f5adb54728792" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:34.218408 26912 tablet_bootstrap.cc:654] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.191110 29575 raft_consensus.cc:493] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.219884 29575 raft_consensus.cc:515] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.222007 29575 leader_election.cc:290] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.222736 26916 raft_consensus.cc:385] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.228025 26916 raft_consensus.cc:740] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.228996 26916 consensus_queue.cc:260] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:34.124759 26594 leader_election.cc:343] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: d13562e920244194969520df564a949d
W20260928 20:03:34.233063 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 108339us
W20260928 20:03:34.236114 26594 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.188414 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f21c71dc0e41aba85bb01c9fddc12d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.198756 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.194439 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.194940 29645 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.243255 29645 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.199474 29653 raft_consensus.cc:2749] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.211944 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7053ca61ed6e4f6dbf1f5adb54728792" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:34.195297 26913 consensus_queue.cc:260] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.246352 26913 ts_tablet_manager.cc:1480] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.318s user 0.005s sys 0.003s
I20260928 20:03:34.247354 26913 tablet_bootstrap.cc:492] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:34.124478 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
W20260928 20:03:34.218456 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 115543us
I20260928 20:03:34.251364 26595 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.254093 29650 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.260161 26912 tablet_bootstrap.cc:492] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:34.260582 26912 ts_tablet_manager.cc:1449] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.006s
I20260928 20:03:34.262476 26595 leader_election.cc:304] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.263242 26912 raft_consensus.cc:359] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.263895 26912 raft_consensus.cc:385] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.264146 26912 raft_consensus.cc:740] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.264567 26913 tablet_bootstrap.cc:654] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.264739 26912 consensus_queue.cc:260] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.264961 29650 raft_consensus.cc:2804] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:34.265978 29645 consensus_queue.cc:1048] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:34.266666 29650 raft_consensus.cc:493] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:34.267019 29650 raft_consensus.cc:3060] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:34.270738 26912 ts_tablet_manager.cc:1480] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20260928 20:03:34.275336 29650 raft_consensus.cc:515] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.281836 29584 raft_consensus.cc:493] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:34.282012 26450 leader_election.cc:343] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.282618 26450 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.266188 26595 leader_election.cc:304] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:34.283192 26450 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.283767 26916 ts_tablet_manager.cc:1480] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.099s user 0.005s sys 0.000s
I20260928 20:03:34.284693 26916 tablet_bootstrap.cc:492] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:34.284672 26595 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.285518 29639 raft_consensus.cc:2804] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:34.285959 29639 raft_consensus.cc:697] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:34.286764 29639 consensus_queue.cc:237] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:34.287577 29645 raft_consensus.cc:2749] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.282362 29584 raft_consensus.cc:515] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.292450 29584 leader_election.cc:290] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.303712 26913 tablet_bootstrap.cc:492] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:34.304440 26913 ts_tablet_manager.cc:1449] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.000s
I20260928 20:03:34.310575 26916 tablet_bootstrap.cc:654] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:34.313009 26594 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:03:34.319640 29171 consensus_queue.cc:1048] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:34.321201 26594 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.323035 26594 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.327651 26912 tablet_bootstrap.cc:492] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:34.331038 29651 consensus_queue.cc:1048] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:34.333096 29650 leader_election.cc:290] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.333361 26912 tablet_bootstrap.cc:654] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.334317 29677 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.334967 29677 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.336807 29677 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.335848 26913 raft_consensus.cc:359] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.337666 26913 raft_consensus.cc:385] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.336373 26595 leader_election.cc:304] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.339293 26595 leader_election.cc:304] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:34.344602 26739 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:34.339819 29650 raft_consensus.cc:2804] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:34.345309 29650 raft_consensus.cc:493] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:34.345774 29650 raft_consensus.cc:3060] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:34.338061 26913 raft_consensus.cc:740] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.348081 26913 consensus_queue.cc:260] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:34.350730 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 66695.6us
W20260928 20:03:34.351447 26450 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.351363 29651 raft_consensus.cc:2804] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:34.351933 29651 raft_consensus.cc:493] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 20:03:34.352048 26450 leader_election.cc:343] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.352228 29651 raft_consensus.cc:3060] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:34.352532 26450 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.360572 29651 raft_consensus.cc:515] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.362223 26595 leader_election.cc:304] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.363713 26913 ts_tablet_manager.cc:1480] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.059s user 0.003s sys 0.001s
I20260928 20:03:34.366780 29639 raft_consensus.cc:2804] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:34.367130 29639 raft_consensus.cc:493] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:34.367424 29639 raft_consensus.cc:3060] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:34.370009 26450 leader_election.cc:343] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.370580 29653 raft_consensus.cc:493] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:34.371062 26450 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.371011 29653 raft_consensus.cc:515] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:34.371686 26450 leader_election.cc:343] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.372816 29653 leader_election.cc:290] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.379061 29639 raft_consensus.cc:515] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:34.391356 26450 leader_election.cc:343] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.391992 26450 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.394860 29382 ts_tablet_manager.cc:1975] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:34.395337 29382 log.cc:1199] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/0a2d13d16d9946c6b09f9197c165033c
I20260928 20:03:34.396538 29382 ts_tablet_manager.cc:1996] T 0a2d13d16d9946c6b09f9197c165033c P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:34.388652 26913 tablet_bootstrap.cc:492] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:34.393774 26595 leader_election.cc:304] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.395576 29651 leader_election.cc:290] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.401983 29653 raft_consensus.cc:2804] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:34.402446 29653 raft_consensus.cc:493] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:34.402873 29653 raft_consensus.cc:3060] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:34.417403 29650 raft_consensus.cc:515] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.414706 29677 raft_consensus.cc:493] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.423269 29677 raft_consensus.cc:515] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.425235 29677 leader_election.cc:290] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.419173 29639 leader_election.cc:290] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.436462 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 8) took 6857 ms. Trace:
I20260928 20:03:34.437193 29650 leader_election.cc:290] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:34.438684 26450 leader_election.cc:343] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.439620 26450 leader_election.cc:343] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.440158 26450 leader_election.cc:343] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.447414 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:34.447754 29600 raft_consensus.cc:493] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.448246 29600 raft_consensus.cc:515] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.449174 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:34.450490 29600 leader_election.cc:290] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.409737 29653 raft_consensus.cc:515] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.447543 29382 rpcz_store.cc:276] 0928 20:03:27.579029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.579407 (+ 378us) service_pool.cc:224] Handling call
0928 20:03:33.909085 (+6329678us) ts_tablet_manager.cc:1197] Deleting tablet 0a2d13d16d9946c6b09f9197c165033c
0928 20:03:34.103567 (+194482us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:34.285432 (+181865us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:34.394698 (+109266us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:34.436390 (+ 41692us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3213,"tablet-delete.queue_time_us":6327634}
I20260928 20:03:34.452975 29653 leader_election.cc:290] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.431296 26913 tablet_bootstrap.cc:654] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.453807 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 0a2d13d16d9946c6b09f9197c165033c (table default.Table_0db7c57c88674a57b2c4faceaa98eb1e [id=17447ae0353e48e3b1fb75ff64ada358]) successfully deleted
I20260928 20:03:34.454679 29382 tablet_replica.cc:333] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:03:34.454820 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 54735.7us
I20260928 20:03:34.457525 26916 tablet_bootstrap.cc:492] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:34.458045 26916 ts_tablet_manager.cc:1449] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.174s user 0.010s sys 0.001s
I20260928 20:03:34.460893 26916 raft_consensus.cc:359] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.461578 26916 raft_consensus.cc:385] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.461949 26916 raft_consensus.cc:740] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.462694 26916 consensus_queue.cc:260] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.463765 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:34.467131 26916 ts_tablet_manager.cc:1480] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260928 20:03:34.467864 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:34.468485 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]). Expected version 1 got 0
I20260928 20:03:34.487957 29382 raft_consensus.cc:2243] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:34.489082 29382 raft_consensus.cc:2272] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:34.491430 29382 ts_tablet_manager.cc:1962] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:34.501731 26913 tablet_bootstrap.cc:492] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:34.510447 26913 ts_tablet_manager.cc:1449] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.122s user 0.006s sys 0.005s
I20260928 20:03:34.523711 26913 raft_consensus.cc:359] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.524392 26913 raft_consensus.cc:385] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.524655 26913 raft_consensus.cc:740] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.469240 26158 catalog_manager.cc:5838] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:34.537292 26913 consensus_queue.cc:260] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.539563 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:34.540518 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:34.541296 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:34.547876 26913 ts_tablet_manager.cc:1480] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260928 20:03:34.557217 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:34.557749 26913 tablet_bootstrap.cc:492] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:34.557946 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:34.558332 29171 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.558749 29171 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.560417 29171 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:34.473047 26450 leader_election.cc:343] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.569465 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 96436.6us
W20260928 20:03:34.570194 26450 leader_election.cc:343] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.522630 29584 raft_consensus.cc:493] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.561764 29575 raft_consensus.cc:493] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.570070 26158 catalog_manager.cc:5838] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193). New cstate: current_term: 1 leader_uuid: "9b44798af33f4733ba9cde0a1b541f54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: HEALTHY } } }
I20260928 20:03:34.571072 29584 raft_consensus.cc:515] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.572196 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:34.573555 29584 leader_election.cc:290] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.571383 29575 raft_consensus.cc:515] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.576174 29575 leader_election.cc:290] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:34.570792 26450 leader_election.cc:343] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.577226 26450 leader_election.cc:343] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.578282 26450 leader_election.cc:343] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 7775ad91c86840c49a902b059a0ff74d
I20260928 20:03:34.497257 26739 leader_election.cc:304] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:34.583297 29400 raft_consensus.cc:3060] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:34.583431 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 86247.8us
I20260928 20:03:34.584105 26739 leader_election.cc:304] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:34.584920 29679 raft_consensus.cc:3060] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:34.591192 26739 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:34.592227 29597 raft_consensus.cc:3060] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:34.593662 26913 tablet_bootstrap.cc:654] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.599382 26450 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:34.600145 29584 raft_consensus.cc:2804] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:03:34.600546 29584 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:34.600970 29584 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:34.603765 29679 raft_consensus.cc:2749] T b3ee867b0443431ba816ee5309888080 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.604758 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]). Expected version 1 got 0
I20260928 20:03:34.605518 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:34.609477 29400 raft_consensus.cc:2749] T 74f9252dd72c46b3acf84be7feb6a4f1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.540182 26912 tablet_bootstrap.cc:492] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:34.610391 26912 ts_tablet_manager.cc:1449] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.283s user 0.010s sys 0.001s
I20260928 20:03:34.611838 29597 raft_consensus.cc:2749] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.612885 26912 raft_consensus.cc:359] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.613513 26912 raft_consensus.cc:385] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.613811 26912 raft_consensus.cc:740] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:03:34.631526 26450 leader_election.cc:343] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.632251 26450 leader_election.cc:343] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:34.632853 26450 leader_election.cc:343] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.640476 26912 consensus_queue.cc:260] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.648492 26916 tablet_bootstrap.cc:492] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:34.658980 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:34.664371 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:34.664871 29584 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.665408 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:34.666883 29584 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:34.671365 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 78192.9us
W20260928 20:03:34.681402 26739 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211
I20260928 20:03:34.665910 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:34.683797 26739 leader_election.cc:304] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:34.684644 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:34.685436 29640 raft_consensus.cc:2749] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.648612 26912 ts_tablet_manager.cc:1480] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20260928 20:03:34.688627 26912 tablet_bootstrap.cc:492] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:34.715760 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:34.717415 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:34.718628 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cb96cab3e647908f3e99981e7147c7" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:34.721028 26594 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.724246 29645 raft_consensus.cc:493] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.724668 29645 raft_consensus.cc:515] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.726825 29645 leader_election.cc:290] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:34.729785 26913 tablet_bootstrap.cc:492] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:34.730283 26913 ts_tablet_manager.cc:1449] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.173s user 0.017s sys 0.003s
I20260928 20:03:34.731622 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:34.732187 26795 raft_consensus.cc:3060] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:34.733150 26913 raft_consensus.cc:359] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.733973 26913 raft_consensus.cc:385] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.734359 26913 raft_consensus.cc:740] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.748411 26795 raft_consensus.cc:2468] T d0f9b3c3b4c84b19b4325152899e6b26 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:34.675155 26450 leader_election.cc:343] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.751368 26450 leader_election.cc:304] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.766500 26158 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:34.770440 26913 consensus_queue.cc:260] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.772562 26913 ts_tablet_manager.cc:1480] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.042s user 0.004s sys 0.000s
I20260928 20:03:34.773423 26913 tablet_bootstrap.cc:492] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:34.782497 29575 raft_consensus.cc:2749] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:34.783473 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 108563us
W20260928 20:03:34.784454 26450 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.784909 26450 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.785629 29575 raft_consensus.cc:2749] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:34.786667 26450 leader_election.cc:343] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.787086 26450 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.787737 29575 raft_consensus.cc:2749] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:34.788686 26450 leader_election.cc:343] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.789127 26450 leader_election.cc:304] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.789927 29575 raft_consensus.cc:2749] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.790783 26912 tablet_bootstrap.cc:654] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:34.791100 26450 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.791487 26450 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.792207 29575 raft_consensus.cc:2749] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.800293 26916 tablet_bootstrap.cc:654] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:34.810420 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 79024.3us
I20260928 20:03:34.815301 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:34.817370 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:34.817629 26913 tablet_bootstrap.cc:654] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.818737 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:34.824021 26222 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d27a3bd58866482f80fae7afe0ad48d7 (table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d27a3bd58866482f80fae7afe0ad48d7 consensus state has no leader
I20260928 20:03:34.827176 26450 leader_election.cc:304] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.828054 29584 raft_consensus.cc:2804] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:34.828477 29584 raft_consensus.cc:493] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:34.828893 29584 raft_consensus.cc:3060] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:34.836470 26450 leader_election.cc:343] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.836966 26450 leader_election.cc:304] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.875187 29575 raft_consensus.cc:493] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:34.876284 29575 raft_consensus.cc:515] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.878331 29575 leader_election.cc:290] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.880122 29575 raft_consensus.cc:2749] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:34.881279 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44840.7us
I20260928 20:03:34.883637 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:34.916065 26450 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:34.916499 26450 leader_election.cc:304] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.917171 29677 raft_consensus.cc:2749] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:34.918371 26450 leader_election.cc:304] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.919034 29677 raft_consensus.cc:2749] T 756342f2b9a245c89ad8dbc6089b71d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.888921 26916 tablet_bootstrap.cc:492] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:34.920022 26916 ts_tablet_manager.cc:1449] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.272s user 0.012s sys 0.000s
I20260928 20:03:34.924041 29584 raft_consensus.cc:515] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.946980 26916 raft_consensus.cc:359] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.947798 26916 raft_consensus.cc:385] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.948083 26916 raft_consensus.cc:740] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.955054 26912 tablet_bootstrap.cc:492] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:34.955547 26912 ts_tablet_manager.cc:1449] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.267s user 0.011s sys 0.000s
I20260928 20:03:34.957295 26450 leader_election.cc:304] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.958021 29677 raft_consensus.cc:2749] T 03509d3602b345f69f059ae11c461920 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.958127 26912 raft_consensus.cc:359] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.960390 26450 leader_election.cc:304] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.961092 29677 raft_consensus.cc:2749] T e8de132c03884597a311898f4d427bb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.962327 26450 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.926014 29584 leader_election.cc:290] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:34.982884 26916 consensus_queue.cc:260] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.985239 29677 raft_consensus.cc:2749] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:34.986466 26913 tablet_bootstrap.cc:492] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:34.986868 26913 ts_tablet_manager.cc:1449] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.214s user 0.021s sys 0.031s
I20260928 20:03:34.987021 26916 ts_tablet_manager.cc:1480] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.067s user 0.006s sys 0.000s
I20260928 20:03:34.988577 26450 leader_election.cc:304] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:34.989307 26913 raft_consensus.cc:359] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:34.989997 26913 raft_consensus.cc:385] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:34.990291 26913 raft_consensus.cc:740] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:34.999843 26913 consensus_queue.cc:260] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.006042 26913 ts_tablet_manager.cc:1480] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260928 20:03:35.007083 26913 tablet_bootstrap.cc:492] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:35.008832 26450 leader_election.cc:304] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.009764 29584 raft_consensus.cc:2749] T 534674440ee649e4afbc87b3cce5c43e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.007737 26916 tablet_bootstrap.cc:492] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:35.022749 26912 raft_consensus.cc:385] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.023074 26912 raft_consensus.cc:740] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.023667 26912 consensus_queue.cc:260] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.026078 26912 ts_tablet_manager.cc:1480] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.070s user 0.005s sys 0.000s
I20260928 20:03:35.028004 29645 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.028470 29645 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.029826 26916 tablet_bootstrap.cc:654] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:35.030287 29677 raft_consensus.cc:2749] T 25512bb19e3c4f78bb917378b10021e5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.031148 29645 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:35.031395 26450 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.031749 26450 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.032425 29677 raft_consensus.cc:2749] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:35.033641 26450 leader_election.cc:343] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.034112 26450 leader_election.cc:304] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.034818 29584 raft_consensus.cc:2749] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.036346 29584 raft_consensus.cc:493] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.036813 29584 raft_consensus.cc:515] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.038812 29584 leader_election.cc:290] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.049502 29645 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.050068 29645 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.053254 26450 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.054478 26450 leader_election.cc:304] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.055222 29677 raft_consensus.cc:2749] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.055840 29677 raft_consensus.cc:2749] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.057000 26450 leader_election.cc:304] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.052600 29645 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.060702 26913 tablet_bootstrap.cc:654] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:34.993584 29382 ts_tablet_manager.cc:1975] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:35.067353 29382 log.cc:1199] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:35.068156 29382 ts_tablet_manager.cc:1996] T e5e8ff2ad1f745f88df6e471ed935f2f P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:35.119035 29677 raft_consensus.cc:493] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.119556 29677 raft_consensus.cc:515] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.121948 29584 raft_consensus.cc:2749] T 6393d0583a9a47ec9eb455b30a548fc3 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.130005 26913 tablet_bootstrap.cc:492] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:35.130566 26913 ts_tablet_manager.cc:1449] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.124s user 0.014s sys 0.000s
I20260928 20:03:35.134136 26913 raft_consensus.cc:359] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.134845 26913 raft_consensus.cc:385] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.135085 26913 raft_consensus.cc:740] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.153909 26913 consensus_queue.cc:260] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.163817 29702 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.164525 29702 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:35.168179 27924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:35.176846 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:35.184640 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:35.196585 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:35.199681 26803 raft_consensus.cc:3060] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:35.218287 29584 raft_consensus.cc:493] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.218786 29584 raft_consensus.cc:515] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.231763 26220 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:35.234018 29584 leader_election.cc:290] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.241216 29702 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:35.241882 29702 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:35.243638 26912 tablet_bootstrap.cc:492] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:35.246820 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 189880us
I20260928 20:03:35.247795 26450 leader_election.cc:304] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.248991 26450 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.251672 26912 tablet_bootstrap.cc:654] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:35.256695 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 9) took 7677 ms. Trace:
I20260928 20:03:35.257408 29382 rpcz_store.cc:276] 0928 20:03:27.579562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.581585 (+ 2023us) service_pool.cc:224] Handling call
0928 20:03:34.454525 (+6872940us) ts_tablet_manager.cc:1197] Deleting tablet e5e8ff2ad1f745f88df6e471ed935f2f
0928 20:03:34.454571 (+ 46us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:34.749177 (+294606us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:34.993410 (+244233us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:35.256400 (+262990us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32424,"tablet-delete.queue_time_us":6872471}
I20260928 20:03:35.259502 29382 tablet_replica.cc:333] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:35.260741 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet e5e8ff2ad1f745f88df6e471ed935f2f (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]) successfully deleted
I20260928 20:03:35.270752 26916 tablet_bootstrap.cc:492] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:35.271374 26916 ts_tablet_manager.cc:1449] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.264s user 0.013s sys 0.001s
I20260928 20:03:35.259162 29677 leader_election.cc:290] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:35.285625 26220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.254:42899, user_credentials={real_user=slave}} blocked reactor thread for 53944.3us
I20260928 20:03:35.288057 29575 raft_consensus.cc:2804] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:35.293586 29584 raft_consensus.cc:2804] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:35.301543 29584 raft_consensus.cc:697] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:35.302407 29575 raft_consensus.cc:697] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:35.308147 29575 consensus_queue.cc:237] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.313500 29708 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.314754 29584 consensus_queue.cc:237] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.322836 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:35.326319 29708 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.329160 29708 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:35.306515 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 57595.5us
I20260928 20:03:35.331533 26450 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.332464 29677 raft_consensus.cc:2804] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:35.333033 29677 raft_consensus.cc:697] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:35.334046 29677 consensus_queue.cc:237] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.339730 26916 raft_consensus.cc:359] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.341215 26916 raft_consensus.cc:385] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.341571 26916 raft_consensus.cc:740] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.342499 26916 consensus_queue.cc:260] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.343554 26913 ts_tablet_manager.cc:1480] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.213s user 0.007s sys 0.000s
I20260928 20:03:35.372865 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:35.375272 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:35.386457 26912 tablet_bootstrap.cc:492] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:35.394529 26912 ts_tablet_manager.cc:1449] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.151s user 0.008s sys 0.006s
I20260928 20:03:35.354396 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:35.406798 26503 raft_consensus.cc:2393] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:35.409545 26913 tablet_bootstrap.cc:492] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:35.409910 26916 ts_tablet_manager.cc:1480] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.138s user 0.006s sys 0.001s
I20260928 20:03:35.362892 26450 leader_election.cc:304] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:35.410830 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 48030.4us
I20260928 20:03:35.411571 26450 leader_election.cc:304] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.413007 29712 raft_consensus.cc:2749] T 87718f040f0d4b9d88a551cae4f0d47f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.412385 29575 raft_consensus.cc:2749] T 30ef26307b9a459f8634d59b1ca373ef P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.414626 26450 leader_election.cc:304] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.415907 26913 tablet_bootstrap.cc:654] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:35.415733 26450 leader_election.cc:304] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.416520 29575 raft_consensus.cc:2749] T 964f7c83a1c048688ea1f3227a88bb8f P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.417284 29575 raft_consensus.cc:2749] T ea01d2ddd91d4a0fa29afaebfbd83528 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.426690 26916 tablet_bootstrap.cc:492] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:35.436283 26594 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:35.437752 26916 tablet_bootstrap.cc:654] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:35.430717 26450 leader_election.cc:343] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.442468 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:35.442399 26450 leader_election.cc:304] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.443207 29584 raft_consensus.cc:2749] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:35.447644 26450 leader_election.cc:343] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:35.449949 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 44041.2us
I20260928 20:03:35.451205 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:35.456988 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:35.457741 26912 raft_consensus.cc:359] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.458736 26912 raft_consensus.cc:385] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.459123 26912 raft_consensus.cc:740] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.460096 26912 consensus_queue.cc:260] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.470945 26450 leader_election.cc:304] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.471942 29584 raft_consensus.cc:2749] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.472357 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:35.473142 26912 ts_tablet_manager.cc:1480] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.078s user 0.006s sys 0.000s
I20260928 20:03:35.474675 26912 tablet_bootstrap.cc:492] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
W20260928 20:03:35.481855 26450 leader_election.cc:343] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.480008 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:35.484575 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:35.498696 26594 leader_election.cc:304] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:35.499681 29651 raft_consensus.cc:2804] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:35.500337 29651 raft_consensus.cc:697] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:35.498945 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:35.501207 29651 consensus_queue.cc:237] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.501961 26450 leader_election.cc:304] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.502839 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:35.503594 29584 raft_consensus.cc:2749] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.504859 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:35.506562 26450 leader_election.cc:304] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.510766 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
W20260928 20:03:35.515753 26594 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
W20260928 20:03:35.516969 26594 leader_election.cc:343] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.522825 29677 raft_consensus.cc:493] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.523236 26913 tablet_bootstrap.cc:492] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:35.523413 29677 raft_consensus.cc:515] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.523880 26913 ts_tablet_manager.cc:1449] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.115s user 0.007s sys 0.002s
I20260928 20:03:35.527206 29677 leader_election.cc:290] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.528029 29584 raft_consensus.cc:2749] T 7775ad91c86840c49a902b059a0ff74d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.528843 29705 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:35.529398 29705 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:35.531771 26594 leader_election.cc:343] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:35.532939 26594 leader_election.cc:343] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.535874 29705 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.537228 26450 leader_election.cc:304] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.542248 29651 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:35.542917 29651 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.546298 29651 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.547693 29651 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.549193 29651 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.550284 29705 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:35.550913 29705 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.553121 29705 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.559566 29651 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.561008 29651 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
W20260928 20:03:35.562260 26740 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 79628.5us
I20260928 20:03:35.562515 29651 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:35.565362 29584 raft_consensus.cc:2749] T 979f943cd32849f399347f3d9d5b5c18 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:35.566787 26450 leader_election.cc:304] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.567549 29584 raft_consensus.cc:2749] T 06e4d7f4ee1a4e77aaf5190a550c56a8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.568403 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:35.575184 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:35.575631 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:35.579978 26450 leader_election.cc:304] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.580830 29584 raft_consensus.cc:2749] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.584283 26912 tablet_bootstrap.cc:654] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:35.588752 26450 leader_election.cc:343] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.589254 26450 leader_election.cc:304] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.590031 29584 raft_consensus.cc:2749] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.597563 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:35.602188 26450 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.605057 26916 tablet_bootstrap.cc:492] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:35.605578 26916 ts_tablet_manager.cc:1449] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.179s user 0.010s sys 0.000s
I20260928 20:03:35.593631 29651 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.613534 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:35.619803 29709 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:35.620493 29709 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:35.623198 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:35.624655 29709 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:35.626979 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:35.630335 29584 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:35.630913 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:35.631796 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 1dde3191a52b4254944ae1f8556e1632
I20260928 20:03:35.632598 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:35.632725 26450 leader_election.cc:304] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.633412 29584 raft_consensus.cc:2749] T a8b15d2c55d94e64b75da8089a68b6e1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.634617 26450 leader_election.cc:304] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.636904 29584 raft_consensus.cc:2749] T 311f004a7acc4d43b4b88564b57efa74 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.638168 26450 leader_election.cc:304] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.651237 26913 raft_consensus.cc:359] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.658918 26913 raft_consensus.cc:385] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.659230 26913 raft_consensus.cc:740] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.661636 26912 tablet_bootstrap.cc:492] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:35.662205 26912 ts_tablet_manager.cc:1449] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.188s user 0.008s sys 0.004s
I20260928 20:03:35.664271 29722 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.664777 29722 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.665598 26912 raft_consensus.cc:359] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:35.666447 26912 raft_consensus.cc:385] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.667260 26912 raft_consensus.cc:740] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.667537 26913 consensus_queue.cc:260] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.635936 26916 raft_consensus.cc:359] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.669003 26916 raft_consensus.cc:385] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.669349 26916 raft_consensus.cc:740] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.670187 26916 consensus_queue.cc:260] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.686445 29584 raft_consensus.cc:2749] T 21cb34c5e33544c9875e7babf4830164 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:35.687672 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 49607.9us
I20260928 20:03:35.688496 26450 leader_election.cc:304] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.689787 29677 raft_consensus.cc:2749] T d3e2de7890874892be6ae5a2008d8a12 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:35.690393 29677 raft_consensus.cc:493] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.690320 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:35.690795 29677 raft_consensus.cc:515] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.692595 26157 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:35.692662 29677 leader_election.cc:290] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.697069 26916 ts_tablet_manager.cc:1480] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.091s user 0.007s sys 0.000s
I20260928 20:03:35.698071 26916 tablet_bootstrap.cc:492] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:35.700516 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:35.701292 26651 raft_consensus.cc:2393] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:35.707943 26450 leader_election.cc:304] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.708633 29584 raft_consensus.cc:2749] T 309f8fcc50e545178888846ac90afcf2 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.709654 26450 leader_election.cc:304] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.710629 29584 raft_consensus.cc:2749] T d5ed5998a6194061839143c4adf4d3d4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.712003 26450 leader_election.cc:304] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.685971 29722 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:35.718353 26595 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.193:33323 timed out after 3.185s (SENT) [suppressed 1 similar messages]
I20260928 20:03:35.723394 26913 ts_tablet_manager.cc:1480] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.199s user 0.007s sys 0.002s
I20260928 20:03:35.724473 26913 tablet_bootstrap.cc:492] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:35.727560 26916 tablet_bootstrap.cc:654] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:35.729261 29709 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.738489 29709 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.736943 26739 leader_election.cc:304] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:35.740805 29709 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.742066 26912 consensus_queue.cc:260] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:35.740826 29705 raft_consensus.cc:2749] T c1cb96cab3e647908f3e99981e7147c7 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.751186 26912 ts_tablet_manager.cc:1480] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.089s user 0.003s sys 0.003s
I20260928 20:03:35.752501 26912 tablet_bootstrap.cc:492] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:35.753769 26913 tablet_bootstrap.cc:654] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:35.757113 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 57098.1us
W20260928 20:03:35.760491 26594 leader_election.cc:343] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:35.764089 26594 leader_election.cc:343] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.742184 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:35.783020 26503 raft_consensus.cc:2393] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:35.753094 29584 raft_consensus.cc:2749] T 8a3021bc9be24874a6ebee01dfb6d7fa P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:35.753713 29677 raft_consensus.cc:493] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.784502 29677 raft_consensus.cc:515] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.789321 29677 leader_election.cc:290] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:35.795408 26594 consensus_peers.cc:597] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:35.802824 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 84493.9us
I20260928 20:03:35.755376 26450 leader_election.cc:304] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.758010 29575 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.805243 29575 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:35.807745 29575 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.812204 29575 raft_consensus.cc:2749] T 323a20314a734279a4af64e8b4f0ff0d P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:35.813603 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 58307.2us
I20260928 20:03:35.814459 26450 leader_election.cc:304] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.815280 29575 raft_consensus.cc:2749] T bc58b27db848454196f75b9077a203cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.820930 26912 tablet_bootstrap.cc:654] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:35.822167 26450 leader_election.cc:304] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.824072 29575 raft_consensus.cc:2749] T 9c4f6c6d4a0a4aada3a17d16c63d3b25 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:35.825289 26450 leader_election.cc:343] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:35.825950 26450 leader_election.cc:343] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.826339 26450 leader_election.cc:304] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:35.828436 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 54696.8us
I20260928 20:03:35.851616 29651 raft_consensus.cc:493] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.852123 29651 raft_consensus.cc:515] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.840062 29382 raft_consensus.cc:2243] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:35.871606 29382 raft_consensus.cc:2272] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:35.856386 26912 tablet_bootstrap.cc:492] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:35.873987 29382 ts_tablet_manager.cc:1962] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:35.874540 26912 ts_tablet_manager.cc:1449] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.122s user 0.011s sys 0.001s
W20260928 20:03:35.875324 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 46876.1us
I20260928 20:03:35.828035 26916 tablet_bootstrap.cc:492] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:35.876151 26916 ts_tablet_manager.cc:1449] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.178s user 0.009s sys 0.002s
I20260928 20:03:35.876573 29575 raft_consensus.cc:2749] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:35.877619 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 51689us
W20260928 20:03:35.878959 26594 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.879035 26916 raft_consensus.cc:359] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.879781 26916 raft_consensus.cc:385] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.880076 26916 raft_consensus.cc:740] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.880927 29651 leader_election.cc:290] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.880764 26916 consensus_queue.cc:260] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.881445 29645 consensus_queue.cc:1048] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:35.882586 26913 tablet_bootstrap.cc:492] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:35.882979 26913 ts_tablet_manager.cc:1449] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.159s user 0.010s sys 0.001s
W20260928 20:03:35.879911 26450 leader_election.cc:343] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.883596 26450 leader_election.cc:304] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.885419 29575 raft_consensus.cc:2749] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.888473 26916 ts_tablet_manager.cc:1480] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
W20260928 20:03:35.888793 26450 leader_election.cc:343] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.891743 29575 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.892220 29575 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:35.894403 29575 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:35.891360 26739 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:35.897464 29709 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:35.903208 26594 leader_election.cc:343] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:35.903822 26594 leader_election.cc:343] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:35.889384 26450 leader_election.cc:304] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.904583 29575 raft_consensus.cc:2749] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:35.904527 29651 consensus_queue.cc:1048] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:35.905798 26595 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
I20260928 20:03:35.906203 26595 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:35.907279 29645 raft_consensus.cc:2749] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:35.908694 29645 consensus_queue.cc:1048] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:35.908557 26912 raft_consensus.cc:359] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.909272 26912 raft_consensus.cc:385] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.909523 26912 raft_consensus.cc:740] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.914173 26912 consensus_queue.cc:260] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.916410 26912 ts_tablet_manager.cc:1480] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.042s user 0.005s sys 0.000s
I20260928 20:03:35.917392 26912 tablet_bootstrap.cc:492] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:35.917716 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:35.918418 29651 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.918862 29651 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.921357 29651 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.923384 29725 raft_consensus.cc:493] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.923821 29725 raft_consensus.cc:515] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.923897 29645 consensus_queue.cc:1048] T 762cb728cc574a36a68fbe9033544b04 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:35.925738 29725 leader_election.cc:290] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.926782 29725 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.927549 29651 raft_consensus.cc:493] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.927341 29725 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.928004 29651 raft_consensus.cc:515] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.929818 29651 leader_election.cc:290] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.930389 29725 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.934033 26916 tablet_bootstrap.cc:492] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:35.931519 29651 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.935226 29651 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:35.937124 29651 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.934585 29645 raft_consensus.cc:493] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.937639 29645 raft_consensus.cc:515] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.939426 29645 leader_election.cc:290] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.949455 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:35.950727 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:35.951359 26655 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:35.952281 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:35.952955 26646 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 3.
I20260928 20:03:35.953509 29677 raft_consensus.cc:493] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.953547 29575 raft_consensus.cc:493] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.954180 29575 raft_consensus.cc:515] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.954264 29677 raft_consensus.cc:515] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:35.956061 29575 leader_election.cc:290] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.956156 29677 leader_election.cc:290] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.957211 26913 raft_consensus.cc:359] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.957883 26913 raft_consensus.cc:385] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:35.958169 26913 raft_consensus.cc:740] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:35.958731 29677 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.959164 29677 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.960871 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:35.961038 29677 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.961663 26651 raft_consensus.cc:2393] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:35.963404 29651 raft_consensus.cc:493] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:35.964715 29651 raft_consensus.cc:515] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.973021 29677 raft_consensus.cc:493] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.973618 29677 raft_consensus.cc:515] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:35.975631 29733 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:35.976205 29733 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:35.976584 29677 leader_election.cc:290] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.961673 26913 consensus_queue.cc:260] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.979355 29677 raft_consensus.cc:493] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.979817 29677 raft_consensus.cc:515] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.980491 29575 raft_consensus.cc:493] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:35.980997 29575 raft_consensus.cc:515] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.981559 29677 leader_election.cc:290] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.982647 26913 ts_tablet_manager.cc:1480] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.099s user 0.001s sys 0.005s
I20260928 20:03:35.982952 29575 leader_election.cc:290] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.983970 29651 leader_election.cc:290] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:35.987068 29575 raft_consensus.cc:493] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:35.987493 29575 raft_consensus.cc:515] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:35.989400 29575 leader_election.cc:290] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:35.998800 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:35.999614 26659 raft_consensus.cc:2468] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.001700 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.001966 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.002408 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.002684 26659 raft_consensus.cc:2468] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.003752 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd0122845044fd993d166824f3b9cc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.004043 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f21c71dc0e41aba85bb01c9fddc12d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.005069 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.006161 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cc46819bf4480b5cef0f9b92e66b2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.007349 26796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447b96436b34949a35f93b93732a820" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.008422 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c865d2d368847dd9de688bdd65e88b9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.010607 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:36.011205 26794 raft_consensus.cc:3060] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:36.011199 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cc46819bf4480b5cef0f9b92e66b2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.012768 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.014457 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd0122845044fd993d166824f3b9cc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.015246 26651 raft_consensus.cc:2468] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.018226 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79967f9c7bf44678b9681449992776c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.018535 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:36.019054 26797 raft_consensus.cc:3060] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.020020 26912 tablet_bootstrap.cc:654] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.022737 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447b96436b34949a35f93b93732a820" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.024437 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c865d2d368847dd9de688bdd65e88b9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.028113 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79967f9c7bf44678b9681449992776c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.034456 29709 raft_consensus.cc:2749] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:36.034462 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:36.035130 26659 raft_consensus.cc:2393] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:36.036334 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6048c2fc40cf48229c4822e6b68f9376" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.038008 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6048c2fc40cf48229c4822e6b68f9376" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.039266 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3600b2fbb574106b5b13ab837754eb3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.041337 29733 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:36.042711 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 634 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:35.973964 26916 tablet_bootstrap.cc:654] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.048956 26797 raft_consensus.cc:2468] T d3c3cffa96f043629e4bbfcf282d86bd P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:36.051695 26794 raft_consensus.cc:2468] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
I20260928 20:03:36.058918 29400 raft_consensus.cc:493] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.059482 29400 raft_consensus.cc:515] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:36.061898 29400 leader_election.cc:290] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:36.063097 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.064162 26503 raft_consensus.cc:2393] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:36.065162 29382 ts_tablet_manager.cc:1975] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:36.065598 29382 log.cc:1199] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/3657e36a6d2844c28852db1a4f2ed191
I20260928 20:03:36.066488 29382 ts_tablet_manager.cc:1996] T 3657e36a6d2844c28852db1a4f2ed191 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:36.073886 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3600b2fbb574106b5b13ab837754eb3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.075165 29575 raft_consensus.cc:493] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.075635 29575 raft_consensus.cc:515] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:36.077539 29575 leader_election.cc:290] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.083597 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.083885 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.089073 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d556a7736504aa2aa2fe8f868ecf489" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.090931 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d556a7736504aa2aa2fe8f868ecf489" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.096029 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 10) took 8144 ms. Trace:
I20260928 20:03:36.097546 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.099846 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.100454 26913 tablet_bootstrap.cc:492] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:36.108456 26913 tablet_bootstrap.cc:654] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.121526 26916 tablet_bootstrap.cc:492] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:36.122334 26916 ts_tablet_manager.cc:1449] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.188s user 0.004s sys 0.008s
I20260928 20:03:36.122228 29382 rpcz_store.cc:276] 0928 20:03:27.951375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:27.951575 (+ 200us) service_pool.cc:224] Handling call
0928 20:03:35.259232 (+7307657us) ts_tablet_manager.cc:1197] Deleting tablet 3657e36a6d2844c28852db1a4f2ed191
0928 20:03:35.259312 (+ 80us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:35.920227 (+660915us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:36.065030 (+144803us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:36.095963 (+ 30933us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":579201,"tablet-delete.queue_time_us":7301819}
I20260928 20:03:36.124027 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 3657e36a6d2844c28852db1a4f2ed191 (table default.Table_f87f9401517747eb9784b49f2ffce310 [id=27105e0b65184760a89eb58afd0539eb]) successfully deleted
I20260928 20:03:36.097776 29709 raft_consensus.cc:493] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.124755 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.124962 29709 raft_consensus.cc:515] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.125900 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.097731 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046ed3ac8b6b46afbc1e1bde4b2365ef" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.113147 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62114712f2c040e6b1ae831911d68896" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.127748 29709 leader_election.cc:290] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.128767 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.130095 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.128976 29382 tablet_replica.cc:333] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:36.137094 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.142759 29734 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.142784 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.143342 29734 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.145489 29734 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.147548 29575 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.148159 29575 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.151193 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.155181 29575 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.159507 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.160194 26804 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.166180 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:36.172298 29677 raft_consensus.cc:493] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.172919 29677 raft_consensus.cc:515] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:36.176012 29677 leader_election.cc:290] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.176800 29677 raft_consensus.cc:493] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.177309 29677 raft_consensus.cc:515] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.182240 29677 leader_election.cc:290] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.184576 29575 raft_consensus.cc:493] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.185196 29575 raft_consensus.cc:515] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.190881 29575 leader_election.cc:290] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.191517 29575 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.192442 29575 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.201357 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.201264 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.201920 26513 raft_consensus.cc:2468] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.201999 26503 raft_consensus.cc:2468] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.208599 29734 raft_consensus.cc:493] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:36.209367 29734 raft_consensus.cc:515] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.213310 29734 leader_election.cc:290] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.172514 26912 tablet_bootstrap.cc:492] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:36.184119 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd0122845044fd993d166824f3b9cc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.189803 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d27cbf353246fbb7fe09f385194d8a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.190016 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.190286 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.196156 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.215575 26912 ts_tablet_manager.cc:1449] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.298s user 0.011s sys 0.004s
I20260928 20:03:36.218469 26912 raft_consensus.cc:359] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:36.219336 26912 raft_consensus.cc:385] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:36.219955 26912 raft_consensus.cc:740] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:36.220829 26912 consensus_queue.cc:260] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:36.222668 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.223356 26513 raft_consensus.cc:2468] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.226862 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.242565 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.243718 29575 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.264072 26912 ts_tablet_manager.cc:1480] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.048s user 0.004s sys 0.002s
I20260928 20:03:36.243911 26916 raft_consensus.cc:359] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.268862 26916 raft_consensus.cc:385] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:36.269182 26916 raft_consensus.cc:740] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:36.269809 26916 consensus_queue.cc:260] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.271797 26916 ts_tablet_manager.cc:1480] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.149s user 0.005s sys 0.000s
I20260928 20:03:36.273350 26916 tablet_bootstrap.cc:492] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:36.280753 26913 tablet_bootstrap.cc:492] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:36.281385 26913 ts_tablet_manager.cc:1449] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.181s user 0.065s sys 0.049s
I20260928 20:03:36.285423 26913 raft_consensus.cc:359] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.286795 26913 raft_consensus.cc:385] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:36.287137 26913 raft_consensus.cc:740] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:36.288184 26913 consensus_queue.cc:260] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.290505 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.291015 26913 ts_tablet_manager.cc:1480] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.009s user 0.001s sys 0.004s
I20260928 20:03:36.291165 26794 raft_consensus.cc:2468] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:36.291913 26913 tablet_bootstrap.cc:492] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:36.300990 26913 tablet_bootstrap.cc:654] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.310674 26912 tablet_bootstrap.cc:492] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:36.320762 26912 tablet_bootstrap.cc:654] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.314980 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f9b3c3b4c84b19b4325152899e6b26" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.318274 29575 raft_consensus.cc:493] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.338598 29677 raft_consensus.cc:493] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.354318 26505 raft_consensus.cc:3060] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.354426 29677 raft_consensus.cc:515] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.356302 29677 leader_election.cc:290] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.357265 29575 raft_consensus.cc:515] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.359083 29575 leader_election.cc:290] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.360715 26505 raft_consensus.cc:2468] T d0f9b3c3b4c84b19b4325152899e6b26 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:36.403931 29382 raft_consensus.cc:2243] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:36.405028 29382 raft_consensus.cc:2272] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:36.412648 29382 ts_tablet_manager.cc:1962] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:36.436347 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:36.437714 26594 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.369376 29575 raft_consensus.cc:493] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:36.377213 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.454912 26498 raft_consensus.cc:3060] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.378753 26513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.458314 26513 raft_consensus.cc:3060] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.379082 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3cffa96f043629e4bbfcf282d86bd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.386462 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.462412 26502 raft_consensus.cc:3060] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.462576 26506 raft_consensus.cc:2393] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:36.463713 29575 raft_consensus.cc:515] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:36.428757 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.466500 26497 raft_consensus.cc:2468] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.469774 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.470937 26499 raft_consensus.cc:2468] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.475401 26513 raft_consensus.cc:2468] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:36.476763 29575 leader_election.cc:290] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:36.477538 26498 raft_consensus.cc:2468] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:36.484840 26502 raft_consensus.cc:2468] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:36.445523 26916 tablet_bootstrap.cc:654] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.499553 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b3ac3820e34f519f593a794b7e0899" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.500232 26659 raft_consensus.cc:2393] T 56b3ac3820e34f519f593a794b7e0899 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:36.501601 26594 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:36.504477 29734 raft_consensus.cc:2804] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:36.505017 29734 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:36.505538 29734 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:36.518682 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.519824 26499 raft_consensus.cc:2376] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1. Re-sending same reply.
I20260928 20:03:36.520381 29734 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.523669 26912 tablet_bootstrap.cc:492] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:36.524387 26912 ts_tablet_manager.cc:1449] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.214s user 0.011s sys 0.000s
I20260928 20:03:36.528805 26912 raft_consensus.cc:359] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.529577 26912 raft_consensus.cc:385] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:36.542574 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.543330 26506 raft_consensus.cc:2468] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.542572 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.544183 26497 raft_consensus.cc:2468] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.581491 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.581983 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.531837 29705 raft_consensus.cc:493] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:36.586627 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.586493 29705 raft_consensus.cc:515] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.587476 26497 raft_consensus.cc:2468] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.532238 29400 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:36.590379 29400 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.592303 29400 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.589813 29705 leader_election.cc:290] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.593241 26912 raft_consensus.cc:740] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:36.595158 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.598016 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd0122845044fd993d166824f3b9cc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.598217 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.598680 26499 raft_consensus.cc:2468] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:36.594008 26912 consensus_queue.cc:260] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.603894 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49aa062e7674a47ac68fdadf68980b8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.604529 26497 raft_consensus.cc:2376] T c49aa062e7674a47ac68fdadf68980b8 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1. Re-sending same reply.
I20260928 20:03:36.609251 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.610435 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc62660134e45f8bc958e95f4e56906" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.622606 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec2497f4eac4408a37eb2a40122a672" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.624936 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4056bc0590264672bd7c4f6d97050dd5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.626978 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:36.628034 26912 ts_tablet_manager.cc:1480] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.103s user 0.006s sys 0.000s
I20260928 20:03:36.628659 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:36.536106 26594 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:36.537715 26913 tablet_bootstrap.cc:492] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
W20260928 20:03:36.629675 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 93609.7us
I20260928 20:03:36.629815 26913 ts_tablet_manager.cc:1449] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.338s user 0.050s sys 0.092s
W20260928 20:03:36.631304 26594 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:36.632141 26913 raft_consensus.cc:359] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.632802 26913 raft_consensus.cc:385] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:36.633042 26913 raft_consensus.cc:740] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:36.544464 29651 raft_consensus.cc:493] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:36.634286 29651 raft_consensus.cc:515] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.637508 29651 leader_election.cc:290] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.633574 26913 consensus_queue.cc:260] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.639654 26913 ts_tablet_manager.cc:1480] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260928 20:03:36.593035 29755 raft_consensus.cc:493] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.640895 29755 raft_consensus.cc:515] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.643435 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b42615f62284e359cdc1f4c9cc715c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.644029 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b42615f62284e359cdc1f4c9cc715c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.644595 29755 leader_election.cc:290] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.645247 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.645762 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abf33cd0d114c25a729bd0eb8ae1278" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.651757 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.652226 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.655146 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.656909 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.668102 26916 tablet_bootstrap.cc:492] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:36.668542 26916 ts_tablet_manager.cc:1449] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.395s user 0.005s sys 0.005s
I20260928 20:03:36.671247 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.673348 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e78ac2ae0124b7b859a79bd9f1c203a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.674376 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.674929 29734 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:36.676071 27822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.633s (SENT)
I20260928 20:03:36.676785 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.609591 29382 ts_tablet_manager.cc:1975] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:36.682714 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e09ad691ec3444d938a04a5c572b0cb" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.683586 29382 log.cc:1199] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/3eb8477c5cb74205b4b55eb38d7f9542
I20260928 20:03:36.684597 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.687701 29382 ts_tablet_manager.cc:1996] T 3eb8477c5cb74205b4b55eb38d7f9542 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:36.694510 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.695693 26739 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:36.696561 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c5918f0c05420b8ed8885c18c63907" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:36.697206 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 65348.9us
I20260928 20:03:36.698402 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:36.700053 26594 leader_election.cc:343] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.708223 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.709141 26651 raft_consensus.cc:2468] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.708990 29705 raft_consensus.cc:2749] T b97ad3f841f54aa38bbb312c50db384e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:36.713372 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ac199f639c454cbc920012040f52c9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.713500 26595 leader_election.cc:304] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:36.714943 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.714779 26916 raft_consensus.cc:359] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.715152 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ddf1201784a93ada93e629befa030" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.715443 26916 raft_consensus.cc:385] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:36.715715 26916 raft_consensus.cc:740] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:36.715762 26793 raft_consensus.cc:2468] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.716544 26804 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.716333 26916 consensus_queue.cc:260] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.717935 26916 ts_tablet_manager.cc:1480] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.049s user 0.006s sys 0.001s
I20260928 20:03:36.721472 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ac199f639c454cbc920012040f52c9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.724798 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.727952 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ddf1201784a93ada93e629befa030" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.730439 26595 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:36.730465 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.731902 26651 raft_consensus.cc:2468] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.732503 29651 raft_consensus.cc:2804] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:36.733083 29651 raft_consensus.cc:493] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:36.733659 29651 raft_consensus.cc:3060] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.734829 26913 tablet_bootstrap.cc:492] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:36.741657 26913 tablet_bootstrap.cc:654] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.742189 29755 raft_consensus.cc:2804] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:36.742724 29755 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:36.743227 29755 raft_consensus.cc:3060] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.745278 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.745858 26659 raft_consensus.cc:2468] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:36.743178 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfce3de1374f7a8c02c6898f6a741c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:36.749724 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:36.756207 26450 leader_election.cc:343] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.757031 26450 leader_election.cc:343] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.757634 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:36.757719 26450 leader_election.cc:304] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:36.758502 29575 raft_consensus.cc:2749] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:36.758598 26156 catalog_manager.cc:5838] T e8de132c03884597a311898f4d427bb1 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
W20260928 20:03:36.760028 26450 leader_election.cc:343] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.760581 26450 leader_election.cc:343] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.761300 26450 leader_election.cc:343] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.761808 26450 leader_election.cc:343] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.761770 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
W20260928 20:03:36.763856 26450 leader_election.cc:343] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.764379 26450 leader_election.cc:343] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.764695 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
W20260928 20:03:36.764990 26450 leader_election.cc:343] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.765581 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:36.767118 26450 leader_election.cc:304] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:36.767845 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:36.767844 29575 raft_consensus.cc:2804] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:36.768611 29575 raft_consensus.cc:697] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:36.769898 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:36.771757 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:36.771062 29575 consensus_queue.cc:237] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.774546 26156 catalog_manager.cc:5838] T 03bd721cb5b34b9288fad286290db847 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 1 to 2, leader changed from 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193) to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 2 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
W20260928 20:03:36.775579 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 62777us
I20260928 20:03:36.776733 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:36.776841 26450 leader_election.cc:304] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:36.777648 29677 raft_consensus.cc:2804] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 20:03:36.782685 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
W20260928 20:03:36.783212 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 71791.3us
W20260928 20:03:36.783896 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 74552.6us
I20260928 20:03:36.784646 26739 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:36.785673 26793 raft_consensus.cc:3060] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.786914 29400 raft_consensus.cc:2804] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:36.787098 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfce3de1374f7a8c02c6898f6a741c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.787297 29400 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:36.787642 29400 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:36.788612 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.790752 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf030c329e64d208a3f507804edbd54" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:36.790932 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:36.795746 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:36.797145 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:36.796919 29400 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:36.797017 26450 leader_election.cc:343] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.798867 26450 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.799418 26450 leader_election.cc:343] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.803232 29677 raft_consensus.cc:697] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [term 3 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:36.803923 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:36.804363 29677 consensus_queue.cc:237] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.805202 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:36.806354 26156 catalog_manager.cc:5838] T bc58b27db848454196f75b9077a203cb P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:36.808524 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:36.809281 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
W20260928 20:03:36.809835 26450 leader_election.cc:343] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.810511 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
W20260928 20:03:36.812053 26450 leader_election.cc:343] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.812330 26156 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
W20260928 20:03:36.817884 26450 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.818645 26450 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.822598 26450 leader_election.cc:343] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.823287 26450 leader_election.cc:343] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.823956 26450 leader_election.cc:304] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:36.825130 29764 raft_consensus.cc:2804] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:36.825661 29764 raft_consensus.cc:493] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:36.826254 29764 raft_consensus.cc:3060] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.828091 29677 raft_consensus.cc:493] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:36.828296 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 47741.9us
I20260928 20:03:36.828866 29677 raft_consensus.cc:515] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.832248 26739 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:36.833371 29757 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260928 20:03:36.833727 29757 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:36.834050 29757 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Advancing to term 4
I20260928 20:03:36.839386 29677 leader_election.cc:290] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:36.845903 26450 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.847015 26450 leader_election.cc:343] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:36.850461 26450 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:36.849645 29677 raft_consensus.cc:493] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.856992 29757 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:36.870466 29757 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 4 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:36.875411 26739 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:36.876945 29400 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:36.878350 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 49208.7us
I20260928 20:03:36.888799 26912 tablet_bootstrap.cc:492] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:36.893332 29761 tablet.cc:1751] T 7e09ad691ec3444d938a04a5c572b0cb P 92fd8074a7df4bba87a73c0d84ed00c8: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:03:36.894253 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 149879us
I20260928 20:03:36.894973 26595 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:36.895668 29765 raft_consensus.cc:2804] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:36.896003 29765 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:36.896306 29765 raft_consensus.cc:3060] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:36.901065 26595 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:36.901787 29575 consensus_queue.cc:1048] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:36.902163 26916 tablet_bootstrap.cc:492] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:36.901445 26595 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:36.904084 26912 tablet_bootstrap.cc:654] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.903635 29734 raft_consensus.cc:2749] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:36.907083 29765 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.916988 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.917538 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:36.922207 29575 consensus_queue.cc:1048] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:36.930809 26916 tablet_bootstrap.cc:654] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:36.933622 29777 raft_consensus.cc:493] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:36.934281 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 82733.1us
I20260928 20:03:36.934648 29777 raft_consensus.cc:515] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:36.935442 26450 leader_election.cc:304] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:36.936898 29575 consensus_queue.cc:1048] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:36.924546 29778 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:36.942458 29757 raft_consensus.cc:3060] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.896988 29651 raft_consensus.cc:515] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.955647 26913 tablet_bootstrap.cc:492] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:36.956157 26913 ts_tablet_manager.cc:1449] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.222s user 0.003s sys 0.011s
I20260928 20:03:36.955916 29755 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.957621 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 11) took 8870 ms. Trace:
I20260928 20:03:36.958214 26912 tablet_bootstrap.cc:492] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:36.958597 26912 ts_tablet_manager.cc:1449] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.000s
I20260928 20:03:36.910676 29677 raft_consensus.cc:515] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:36.957988 29382 rpcz_store.cc:276] 0928 20:03:28.100667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.100797 (+ 130us) service_pool.cc:224] Handling call
0928 20:03:36.127318 (+8026521us) ts_tablet_manager.cc:1197] Deleting tablet 3eb8477c5cb74205b4b55eb38d7f9542
0928 20:03:36.127379 (+ 61us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:36.453973 (+326594us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:36.609431 (+155458us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:36.957516 (+348085us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327702,"tablet-delete.queue_time_us":8018032}
I20260928 20:03:36.969849 29382 tablet_replica.cc:333] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:36.970803 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 3eb8477c5cb74205b4b55eb38d7f9542 (table default.Table_9383c6792e2d433ab615717932fa897e [id=b639dae4a9234107aa133677343f4d12]) successfully deleted
W20260928 20:03:36.977667 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 98560.3us
W20260928 20:03:36.980906 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 105566us
W20260928 20:03:36.990958 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 89893.3us
I20260928 20:03:36.993137 29651 leader_election.cc:290] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:36.953750 29757 raft_consensus.cc:2749] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.000768 29765 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.012147 26912 raft_consensus.cc:359] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.013067 26912 raft_consensus.cc:385] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.013458 26912 raft_consensus.cc:740] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
W20260928 20:03:37.017306 26595 leader_election.cc:343] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0aad5c72e4c64b9e91082860477c78fa
I20260928 20:03:36.938073 29777 leader_election.cc:290] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:36.938676 29575 raft_consensus.cc:2804] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.019412 29575 raft_consensus.cc:493] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.020032 29575 raft_consensus.cc:3060] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:36.950909 29778 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.025507 26739 leader_election.cc:304] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:37.027082 29709 raft_consensus.cc:3060] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.028687 29778 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:36.980093 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44714.1us
I20260928 20:03:36.964439 29677 leader_election.cc:290] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.036573 26450 leader_election.cc:304] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.037489 29677 raft_consensus.cc:2804] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.038040 29677 raft_consensus.cc:493] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260928 20:03:37.037868 26450 leader_election.cc:343] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.038652 29677 raft_consensus.cc:3060] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.015383 29764 raft_consensus.cc:515] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:37.049513 26450 leader_election.cc:304] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.050508 26912 consensus_queue.cc:260] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.053108 26450 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.057612 26595 leader_election.cc:304] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.021165 26594 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:37.058620 29651 raft_consensus.cc:2804] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:37.059098 26450 leader_election.cc:304] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.059226 29651 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.059906 29651 raft_consensus.cc:3060] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:37.062901 29770 raft_consensus.cc:493] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.063409 29770 raft_consensus.cc:515] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.065598 29770 leader_election.cc:290] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.004510 29755 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.067692 29777 raft_consensus.cc:2749] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:37.069169 29677 raft_consensus.cc:515] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.069773 26916 tablet_bootstrap.cc:492] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:37.070310 26916 ts_tablet_manager.cc:1449] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.168s user 0.015s sys 0.001s
I20260928 20:03:37.049677 29764 leader_election.cc:290] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:37.075800 26594 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3
I20260928 20:03:36.980093 29780 raft_consensus.cc:493] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.079938 29780 raft_consensus.cc:515] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.053846 26913 raft_consensus.cc:359] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.081223 26913 raft_consensus.cc:385] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.081820 26913 raft_consensus.cc:740] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.084048 29780 leader_election.cc:290] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.084815 29780 raft_consensus.cc:493] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.083022 26913 consensus_queue.cc:260] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:37.071532 26450 leader_election.cc:343] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.071252 29778 raft_consensus.cc:2749] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.074707 26916 raft_consensus.cc:359] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.075363 29777 raft_consensus.cc:2804] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.076009 29677 leader_election.cc:290] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.086504 29777 raft_consensus.cc:493] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.087294 29777 raft_consensus.cc:3060] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.086593 26916 raft_consensus.cc:385] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.091636 26916 raft_consensus.cc:740] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.086313 26450 leader_election.cc:304] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.098380 26916 consensus_queue.cc:260] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:37.098997 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 73589us
I20260928 20:03:37.102396 29677 raft_consensus.cc:2749] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.104801 26916 ts_tablet_manager.cc:1480] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
W20260928 20:03:37.105691 26450 leader_election.cc:343] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.106220 26450 leader_election.cc:304] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.106947 29677 raft_consensus.cc:2749] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.111733 29777 raft_consensus.cc:515] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.118993 29709 raft_consensus.cc:2749] T eb02b1f6bf4e43a08a3331438bf8e362 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.126950 29777 leader_election.cc:290] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:37.113613 26450 leader_election.cc:343] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 1dde3191a52b4254944ae1f8556e1632
W20260928 20:03:37.128441 26450 leader_election.cc:343] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.128863 26450 leader_election.cc:304] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.130155 29764 raft_consensus.cc:2749] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:37.132035 26450 leader_election.cc:343] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.132561 26450 leader_election.cc:304] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.133394 29764 raft_consensus.cc:2749] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:37.134522 26450 leader_election.cc:343] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.085451 29780 raft_consensus.cc:515] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.136996 29780 leader_election.cc:290] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.123096 29575 raft_consensus.cc:515] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.139117 29575 leader_election.cc:290] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.140230 26739 leader_election.cc:304] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:37.139613 26450 leader_election.cc:304] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.141640 26912 ts_tablet_manager.cc:1480] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.183s user 0.007s sys 0.003s
I20260928 20:03:37.142091 29777 raft_consensus.cc:2749] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.142458 29400 raft_consensus.cc:2749] T 56b3ac3820e34f519f593a794b7e0899 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:37.143262 26450 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.147603 26450 leader_election.cc:304] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.149096 29780 raft_consensus.cc:2749] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:37.151012 26450 leader_election.cc:343] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.151401 26450 leader_election.cc:304] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.152330 26450 leader_election.cc:304] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.166294 29575 raft_consensus.cc:2749] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.166846 29780 raft_consensus.cc:2749] T 046ed3ac8b6b46afbc1e1bde4b2365ef P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:37.168797 26450 leader_election.cc:304] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.169543 29575 raft_consensus.cc:2749] T 62114712f2c040e6b1ae831911d68896 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.171030 26450 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.171875 29575 raft_consensus.cc:2749] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.172998 26450 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.173771 29575 raft_consensus.cc:2749] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:37.174950 26450 leader_election.cc:343] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.175377 26450 leader_election.cc:304] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.175992 29575 raft_consensus.cc:2749] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.177016 26450 leader_election.cc:304] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.177712 29575 raft_consensus.cc:2749] T 0abf33cd0d114c25a729bd0eb8ae1278 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.178836 26450 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.179498 29575 raft_consensus.cc:2749] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.180552 26450 leader_election.cc:304] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.181188 29575 raft_consensus.cc:2749] T 7e78ac2ae0124b7b859a79bd9f1c203a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:37.182214 26450 leader_election.cc:304] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.182876 29575 raft_consensus.cc:2749] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:37.183811 26450 leader_election.cc:343] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.184319 26913 ts_tablet_manager.cc:1480] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.228s user 0.005s sys 0.006s
I20260928 20:03:37.184233 26450 leader_election.cc:304] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.184816 29575 raft_consensus.cc:2749] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.185786 26450 leader_election.cc:304] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.186463 29575 raft_consensus.cc:2749] T 78c5918f0c05420b8ed8885c18c63907 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:37.187605 26450 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.188021 26450 leader_election.cc:304] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.195188 26912 tablet_bootstrap.cc:492] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:37.198432 29575 raft_consensus.cc:2749] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.201100 26450 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.202287 29575 raft_consensus.cc:2804] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.202826 29575 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.203441 29575 raft_consensus.cc:3060] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.201867 29756 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:37.207317 29756 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.208261 26913 tablet_bootstrap.cc:492] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:37.215159 29780 consensus_queue.cc:1048] T 56b3ac3820e34f519f593a794b7e0899 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:37.220595 26450 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 030f48d0d716450aaa4248d9fb1397ba
I20260928 20:03:37.223928 29757 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:37.221942 26450 leader_election.cc:343] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.224923 26450 leader_election.cc:304] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.224815 29757 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.225823 29780 raft_consensus.cc:2749] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:37.227386 26450 leader_election.cc:343] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.228427 29575 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.228899 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:37.229877 26499 raft_consensus.cc:2468] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:37.232061 26740 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:37.227766 26450 leader_election.cc:304] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.233521 29757 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.233868 29780 raft_consensus.cc:2749] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.235711 26450 leader_election.cc:304] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:37.238205 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 139595us
I20260928 20:03:37.239604 29575 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.240559 29780 raft_consensus.cc:2804] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.246420 29780 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.247035 29780 raft_consensus.cc:3060] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.254626 26916 tablet_bootstrap.cc:492] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:37.241580 26450 leader_election.cc:304] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.262073 29677 raft_consensus.cc:2804] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.262858 29677 raft_consensus.cc:493] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.263597 29677 raft_consensus.cc:3060] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.265992 26916 tablet_bootstrap.cc:654] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.275072 29677 raft_consensus.cc:515] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.276703 29778 consensus_queue.cc:1048] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:37.276734 26450 leader_election.cc:343] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.277915 26450 leader_election.cc:304] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.278597 29778 raft_consensus.cc:2749] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.279731 26450 leader_election.cc:304] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.280458 29778 raft_consensus.cc:2749] T caf030c329e64d208a3f507804edbd54 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.281394 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:37.282531 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:37.287518 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:37.296207 29677 leader_election.cc:290] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.239260 29756 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.244167 29734 raft_consensus.cc:2749] T 0aad5c72e4c64b9e91082860477c78fa P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.304176 29761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33616 (request call id 8) took 1818 ms. Trace:
W20260928 20:03:37.313088 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.633s (SENT)
I20260928 20:03:37.313479 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:37.304649 29761 rpcz_store.cc:276] 0928 20:03:35.485774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:35.486008 (+ 234us) service_pool.cc:224] Handling call
0928 20:03:37.304078 (+1818070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:35.710491 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0928 20:03:35.710933 (+ 442us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0928 20:03:35.710978 (+ 45us) alter_schema_op.cc:66] Acquired schema lock
0928 20:03:35.711033 (+ 55us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0928 20:03:35.711167 (+ 134us) alter_schema_op.cc:128] START. Timestamp: 1790625815711059
0928 20:03:35.711206 (+ 39us) op_driver.cc:348] REPLICATION: starting
0928 20:03:35.711819 (+ 613us) log.cc:844] Serialized 173 byte log entry
0928 20:03:36.704208 (+992389us) op_driver.cc:464] REPLICATION: finished
0928 20:03:36.893195 (+188987us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0928 20:03:36.909780 (+ 16585us) log.cc:844] Serialized 5 byte log entry
0928 20:03:37.211444 (+301664us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:37.303842 (+ 92398us) log.cc:844] Serialized 14 byte log entry
0928 20:03:37.303932 (+ 90us) alter_schema_op.cc:73] Released schema lock
0928 20:03:37.303960 (+ 28us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":188754,"prepare.queue_time_us":223397,"prepare.run_cpu_time_us":23340,"prepare.run_wall_time_us":163812,"replication_time_us":992859,"thread_start_us":526296,"threads_started":4,"wal-append.queue_time_us":149696,"wal-append.run_cpu_time_us":1384,"wal-append.run_wall_time_us":1012436}]]}
I20260928 20:03:37.343822 29651 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.346928 29651 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.348657 26913 tablet_bootstrap.cc:654] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.297729 29780 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.352262 29780 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.380002 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec056d6f6b0461da1f0a4525b711c8c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.381631 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.382663 26916 tablet_bootstrap.cc:492] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:37.383229 26916 ts_tablet_manager.cc:1449] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.129s user 0.012s sys 0.002s
I20260928 20:03:37.386088 26916 raft_consensus.cc:359] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.386888 26916 raft_consensus.cc:385] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.387221 26916 raft_consensus.cc:740] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.387921 26916 consensus_queue.cc:260] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.388423 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:37.390646 26916 ts_tablet_manager.cc:1480] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260928 20:03:37.393515 26916 tablet_bootstrap.cc:492] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:37.395358 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:37.399263 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 155469us
I20260928 20:03:37.411422 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.416296 29780 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:37.416899 29780 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.418990 29780 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.238456 29709 raft_consensus.cc:2804] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.422870 29709 raft_consensus.cc:493] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.423321 29709 raft_consensus.cc:3060] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.424224 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.424379 26916 tablet_bootstrap.cc:654] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.424747 26651 raft_consensus.cc:3060] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:37.242590 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 59315.3us
I20260928 20:03:37.287089 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec056d6f6b0461da1f0a4525b711c8c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.288033 26793 raft_consensus.cc:1240] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 3. Current term is 4. Ops: []
I20260928 20:03:37.431988 26651 raft_consensus.cc:2468] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:37.390085 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:37.335806 26912 tablet_bootstrap.cc:654] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.366917 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.399565 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.413754 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.422329 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030f48d0d716450aaa4248d9fb1397ba" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.437258 26794 raft_consensus.cc:3060] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.437757 29797 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:37.439640 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 126586us
I20260928 20:03:37.441838 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:37.443162 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.445974 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.448110 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f9252dd72c46b3acf84be7feb6a4f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.450290 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]). Expected version 1 got 0
I20260928 20:03:37.450482 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd0122845044fd993d166824f3b9cc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.450968 26651 raft_consensus.cc:3060] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.452375 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:37.453289 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:37.454838 26913 tablet_bootstrap.cc:492] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:37.455287 26913 ts_tablet_manager.cc:1449] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.247s user 0.010s sys 0.004s
I20260928 20:03:37.455140 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61bd0122845044fd993d166824f3b9cc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.472007 26916 tablet_bootstrap.cc:492] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:37.472543 26916 ts_tablet_manager.cc:1449] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.080s user 0.011s sys 0.001s
I20260928 20:03:37.475520 26916 raft_consensus.cc:359] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.454079 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:37.477789 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:37.479318 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376f270145e44b3acb4b8b2437cba33" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.482941 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97ad3f841f54aa38bbb312c50db384e" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.483003 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376f270145e44b3acb4b8b2437cba33" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:37.484812 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.488292 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.489259 26656 raft_consensus.cc:3060] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.494608 26916 raft_consensus.cc:385] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.495055 26916 raft_consensus.cc:740] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.493757 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:37.496920 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:37.497468 26916 consensus_queue.cc:260] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.502547 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.504673 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.505412 26657 raft_consensus.cc:2393] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:37.505508 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.506363 26656 raft_consensus.cc:2468] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:37.508812 26916 ts_tablet_manager.cc:1480] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20260928 20:03:37.509840 26916 tablet_bootstrap.cc:492] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:37.513285 26651 raft_consensus.cc:2468] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:37.515502 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:37.544657 26912 tablet_bootstrap.cc:492] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:37.545272 26912 ts_tablet_manager.cc:1449] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.350s user 0.006s sys 0.005s
I20260928 20:03:37.534366 29808 tablet.cc:1751] T 7e09ad691ec3444d938a04a5c572b0cb P b2d286f4404146278f5e0785ed9fcee4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260928 20:03:37.536957 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:37.556120 26794 raft_consensus.cc:2468] T 030f48d0d716450aaa4248d9fb1397ba P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:37.556666 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:37.557881 29382 raft_consensus.cc:2243] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:37.559909 29382 raft_consensus.cc:2272] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:37.562978 29382 ts_tablet_manager.cc:1962] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:37.568775 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:37.570212 26916 tablet_bootstrap.cc:654] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.570755 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:37.575356 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:37.571080 29780 raft_consensus.cc:493] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.576915 26797 raft_consensus.cc:1240] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:37.576145 29780 raft_consensus.cc:515] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.571652 29777 raft_consensus.cc:493] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.578318 29777 raft_consensus.cc:515] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.580425 29777 leader_election.cc:290] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.572160 29764 raft_consensus.cc:493] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.581171 29764 raft_consensus.cc:515] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.584596 29764 leader_election.cc:290] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.586691 29780 leader_election.cc:290] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.595669 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:37.599855 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:37.602633 29780 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.603132 29780 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.605233 29780 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.614455 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:37.518458 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 501146us
I20260928 20:03:37.522509 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.523034 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.523831 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ac9772778c4fe8afc272f98eee2999" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.525676 26656 raft_consensus.cc:1240] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 20:03:37.624351 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:37.627171 29764 raft_consensus.cc:493] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.628239 29764 raft_consensus.cc:515] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.631259 29764 leader_election.cc:290] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:37.649080 26450 leader_election.cc:343] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.529516 26913 raft_consensus.cc:359] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:37.554710 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.592481 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:37.651074 26913 raft_consensus.cc:385] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.651401 26913 raft_consensus.cc:740] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.651981 26913 consensus_queue.cc:260] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:37.653887 26913 ts_tablet_manager.cc:1480] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.198s user 0.006s sys 0.000s
I20260928 20:03:37.631552 26155 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:37.665464 29777 consensus_queue.cc:1059] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260928 20:03:37.667569 29677 raft_consensus.cc:3055] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 3 LEADER]: Stepping down as leader of term 3
I20260928 20:03:37.606700 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.668427 26658 raft_consensus.cc:3060] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.668159 29677 raft_consensus.cc:740] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:37.607785 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:37.608774 26653 raft_consensus.cc:1240] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Rejecting Update request from peer 9b44798af33f4733ba9cde0a1b541f54 for earlier term 1. Current term is 2. Ops: []
W20260928 20:03:37.670264 26450 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:37.671813 26450 leader_election.cc:343] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.611270 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:37.672369 26450 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.672477 26654 raft_consensus.cc:2393] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:37.593457 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:03:37.672891 26450 leader_election.cc:343] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.673295 26646 raft_consensus.cc:3060] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.677057 26658 raft_consensus.cc:2468] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:37.669626 29677 consensus_queue.cc:260] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:37.680101 29677 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Advancing to term 4
I20260928 20:03:37.690212 26646 raft_consensus.cc:2468] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:37.693128 26916 tablet_bootstrap.cc:492] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:37.705628 26595 leader_election.cc:304] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.710803 26912 raft_consensus.cc:359] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.711783 26912 raft_consensus.cc:385] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.712106 26912 raft_consensus.cc:740] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.701426 29575 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.714525 26916 ts_tablet_manager.cc:1449] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.205s user 0.013s sys 0.007s
W20260928 20:03:37.702999 26450 leader_election.cc:343] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:37.715796 26450 leader_election.cc:343] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:37.716492 26450 leader_election.cc:343] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:37.717044 26450 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.717589 26450 leader_election.cc:304] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:37.713268 26912 consensus_queue.cc:260] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.726528 29796 raft_consensus.cc:493] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:37.727242 29796 raft_consensus.cc:515] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.731158 29762 raft_consensus.cc:2749] T d3c3cffa96f043629e4bbfcf282d86bd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.704556 29709 raft_consensus.cc:515] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.736239 29709 leader_election.cc:290] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:37.738739 26450 leader_election.cc:343] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:37.739312 26450 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 3657e36a6d2844c28852db1a4f2ed191
W20260928 20:03:37.739848 26450 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:37.740476 26450 leader_election.cc:343] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.740832 26450 leader_election.cc:304] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.743103 26912 ts_tablet_manager.cc:1480] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.197s user 0.003s sys 0.005s
I20260928 20:03:37.744300 29780 raft_consensus.cc:2749] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.714525 29575 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.741668 29764 raft_consensus.cc:2804] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:37.747442 29764 raft_consensus.cc:697] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:37.748240 29575 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.748210 29764 consensus_queue.cc:237] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:37.748471 29778 consensus_queue.cc:1059] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 20:03:37.749398 29575 raft_consensus.cc:3055] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:37.749698 29575 raft_consensus.cc:740] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:37.750037 26595 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.750411 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:37.751992 29799 raft_consensus.cc:2804] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.752351 29799 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.752815 29799 raft_consensus.cc:3060] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.754261 29575 consensus_queue.cc:260] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.755242 29758 consensus_queue.cc:1048] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:37.755883 29575 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:37.758617 26916 raft_consensus.cc:359] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.760016 26916 raft_consensus.cc:385] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:37.760664 26916 raft_consensus.cc:740] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:37.767741 26916 consensus_queue.cc:260] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.769618 26499 raft_consensus.cc:3060] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.774981 29400 raft_consensus.cc:493] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:37.775174 26916 ts_tablet_manager.cc:1480] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.060s user 0.006s sys 0.000s
I20260928 20:03:37.775602 29400 raft_consensus.cc:515] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.777371 29400 leader_election.cc:290] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:37.779790 26740 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:37.785010 26916 tablet_bootstrap.cc:492] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:37.799634 29796 leader_election.cc:290] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.801033 29382 ts_tablet_manager.cc:1975] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:37.801611 29382 log.cc:1199] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:03:37.802718 29382 ts_tablet_manager.cc:1996] T 12a86cd5167c43a4beb51cd3138cdef8 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:37.817889 26912 tablet_bootstrap.cc:492] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:37.829842 26912 tablet_bootstrap.cc:654] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:37.841219 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 100767us
W20260928 20:03:37.842144 26450 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.842517 26450 leader_election.cc:304] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:37.843436 26450 leader_election.cc:343] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.843776 26450 leader_election.cc:304] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:37.803565 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 49146.9us
I20260928 20:03:37.811517 26913 tablet_bootstrap.cc:492] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:37.859516 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:37.859917 26595 leader_election.cc:304] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.860406 26658 raft_consensus.cc:2393] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:37.861299 26595 leader_election.cc:304] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.861920 29792 raft_consensus.cc:2804] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:37.862275 29792 raft_consensus.cc:493] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:37.862342 29575 raft_consensus.cc:2749] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.862576 29792 raft_consensus.cc:3060] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:37.863186 29575 raft_consensus.cc:2749] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.863310 29755 raft_consensus.cc:2804] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:37.863788 29755 raft_consensus.cc:697] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:37.864562 29755 consensus_queue.cc:237] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.871469 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026]
I20260928 20:03:37.873180 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_faf293f941b845a992e4a5bc2f0d8e97 [id=00b3eb91544b41a1ab2a3b09f4f003ba]
I20260928 20:03:37.871616 26913 tablet_bootstrap.cc:654] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.874960 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]
I20260928 20:03:37.881199 29575 raft_consensus.cc:493] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.881628 29575 raft_consensus.cc:515] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.883543 29575 leader_election.cc:290] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.885776 26595 leader_election.cc:304] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.892794 26499 raft_consensus.cc:2468] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:37.894311 29796 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:37.895473 29796 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.897406 29796 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.913805 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]
I20260928 20:03:37.899438 29762 raft_consensus.cc:2804] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:37.924100 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_18c37f8dfcdb47169eb7230ea02b7b2a [id=03435de0a7f1414ca9387b9a6695e4a4]
I20260928 20:03:37.904016 29799 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.927851 29799 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.929260 29762 raft_consensus.cc:697] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:37.930274 29762 consensus_queue.cc:237] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.934063 29796 raft_consensus.cc:493] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.935539 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02]
I20260928 20:03:37.937450 29796 raft_consensus.cc:515] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.947355 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29]
I20260928 20:03:37.961575 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c]
I20260928 20:03:37.965878 29796 leader_election.cc:290] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:37.872067 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 12) took 9762 ms. Trace:
I20260928 20:03:37.966542 29382 rpcz_store.cc:276] 0928 20:03:28.109842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.109951 (+ 109us) service_pool.cc:224] Handling call
0928 20:03:36.969657 (+8859706us) ts_tablet_manager.cc:1197] Deleting tablet 12a86cd5167c43a4beb51cd3138cdef8
0928 20:03:36.969743 (+ 86us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:37.616621 (+646878us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:37.800882 (+184261us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:37.871986 (+ 71104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":582170,"tablet-delete.queue_time_us":8857352}
I20260928 20:03:37.968156 29382 tablet_replica.cc:333] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:37.968266 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 12a86cd5167c43a4beb51cd3138cdef8 (table default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]) successfully deleted
I20260928 20:03:37.970021 29382 raft_consensus.cc:2243] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
W20260928 20:03:37.902208 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 58788.9us
W20260928 20:03:37.971267 26450 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.971750 26450 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:37.972965 26450 leader_election.cc:343] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: 030f48d0d716450aaa4248d9fb1397ba
I20260928 20:03:37.974447 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_510d412b30ab4062a23624ee27c50764 [id=06e70e3562fa4d06ac62f31df801e152]
I20260928 20:03:37.974319 29816 raft_consensus.cc:2749] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.923417 26916 tablet_bootstrap.cc:654] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:37.946257 29764 raft_consensus.cc:493] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.975907 29764 raft_consensus.cc:515] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.973791 26450 leader_election.cc:304] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.978564 29816 raft_consensus.cc:2804] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:37.978955 29764 leader_election.cc:290] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.968670 29575 raft_consensus.cc:493] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:37.979770 29575 raft_consensus.cc:515] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.979031 29816 raft_consensus.cc:697] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:37.981801 29575 leader_election.cc:290] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:37.982753 29382 raft_consensus.cc:2272] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:37.982009 29816 consensus_queue.cc:237] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.985118 29382 ts_tablet_manager.cc:1962] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:37.980018 26450 leader_election.cc:304] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:37.987417 26450 leader_election.cc:343] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:37.987775 26450 leader_election.cc:304] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.988798 26450 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.989038 29677 raft_consensus.cc:2749] T 74f9252dd72c46b3acf84be7feb6a4f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:37.989419 29777 raft_consensus.cc:2749] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.989660 29677 raft_consensus.cc:2749] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:37.954381 26913 tablet_bootstrap.cc:492] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:37.990573 26913 ts_tablet_manager.cc:1449] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.179s user 0.011s sys 0.000s
I20260928 20:03:37.990422 26450 leader_election.cc:304] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.991104 29677 raft_consensus.cc:2804] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:37.991526 29677 raft_consensus.cc:697] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:37.951606 26595 leader_election.cc:304] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:37.993083 29677 consensus_queue.cc:237] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.982775 29651 consensus_queue.cc:1048] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:37.995733 29755 raft_consensus.cc:2804] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:37.996286 29755 raft_consensus.cc:697] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:37.997144 29755 consensus_queue.cc:237] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.002517 26595 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.004354 29651 raft_consensus.cc:2804] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:38.004469 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb]
I20260928 20:03:38.005141 29651 raft_consensus.cc:697] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:38.006024 29651 consensus_queue.cc:237] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.015030 29792 raft_consensus.cc:515] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.020805 29792 leader_election.cc:290] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.031587 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_17646d9afe134fafb835619843fc9c55 [id=0874aafb30524dd8b985f8806b1ae371]
W20260928 20:03:37.998246 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 91366.5us
I20260928 20:03:38.030033 29705 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.049199 29705 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.052800 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_99563ab39a854e5d9d4d2968f07bfe84 [id=0c98275433a24292b35617002df2cf6b]
I20260928 20:03:38.031284 26740 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:38.053884 29709 raft_consensus.cc:2804] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:38.054683 29709 raft_consensus.cc:697] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:38.055557 29709 consensus_queue.cc:237] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:37.992270 26450 leader_election.cc:304] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:38.057616 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 65401.9us
I20260928 20:03:38.057955 26912 tablet_bootstrap.cc:492] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:38.058470 26912 ts_tablet_manager.cc:1449] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.241s user 0.003s sys 0.013s
I20260928 20:03:38.058540 29677 raft_consensus.cc:2804] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:38.058655 26450 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.059026 29677 raft_consensus.cc:697] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:38.059818 29677 consensus_queue.cc:237] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.060732 26916 tablet_bootstrap.cc:492] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:38.061144 26916 ts_tablet_manager.cc:1449] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.285s user 0.013s sys 0.006s
I20260928 20:03:38.061226 26912 raft_consensus.cc:359] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.061821 26912 raft_consensus.cc:385] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.062064 26912 raft_consensus.cc:740] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.024992 29758 consensus_queue.cc:1048] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:37.986338 26594 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:38.071177 29825 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
W20260928 20:03:38.071460 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 85153.1us
I20260928 20:03:38.071698 29825 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:38.073930 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.074646 26499 raft_consensus.cc:2468] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:38.074725 29825 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:38.074724 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 635 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:38.031942 26913 raft_consensus.cc:359] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.082358 26913 raft_consensus.cc:385] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.082366 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_013206933b0d4b2b9165cc1216c6f2e3 [id=0d47e25ff40148fba54be89b81ab05d4]
I20260928 20:03:38.082707 26913 raft_consensus.cc:740] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.083494 26913 consensus_queue.cc:260] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.085824 26913 ts_tablet_manager.cc:1480] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.095s user 0.005s sys 0.001s
I20260928 20:03:38.047705 26595 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.087476 26595 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.088227 29755 raft_consensus.cc:2804] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:38.088615 29755 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:38.088683 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_007ea4b1225442a2b70ad99fa3bafe73 [id=0d8dd739f4ba4c9baeccfb6cd40490c3]
I20260928 20:03:38.089006 29755 raft_consensus.cc:3060] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.091421 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b]
I20260928 20:03:38.094270 29758 raft_consensus.cc:2804] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:38.094738 29758 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:38.095130 29758 raft_consensus.cc:3060] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.108902 29777 consensus_queue.cc:1059] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:38.071468 26739 leader_election.cc:304] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:38.109889 29777 raft_consensus.cc:2749] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.110066 29778 consensus_queue.cc:1059] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:38.110261 29757 raft_consensus.cc:2749] T 71272e843df3472ab06c4bd0be21d884 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.110551 29777 raft_consensus.cc:3055] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:38.072487 29705 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.078568 26740 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:38.110873 29777 raft_consensus.cc:740] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:38.111223 29764 raft_consensus.cc:3055] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:38.111572 29764 raft_consensus.cc:740] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:38.111712 29757 raft_consensus.cc:2804] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:38.112123 29757 raft_consensus.cc:493] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:38.111609 29777 consensus_queue.cc:260] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.112437 29757 raft_consensus.cc:3060] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.112942 29777 raft_consensus.cc:3060] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:38.112758 29764 consensus_queue.cc:260] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.109004 26912 consensus_queue.cc:260] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.115942 26912 ts_tablet_manager.cc:1480] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.057s user 0.003s sys 0.002s
I20260928 20:03:38.116279 26916 raft_consensus.cc:359] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.116863 26912 tablet_bootstrap.cc:492] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:38.116966 26916 raft_consensus.cc:385] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.117215 26916 raft_consensus.cc:740] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:38.118221 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 58411.8us
I20260928 20:03:38.118997 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]
I20260928 20:03:38.119060 26450 leader_election.cc:304] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.119774 29778 raft_consensus.cc:2804] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:38.120276 29778 raft_consensus.cc:697] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:38.121114 29778 consensus_queue.cc:237] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.124272 29764 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:38.111678 26739 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:38.128599 26739 leader_election.cc:304] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:38.130595 26450 leader_election.cc:304] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.134395 29816 raft_consensus.cc:2804] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:38.134886 29816 raft_consensus.cc:697] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:38.135572 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b786838c638b4e269c6373465a97855f [id=1322b81a3f12437fb5b26c63a6abc9a8]
I20260928 20:03:38.135660 29816 consensus_queue.cc:237] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.137809 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0]
I20260928 20:03:38.129755 26739 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:38.130272 29705 raft_consensus.cc:2749] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260928 20:03:38.131268 29400 raft_consensus.cc:2749] T 41ac9772778c4fe8afc272f98eee2999 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.138824 29757 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.140254 29705 raft_consensus.cc:2749] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.141700 29757 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.142944 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.142460 26916 consensus_queue.cc:260] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.143513 26499 raft_consensus.cc:3060] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.145452 26916 ts_tablet_manager.cc:1480] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.084s user 0.005s sys 0.000s
I20260928 20:03:38.152352 26499 raft_consensus.cc:2468] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:38.152066 29755 raft_consensus.cc:515] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:38.154297 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 54146.1us
I20260928 20:03:38.154407 26740 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:38.155367 26913 tablet_bootstrap.cc:492] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:38.155468 29705 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.155472 26595 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.156059 29705 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.156500 26595 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.157318 29762 consensus_queue.cc:1048] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:38.159133 29705 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.159659 29705 raft_consensus.cc:2804] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:38.160128 29705 raft_consensus.cc:697] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:38.161255 29705 consensus_queue.cc:237] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.162779 29755 leader_election.cc:290] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.164088 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.167644 26499 raft_consensus.cc:2468] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:38.170192 26740 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:38.162513 29758 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.163504 29791 raft_consensus.cc:2749] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.171379 29400 raft_consensus.cc:2804] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:38.166299 29792 raft_consensus.cc:2749] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260928 20:03:38.171701 29400 raft_consensus.cc:493] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:38.171977 29400 raft_consensus.cc:3060] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.173566 26913 tablet_bootstrap.cc:654] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.177359 29758 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.180508 29708 raft_consensus.cc:493] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:38.181097 29708 raft_consensus.cc:515] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.183344 29708 leader_election.cc:290] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.184894 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.189713 29708 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:38.190421 29708 raft_consensus.cc:515] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.193236 26595 leader_election.cc:304] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.195426 29792 raft_consensus.cc:2764] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260928 20:03:38.196076 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 65538.5us
I20260928 20:03:38.196430 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.198220 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.195017 29758 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.198868 29758 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.199280 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e032f645304dbc88a895fae4bbd777" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.199325 29708 leader_election.cc:290] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.199940 29708 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:38.200376 29708 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.201790 29758 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.202566 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.203662 26912 tablet_bootstrap.cc:654] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.203894 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e032f645304dbc88a895fae4bbd777" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.205425 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:38.213392 26595 leader_election.cc:343] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d13562e920244194969520df564a949d
I20260928 20:03:38.219089 29708 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.222307 26595 leader_election.cc:304] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.213919 29832 consensus_queue.cc:1048] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:38.224180 29833 raft_consensus.cc:2749] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.225441 26595 leader_election.cc:304] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.227288 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:38.228427 26595 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:38.230252 26595 leader_election.cc:304] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.228885 29832 raft_consensus.cc:2764] T 61bd0122845044fd993d166824f3b9cc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260928 20:03:38.233002 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.238410 29832 raft_consensus.cc:2749] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.238967 26916 tablet_bootstrap.cc:492] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:38.241031 26595 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:38.242632 26595 leader_election.cc:304] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.251497 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:38.252542 26595 leader_election.cc:343] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d8d27cbf353246fbb7fe09f385194d8a
I20260928 20:03:38.253060 26595 leader_election.cc:304] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.253530 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f337138bc84030a3edf1ec1248d456" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.254652 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b620de746d7346efac926837182aa589 [id=18bdc683ddf64bf2a02bb5902f73933a]
I20260928 20:03:38.251497 29832 raft_consensus.cc:2749] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.255281 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.256842 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f337138bc84030a3edf1ec1248d456" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.261714 29833 raft_consensus.cc:2749] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.263391 26595 leader_election.cc:304] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.260473 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_0823e9b9b5284c5bb8c2752223dc68a4 [id=195a25265b964b7382826f865bcc3022]
I20260928 20:03:38.217935 29400 raft_consensus.cc:515] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.268270 29832 raft_consensus.cc:2749] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.269315 26913 tablet_bootstrap.cc:492] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:38.269346 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_2bd98a3ca12b417aa6115a75f74e752c [id=1967b4ffcea84c8ab364a0e946e5d86b]
I20260928 20:03:38.269897 26913 ts_tablet_manager.cc:1449] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.115s user 0.011s sys 0.001s
I20260928 20:03:38.271718 26595 leader_election.cc:304] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.272794 26913 raft_consensus.cc:359] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.273228 29832 raft_consensus.cc:2749] T edc62660134e45f8bc958e95f4e56906 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.273798 26913 raft_consensus.cc:385] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.274257 26913 raft_consensus.cc:740] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.275002 26595 leader_election.cc:304] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.279044 29832 raft_consensus.cc:2749] T aec2497f4eac4408a37eb2a40122a672 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.280503 26595 leader_election.cc:304] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.252134 26797 raft_consensus.cc:2468] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:38.288303 26912 tablet_bootstrap.cc:492] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:38.291726 26912 ts_tablet_manager.cc:1449] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.175s user 0.008s sys 0.004s
I20260928 20:03:38.292315 29382 ts_tablet_manager.cc:1975] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:38.292738 29382 log.cc:1199] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/91b11022fc774d18b92e0c694f834375
I20260928 20:03:38.287041 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.293571 29382 ts_tablet_manager.cc:1996] T 91b11022fc774d18b92e0c694f834375 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:38.288129 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaae231bea404219875c82340c09df2b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.290459 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807f3ef3db0f4319801baf86a331b98d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.293958 29832 raft_consensus.cc:2749] T 4056bc0590264672bd7c4f6d97050dd5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.291167 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:38.295872 26595 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3
I20260928 20:03:38.305948 26595 leader_election.cc:304] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.308105 29400 leader_election.cc:290] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.311302 29832 raft_consensus.cc:2749] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.312054 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c0cba0a8dbf4476e8c5b101a855ea68b [id=1ba1e6a48ca54423be0f36035c8308b7]
I20260928 20:03:38.275104 26913 consensus_queue.cc:260] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.329011 26912 raft_consensus.cc:359] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.331233 26912 raft_consensus.cc:385] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.331704 26912 raft_consensus.cc:740] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.332610 26912 consensus_queue.cc:260] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.334461 29833 raft_consensus.cc:493] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.334925 29833 raft_consensus.cc:515] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:38.338967 29833 leader_election.cc:290] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.341513 29832 consensus_queue.cc:1048] T d0f9b3c3b4c84b19b4325152899e6b26 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:38.343654 26912 ts_tablet_manager.cc:1480] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.047s user 0.006s sys 0.001s
W20260928 20:03:38.348265 26595 leader_election.cc:343] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 80d7ab92a37c4f9b865fa9fe49d46916
I20260928 20:03:38.349255 26595 leader_election.cc:304] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.349524 26912 tablet_bootstrap.cc:492] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:38.348027 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 14) took 10233 ms. Trace:
I20260928 20:03:38.350270 29832 raft_consensus.cc:2749] T 80d7ab92a37c4f9b865fa9fe49d46916 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:38.353472 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_7f99221c4b2141b0bf6f9d399b4225d9 [id=1c98cebcd6b8483da31aacf5265453f8]
I20260928 20:03:38.354233 29382 rpcz_store.cc:276] 0928 20:03:28.114789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.116468 (+ 1679us) service_pool.cc:224] Handling call
0928 20:03:37.967972 (+9851504us) ts_tablet_manager.cc:1197] Deleting tablet 91b11022fc774d18b92e0c694f834375
0928 20:03:37.968038 (+ 66us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:38.023842 (+ 55804us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:38.292157 (+268315us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:38.347969 (+ 55812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11719,"tablet-delete.queue_time_us":9850836}
I20260928 20:03:38.355648 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.360585 26797 raft_consensus.cc:2468] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:38.358924 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaae231bea404219875c82340c09df2b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.362183 26913 ts_tablet_manager.cc:1480] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.092s user 0.006s sys 0.000s
I20260928 20:03:38.362927 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 91b11022fc774d18b92e0c694f834375 (table default.Table_eaf2b74a92f54fbead13035a6b095ebc [id=23d8489ab3c9424ba65aa2299ec32809]) successfully deleted
I20260928 20:03:38.364097 29382 tablet_replica.cc:333] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
W20260928 20:03:38.367929 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 117104us
W20260928 20:03:38.370512 26739 leader_election.cc:343] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: bd3fa371924149fb814c8458488aea61
I20260928 20:03:38.371071 26739 leader_election.cc:304] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:38.364760 26595 leader_election.cc:304] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.371850 29837 raft_consensus.cc:2749] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.374332 29832 raft_consensus.cc:2749] T b97ad3f841f54aa38bbb312c50db384e P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.384994 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.373925 26913 tablet_bootstrap.cc:492] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:38.393602 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807f3ef3db0f4319801baf86a331b98d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.369628 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.398563 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.403507 26506 raft_consensus.cc:3060] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.404033 26916 tablet_bootstrap.cc:654] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.409643 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]
I20260928 20:03:38.298347 29764 raft_consensus.cc:493] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.410481 29764 raft_consensus.cc:515] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.413065 29764 leader_election.cc:290] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.413609 29764 raft_consensus.cc:493] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.414070 29764 raft_consensus.cc:515] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.376199 26595 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:38.421691 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 45608.5us
I20260928 20:03:38.425071 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9b3e02fb541cab6d0d3c46743ff9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.426999 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9b3e02fb541cab6d0d3c46743ff9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.427513 29833 raft_consensus.cc:2749] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:03:38.428346 29833 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:38.428881 29833 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.429291 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.431427 29833 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.431670 26800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:38.426687 26450 leader_election.cc:343] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.435452 26450 leader_election.cc:343] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.439814 29816 raft_consensus.cc:493] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.439884 29778 raft_consensus.cc:493] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.440747 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c2c1220e1adf428a9a4f66e9b4d701b7 [id=1eebb242f3974ae697935ddbe3403669]
I20260928 20:03:38.440546 29778 raft_consensus.cc:515] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.440502 29816 raft_consensus.cc:515] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.443624 29778 leader_election.cc:290] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.443799 29764 leader_election.cc:290] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.444284 29816 leader_election.cc:290] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.444506 26506 raft_consensus.cc:2468] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:38.448743 26740 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:38.454540 29843 raft_consensus.cc:2804] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260928 20:03:38.454831 26450 leader_election.cc:343] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.456118 26450 leader_election.cc:343] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.456797 29843 raft_consensus.cc:697] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:38.457614 29843 consensus_queue.cc:237] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.460490 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:38.465799 26451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:38.467231 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
W20260928 20:03:38.488417 26450 leader_election.cc:343] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.489099 26450 leader_election.cc:343] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.489624 26450 leader_election.cc:343] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.490162 26450 leader_election.cc:343] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.490823 26450 consensus_peers.cc:597] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dde3191a52b4254944ae1f8556e1632. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:38.499305 29705 raft_consensus.cc:493] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:38.499869 29705 raft_consensus.cc:515] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.506417 29705 leader_election.cc:290] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:38.509270 26740 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211
I20260928 20:03:38.517266 26913 tablet_bootstrap.cc:654] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.518692 26916 tablet_bootstrap.cc:492] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:38.519116 26916 ts_tablet_manager.cc:1449] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.280s user 0.005s sys 0.012s
I20260928 20:03:38.522363 29777 consensus_queue.cc:1048] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:38.525326 26450 leader_election.cc:343] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.525660 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:38.526476 26450 leader_election.cc:343] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.530081 26912 tablet_bootstrap.cc:654] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.530496 26450 leader_election.cc:304] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.531500 29777 raft_consensus.cc:2749] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:38.532773 26450 leader_election.cc:343] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.533116 26450 leader_election.cc:304] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.533715 29777 raft_consensus.cc:2749] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:38.535176 26916 raft_consensus.cc:359] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.535854 26916 raft_consensus.cc:385] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.536098 26916 raft_consensus.cc:740] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.536685 26916 consensus_queue.cc:260] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.537472 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_83090de75bd14a7898987c9d0c93b871 [id=1f5468b83cf74cd49cde65514c10c24d]
W20260928 20:03:38.537832 26450 leader_election.cc:343] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.538215 26450 leader_election.cc:304] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.541488 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c68f60885a0940f583aa139abd8a834a [id=1fd0e6f7ff6b4552b40c8d2afce48966]
I20260928 20:03:38.544862 29777 raft_consensus.cc:2749] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:38.562402 26450 leader_election.cc:343] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.562826 26450 leader_election.cc:304] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.563835 26916 ts_tablet_manager.cc:1480] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.044s user 0.000s sys 0.007s
I20260928 20:03:38.567238 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8d26e012313e4a30b824a5f081aa548d [id=219bcf821c96465eb48c3199ea6f4237]
I20260928 20:03:38.569852 29382 raft_consensus.cc:2243] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:38.570343 29777 raft_consensus.cc:2749] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:38.573601 29382 raft_consensus.cc:2272] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:38.575765 29382 ts_tablet_manager.cc:1962] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:38.578709 26450 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:03:38.579510 29777 raft_consensus.cc:2804] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:38.579831 29777 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:38.580150 29777 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:38.596824 29832 raft_consensus.cc:493] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.601233 29834 raft_consensus.cc:493] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.605155 26916 tablet_bootstrap.cc:492] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:38.597584 29832 raft_consensus.cc:515] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.605868 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.608057 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.608142 29832 leader_election.cc:290] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.602025 29834 raft_consensus.cc:515] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.612533 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3697e383390b4709b95e01cb55f17c34 [id=23a824778def463ebc96837ae1766677]
I20260928 20:03:38.613057 29777 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.614434 29816 consensus_queue.cc:1048] T d3c3cffa96f043629e4bbfcf282d86bd P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:38.615048 29834 leader_election.cc:290] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.623214 26450 leader_election.cc:304] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8
I20260928 20:03:38.623317 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.624605 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.625264 29816 raft_consensus.cc:2804] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:38.625795 29816 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:38.626250 29816 raft_consensus.cc:3060] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.628167 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.631618 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.632310 26794 raft_consensus.cc:2468] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:38.641223 29816 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:38.642931 26450 leader_election.cc:343] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.643438 26450 leader_election.cc:304] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.644218 29764 raft_consensus.cc:2749] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:38.645709 26450 leader_election.cc:343] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.646203 26450 leader_election.cc:304] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.649250 26912 tablet_bootstrap.cc:492] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:38.649808 26912 ts_tablet_manager.cc:1449] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.301s user 0.013s sys 0.008s
I20260928 20:03:38.650789 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.652983 29777 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.661525 29764 raft_consensus.cc:2749] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:38.662369 29764 raft_consensus.cc:493] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.662846 29764 raft_consensus.cc:515] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.665109 29764 leader_election.cc:290] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:38.668933 26450 leader_election.cc:343] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.670953 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_12847c70617446c79bef47447bba6e7f [id=24710d0e366c44a0b041c457b40e9385]
I20260928 20:03:38.672304 29792 raft_consensus.cc:493] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:38.672693 26913 tablet_bootstrap.cc:492] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:38.673159 26913 ts_tablet_manager.cc:1449] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.302s user 0.010s sys 0.006s
I20260928 20:03:38.672768 29792 raft_consensus.cc:515] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.675781 29792 leader_election.cc:290] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.682654 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a]
I20260928 20:03:38.683327 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.676177 26450 leader_election.cc:304] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.686569 29764 raft_consensus.cc:2749] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:38.687942 26450 leader_election.cc:343] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.688527 26450 leader_election.cc:304] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:38.689276 29764 raft_consensus.cc:2749] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:38.691118 29816 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.685144 26912 raft_consensus.cc:359] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.693305 26912 raft_consensus.cc:385] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.693995 29777 raft_consensus.cc:493] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.694648 29777 raft_consensus.cc:515] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:38.693665 26912 raft_consensus.cc:740] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.695719 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:38.696349 26912 consensus_queue.cc:260] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.696483 29777 leader_election.cc:290] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.701503 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bce47a5ab1a44989abe1761cab0c714" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.704360 26912 ts_tablet_manager.cc:1480] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.051s user 0.003s sys 0.003s
I20260928 20:03:38.705288 26912 tablet_bootstrap.cc:492] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:38.706497 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a15ae85ff48d897493156fdd41d3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.713245 29382 ts_tablet_manager.cc:1975] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:38.713972 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.714696 26659 raft_consensus.cc:2468] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:38.719914 26800 raft_consensus.cc:1275] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Refusing update from remote peer 9b44798af33f4733ba9cde0a1b541f54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260928 20:03:38.704357 26913 raft_consensus.cc:359] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:38.723290 26913 raft_consensus.cc:385] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:38.723544 26913 raft_consensus.cc:740] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:38.720517 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.721071 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bce47a5ab1a44989abe1761cab0c714" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.721763 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a15ae85ff48d897493156fdd41d3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.726330 29382 log.cc:1199] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/03509d3602b345f69f059ae11c461920
I20260928 20:03:38.728880 29382 ts_tablet_manager.cc:1996] T 03509d3602b345f69f059ae11c461920 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:38.677048 26916 tablet_bootstrap.cc:654] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.736876 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:38.739228 26913 consensus_queue.cc:260] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:38.741230 26913 ts_tablet_manager.cc:1480] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.068s user 0.005s sys 0.001s
I20260928 20:03:38.741230 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.741762 26797 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:38.748176 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de40520ccd9b4a52a45c4085afd45b2d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.749531 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de40520ccd9b4a52a45c4085afd45b2d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.752152 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:38.755841 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:38.756485 26799 raft_consensus.cc:3060] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.756784 26797 raft_consensus.cc:2468] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 2.
I20260928 20:03:38.761137 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 13) took 10646 ms. Trace:
I20260928 20:03:38.767561 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.768965 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb02b1f6bf4e43a08a3331438bf8e362" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:38.771286 26799 raft_consensus.cc:2468] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:38.766549 29382 rpcz_store.cc:276] 0928 20:03:28.114486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.116585 (+ 2099us) service_pool.cc:224] Handling call
0928 20:03:38.363927 (+10247342us) ts_tablet_manager.cc:1197] Deleting tablet 03509d3602b345f69f059ae11c461920
0928 20:03:38.363996 (+ 69us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:38.599961 (+235965us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:38.713113 (+113152us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:38.761069 (+ 47956us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167393,"tablet-delete.queue_time_us":10246774}
I20260928 20:03:38.779433 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 03509d3602b345f69f059ae11c461920 (table default.Table_71dac26ca689411e89880e236cf117b6 [id=ceab34b317af44bf824578d2a64457c9]) successfully deleted
I20260928 20:03:38.780678 29382 tablet_replica.cc:333] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:38.786477 29764 raft_consensus.cc:493] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.786978 29764 raft_consensus.cc:515] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.789577 29764 leader_election.cc:290] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.790256 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.697536 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:38.795878 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b2dd9c6b864bb68925bf0687fb67d7" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.796465 26506 raft_consensus.cc:3060] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.797426 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:38.799718 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_26df3b482a9148f592e434c9a0d02b0a [id=2c5ef36e0ca548d78e27a4cc047c1b59]
I20260928 20:03:38.799901 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:38.801756 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:38.806738 26506 raft_consensus.cc:2468] T d1b2dd9c6b864bb68925bf0687fb67d7 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:38.790727 26913 tablet_bootstrap.cc:492] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:38.801714 26646 raft_consensus.cc:2393] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:38.811357 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.812175 26505 raft_consensus.cc:2393] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:38.818287 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:38.819510 26659 raft_consensus.cc:2393] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:38.809950 29382 raft_consensus.cc:2243] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:38.822619 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.823369 26659 raft_consensus.cc:2393] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:38.825012 29382 raft_consensus.cc:2272] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:38.826992 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.827818 26498 raft_consensus.cc:2468] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:38.828531 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e47444ae914b07a7e3e64711423635" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.829851 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.830886 26505 raft_consensus.cc:2410] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 20:03:38.811409 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d1af02ecb8456c8354ede7872b1ffb" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.833290 26506 raft_consensus.cc:2393] T 48d1af02ecb8456c8354ede7872b1ffb P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:38.836625 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.840711 29843 raft_consensus.cc:493] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.841614 29843 raft_consensus.cc:515] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.845165 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6aaf0a2434c1fb74dd313fd4b7116" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:38.826713 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b4f6fb24e5d14de3afcb16e1fded33fd [id=2c8fc0970bcb4a83bfd995dcb6ecdf1d]
I20260928 20:03:38.848558 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:38.849407 26646 raft_consensus.cc:2393] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:38.853080 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c909970e41b44433885b634d80002868 [id=2e3160a2ecb54b22a2a543498ec403b0]
I20260928 20:03:38.858747 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.859297 26510 raft_consensus.cc:3060] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.859464 29382 ts_tablet_manager.cc:1962] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:38.865010 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.865878 26500 raft_consensus.cc:2468] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:38.869527 26510 raft_consensus.cc:2468] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:38.873078 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_039c27c2317f4d218f78454b1adcde10 [id=30d0193942bb4680bd08e5ed6064b8ac]
I20260928 20:03:38.874753 26913 tablet_bootstrap.cc:654] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.869577 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.876266 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3566ccc08d42d3a01d567430d1bc4b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.879487 26500 raft_consensus.cc:3060] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:38.879959 26509 raft_consensus.cc:2393] T 6f3566ccc08d42d3a01d567430d1bc4b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:38.893131 26912 tablet_bootstrap.cc:654] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:38.897838 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.899493 26510 raft_consensus.cc:2393] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:38.898986 29843 leader_election.cc:290] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.910348 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ae88901a72984d6a8f4f4a4943fec19f [id=3133dce22f354cf38834989aef48f005]
I20260928 20:03:38.911912 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a72e3f79d3d14d36b9c10099dbdde698 [id=327206ba45a84f26afeea20f363595af]
I20260928 20:03:38.924100 26500 raft_consensus.cc:2468] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:38.930930 29862 tablet.cc:1751] T 7e09ad691ec3444d938a04a5c572b0cb P 9b44798af33f4733ba9cde0a1b541f54: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260928 20:03:38.933645 26594 leader_election.cc:343] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:38.934993 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8fd74e2df9b84a1e998370b85625e609 [id=334efebe93f24b3d98e6a649ec121da4]
W20260928 20:03:38.935490 26594 leader_election.cc:343] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.936633 26594 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:38.945436 26594 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:38.953526 29705 raft_consensus.cc:493] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.954308 29705 raft_consensus.cc:515] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:38.957989 29705 leader_election.cc:290] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:38.943552 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]
I20260928 20:03:38.965463 29834 raft_consensus.cc:493] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:38.965950 29834 raft_consensus.cc:515] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:38.967069 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ff6225f056a84389992b4f66f946fb3e [id=3749b65af21b404e8a638dfc03035266]
I20260928 20:03:38.968143 29834 leader_election.cc:290] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:38.969728 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b6e9471784104b748304857c18d1c3c8 [id=37c8252e29f9443bb978a9ee2b863bf2]
I20260928 20:03:38.978470 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_d90e6a6913a54889810926926798a1b4 [id=3a5c78e561ee43729940d404c103ab3f]
W20260928 20:03:38.991724 26594 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542
W20260928 20:03:38.996068 26594 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
I20260928 20:03:38.996073 29843 consensus_queue.cc:1048] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:38.940829 26916 tablet_bootstrap.cc:492] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:38.960788 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.998461 26916 ts_tablet_manager.cc:1449] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.394s user 0.013s sys 0.000s
I20260928 20:03:38.992677 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7017fddff974abda74574e39fd4e37c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:38.999205 26506 raft_consensus.cc:2393] T f7017fddff974abda74574e39fd4e37c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:38.995473 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:38.999891 26502 raft_consensus.cc:2468] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:39.000774 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:39.000878 26916 raft_consensus.cc:359] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.001370 26505 raft_consensus.cc:2468] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:39.001518 26916 raft_consensus.cc:385] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.001757 26916 raft_consensus.cc:740] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.001716 29843 consensus_queue.cc:1048] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.002516 26916 consensus_queue.cc:260] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.003957 26916 ts_tablet_manager.cc:1480] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260928 20:03:39.004786 26916 tablet_bootstrap.cc:492] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:38.998127 26594 leader_election.cc:343] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:39.005667 26594 leader_election.cc:343] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:39.008322 26594 leader_election.cc:343] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.008879 29382 ts_tablet_manager.cc:1975] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:39.018518 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015]
I20260928 20:03:39.022791 26594 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:39.025261 29834 raft_consensus.cc:2804] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:39.025359 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:39.025930 29834 raft_consensus.cc:493] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.026288 29834 raft_consensus.cc:3060] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:39.026763 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:39.023119 26912 tablet_bootstrap.cc:492] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:39.029968 26912 ts_tablet_manager.cc:1449] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.325s user 0.012s sys 0.006s
W20260928 20:03:39.030572 26594 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 3657e36a6d2844c28852db1a4f2ed191
I20260928 20:03:39.026171 26794 raft_consensus.cc:3060] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:39.032063 26594 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.040191 26912 raft_consensus.cc:359] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.043685 26912 raft_consensus.cc:385] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.044548 26912 raft_consensus.cc:740] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.046808 26912 consensus_queue.cc:260] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.053654 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:39.054320 26511 raft_consensus.cc:2468] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:39.076547 26594 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:39.077306 26912 ts_tablet_manager.cc:1480] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
W20260928 20:03:39.077948 26594 leader_election.cc:343] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:39.082489 26594 consensus_peers.cc:597] T 03509d3602b345f69f059ae11c461920 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:39.082999 29382 log.cc:1199] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:39.083781 29382 ts_tablet_manager.cc:1996] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:39.083922 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:39.084522 26511 raft_consensus.cc:2468] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:39.085599 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.088397 29834 raft_consensus.cc:515] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.094406 26912 tablet_bootstrap.cc:492] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:39.102574 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_92cd775d03ce43259e1527778a376855 [id=3bc1c712116e4b1bae264afc0f8030ed]
I20260928 20:03:39.106866 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:39.107468 26510 raft_consensus.cc:2468] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:39.110548 26916 tablet_bootstrap.cc:654] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.098704 26913 tablet_bootstrap.cc:492] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:39.112022 26913 ts_tablet_manager.cc:1449] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.370s user 0.014s sys 0.004s
I20260928 20:03:39.114313 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727fac90955d49caac8f1fa1567336b5" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.115185 26646 raft_consensus.cc:2393] T 727fac90955d49caac8f1fa1567336b5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:39.115712 26913 raft_consensus.cc:359] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.116475 26913 raft_consensus.cc:385] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.116765 26913 raft_consensus.cc:740] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.117408 26913 consensus_queue.cc:260] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.123865 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76c64607c9425fb5c837cb856c852c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.124341 26595 leader_election.cc:304] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.135597 26595 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.137210 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 15) took 11022 ms. Trace:
I20260928 20:03:39.137239 29755 raft_consensus.cc:2804] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:39.137955 29755 raft_consensus.cc:697] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:39.138768 29755 consensus_queue.cc:237] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.140555 29792 raft_consensus.cc:2749] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:39.144716 26595 leader_election.cc:343] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: fa49943f465f47778ac985cb5f4e6c0f
I20260928 20:03:39.145284 26595 leader_election.cc:304] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.148922 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:39.145809 29758 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.145735 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76c64607c9425fb5c837cb856c852c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.150044 29758 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.150555 26595 leader_election.cc:304] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.151522 29832 raft_consensus.cc:2749] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.152678 29792 raft_consensus.cc:2804] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:39.152841 29758 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.153064 29792 raft_consensus.cc:493] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.153378 29792 raft_consensus.cc:3060] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.158195 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_e81ad7e3711e4f25a6051f1ce257d20a [id=3da22346865f4613910dedb2fad45dc7]
I20260928 20:03:39.162765 26595 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.168310 29792 raft_consensus.cc:515] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.168768 29764 raft_consensus.cc:493] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.169222 29764 raft_consensus.cc:515] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.172677 29764 leader_election.cc:290] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:39.123594 26594 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c
W20260928 20:03:39.175936 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 52362.3us
I20260928 20:03:39.126149 26913 ts_tablet_manager.cc:1480] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260928 20:03:39.180294 26916 tablet_bootstrap.cc:492] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:39.180934 26916 ts_tablet_manager.cc:1449] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.176s user 0.010s sys 0.001s
I20260928 20:03:39.185850 26916 raft_consensus.cc:359] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.188328 26916 raft_consensus.cc:385] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.188640 26916 raft_consensus.cc:740] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.171341 26804 raft_consensus.cc:3060] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.189323 26916 consensus_queue.cc:260] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.186421 29833 raft_consensus.cc:2749] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.184996 29834 leader_election.cc:290] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.200210 26913 tablet_bootstrap.cc:492] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:39.203971 26916 ts_tablet_manager.cc:1480] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260928 20:03:39.203316 29382 rpcz_store.cc:276] 0928 20:03:28.115058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.117200 (+ 2142us) service_pool.cc:224] Handling call
0928 20:03:38.780478 (+10663278us) ts_tablet_manager.cc:1197] Deleting tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
0928 20:03:38.780548 (+ 70us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:38.934423 (+153875us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:39.008750 (+ 74327us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:39.137147 (+128397us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10662657}
W20260928 20:03:39.204640 26594 consensus_peers.cc:597] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:39.205338 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 (table default.Table_6ad2a1c67f69404f894b3deadc055fba [id=259f91142592489a9885a228943b5d11]) successfully deleted
I20260928 20:03:39.208371 29382 tablet_replica.cc:333] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:39.210284 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3]
I20260928 20:03:39.212199 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_1a915ed0be934873a38f26d9661704fe [id=3ea7cdba6c2c4775aa2404a40482f3f4]
I20260928 20:03:39.213881 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_e264a6fddc5a48aa9d2746b30ae7aa07 [id=41a61dca03a547108d47b214ba83b90f]
I20260928 20:03:39.206312 29792 leader_election.cc:290] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.214278 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:39.218063 29778 raft_consensus.cc:493] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.218642 29778 raft_consensus.cc:515] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.221344 29778 leader_election.cc:290] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.223759 29778 raft_consensus.cc:493] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.224673 29778 raft_consensus.cc:515] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.228892 29778 leader_election.cc:290] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:39.230675 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 55556.4us
I20260928 20:03:39.218160 29764 raft_consensus.cc:493] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.232465 26595 leader_election.cc:304] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.232621 29764 raft_consensus.cc:515] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.233157 29758 raft_consensus.cc:2749] T 48d1af02ecb8456c8354ede7872b1ffb P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260928 20:03:39.236650 26595 leader_election.cc:343] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 3eb8477c5cb74205b4b55eb38d7f9542
I20260928 20:03:39.237241 26595 leader_election.cc:304] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.237938 29758 raft_consensus.cc:2749] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.237968 29764 leader_election.cc:290] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.239087 29816 raft_consensus.cc:493] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.239616 29816 raft_consensus.cc:515] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.241603 29816 leader_election.cc:290] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.243161 29816 consensus_queue.cc:1048] T 1dde3191a52b4254944ae1f8556e1632 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.003s
W20260928 20:03:39.247119 26595 leader_election.cc:343] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: b667a45712c1449384e1a288f55fd062
I20260928 20:03:39.247378 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:39.248360 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_45db10c8c743416a901b9737ed72fb04 [id=42107b9751ab49cc85c2946d96002440]
W20260928 20:03:39.249058 26450 leader_election.cc:343] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:39.249719 26450 leader_election.cc:343] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:39.250276 26450 leader_election.cc:343] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.250344 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f]
I20260928 20:03:39.251673 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_39e9fc84df3844129902f8bb568244e2 [id=43ecf4974c7f4dc7a1ebcb5091d78076]
I20260928 20:03:39.252875 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_4a912910bc1f4d59b94845c363144d28 [id=44987915fb2445b5b13c7df9db3e40e8]
W20260928 20:03:39.254220 26450 leader_election.cc:343] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.254889 26450 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:39.255596 29764 raft_consensus.cc:2804] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:39.255890 26450 leader_election.cc:304] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:39.256049 29764 raft_consensus.cc:697] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [term 2 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:39.256896 29764 consensus_queue.cc:237] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.257629 26912 tablet_bootstrap.cc:654] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.257503 26595 leader_election.cc:304] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.263626 29792 raft_consensus.cc:2749] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.268934 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_28cdbc10adcb4b9da604e5bab2dda740 [id=44c95fceecbd42a38a0e6b240cc4b680]
I20260928 20:03:39.269694 26913 tablet_bootstrap.cc:654] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.272285 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_05c17087f17c40ccaef5290a60a1234d [id=45a830baeeb54dcdb2109f053a9413ac]
I20260928 20:03:39.272334 29777 raft_consensus.cc:2804] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:39.272926 29777 raft_consensus.cc:697] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:39.275038 26595 leader_election.cc:304] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.274788 29777 consensus_queue.cc:237] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.283581 29834 raft_consensus.cc:2804] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:39.284204 29834 raft_consensus.cc:493] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.284593 29834 raft_consensus.cc:3060] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.286984 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a4c5888ebf824ce6934efcc6b4257595 [id=462e52b478724a6eb3ce35b6206673e3]
W20260928 20:03:39.291299 26450 leader_election.cc:343] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.292273 29816 consensus_queue.cc:1048] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:39.301126 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 83328.3us
I20260928 20:03:39.304936 26595 leader_election.cc:304] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:39.305258 26450 consensus_peers.cc:597] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:39.306069 29777 consensus_queue.cc:1048] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.307672 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_797ad827e0e34feb927d0abdb8b9ab1a [id=4714dc67744c4ef2817fc28b16820547]
W20260928 20:03:39.309729 26450 leader_election.cc:343] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.310240 26450 leader_election.cc:304] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.311841 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_448e0060fd3d49018e59b4875da55674 [id=474b74c08e6348da8e5de4405064735f]
I20260928 20:03:39.312927 29832 raft_consensus.cc:2749] T 6f3566ccc08d42d3a01d567430d1bc4b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.314196 26595 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.315819 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]
I20260928 20:03:39.315044 29832 raft_consensus.cc:493] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:39.319275 29832 raft_consensus.cc:515] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.320644 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0]
I20260928 20:03:39.322021 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c2e7429ecbd942bd908a88d634de17c6 [id=4a90001d3d204a01929c3a0d03e0bcc6]
W20260928 20:03:39.323141 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 115366us
I20260928 20:03:39.322945 29832 leader_election.cc:290] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.326926 29832 raft_consensus.cc:2804] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:39.328058 29832 raft_consensus.cc:697] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:39.329588 29832 consensus_queue.cc:237] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.331519 29816 raft_consensus.cc:2749] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.332373 26739 leader_election.cc:304] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:39.333122 26450 leader_election.cc:343] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.335057 26450 leader_election.cc:304] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.339222 29777 raft_consensus.cc:2749] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.340842 26450 leader_election.cc:304] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.343129 29777 raft_consensus.cc:2804] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:39.343578 29777 raft_consensus.cc:493] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.339581 26595 leader_election.cc:304] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.344058 29777 raft_consensus.cc:3060] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.346853 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7]
I20260928 20:03:39.348286 26739 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:39.350257 26450 leader_election.cc:343] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.352823 29651 raft_consensus.cc:2804] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:39.348910 29885 raft_consensus.cc:2749] T 01e47444ae914b07a7e3e64711423635 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.353293 29651 raft_consensus.cc:697] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:39.354307 29882 raft_consensus.cc:2749] T e868e5a3ebd2494ca20e1e08a146850e P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.354089 29651 consensus_queue.cc:237] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.355190 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_419bbb75ac2d4717b1cb696825cf70dc [id=4ad6473396cd4040b3abda93d38b0428]
I20260928 20:03:39.356245 26450 leader_election.cc:304] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.357174 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:39.357388 26739 leader_election.cc:304] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:39.359874 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_f9542fb9d4054fec841718053fedb559 [id=4d41cf8ff46f412b8c28cfd2279268e8]
I20260928 20:03:39.362275 29816 raft_consensus.cc:2749] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.362629 29882 raft_consensus.cc:2749] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:39.367755 26450 leader_election.cc:343] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.373796 26450 leader_election.cc:304] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.375166 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_52834d7c9e064555a1ed3e9cd8b98e34 [id=4e50219ff53c4c6c94eec881bb4cfe75]
W20260928 20:03:39.378295 26739 leader_election.cc:343] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Not found: Tablet not found: ed48087b59c744f9a928c8d529b69211
I20260928 20:03:39.379089 29816 raft_consensus.cc:2749] T eb02b1f6bf4e43a08a3331438bf8e362 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.380771 26739 leader_election.cc:304] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
W20260928 20:03:39.385372 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.634s (SENT)
I20260928 20:03:39.385799 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
W20260928 20:03:39.397176 26450 consensus_peers.cc:597] T 030f48d0d716450aaa4248d9fb1397ba P 9b44798af33f4733ba9cde0a1b541f54 -> Peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Couldn't send request to peer 92fd8074a7df4bba87a73c0d84ed00c8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 030f48d0d716450aaa4248d9fb1397ba. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:39.408186 29840 raft_consensus.cc:2749] T ed48087b59c744f9a928c8d529b69211 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.421294 29894 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260928 20:03:39.422895 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 53247.1us
I20260928 20:03:39.430832 26595 leader_election.cc:304] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.439749 26739 leader_election.cc:304] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:39.442535 29843 raft_consensus.cc:2749] T cf1ac58577c345ee817e45b340601185 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.446547 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:39.416167 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:39.440984 26916 tablet_bootstrap.cc:492] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:39.450322 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 53274.8us
W20260928 20:03:39.450984 26450 leader_election.cc:343] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.451336 26450 leader_election.cc:304] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.455273 29777 raft_consensus.cc:515] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.462622 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:39.460515 26916 tablet_bootstrap.cc:654] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.467396 26595 leader_election.cc:304] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.434211 26913 tablet_bootstrap.cc:492] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:39.468331 26913 ts_tablet_manager.cc:1449] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.268s user 0.015s sys 0.003s
I20260928 20:03:39.385716 29834 raft_consensus.cc:515] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.471659 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:39.471621 29834 leader_election.cc:290] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.460469 29892 raft_consensus.cc:493] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:39.472483 29892 raft_consensus.cc:515] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:39.474529 29892 leader_election.cc:290] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.478416 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:39.482709 29764 raft_consensus.cc:2749] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.485457 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_80b7e921026a449aac1078cb8ef22d63 [id=520a43e0bc5d418a9e1e2227a8e65249]
I20260928 20:03:39.485606 29816 consensus_queue.cc:1048] T 727fac90955d49caac8f1fa1567336b5 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:39.490289 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c6e3b12edab441c89f9e255a1a1a001c [id=54949ec9d297437d8f79a73d487f9b7e]
I20260928 20:03:39.491338 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92397ac1a63a46e591e699e76627d5db" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.492097 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.493256 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.493168 29890 raft_consensus.cc:2749] T f7017fddff974abda74574e39fd4e37c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.493743 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13a571f3bd34209b0e6fd9441055eb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.494056 29890 raft_consensus.cc:2804] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:39.494433 29890 raft_consensus.cc:493] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.494801 29890 raft_consensus.cc:3060] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:39.496518 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 55774.1us
I20260928 20:03:39.496977 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353]
I20260928 20:03:39.497592 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13a571f3bd34209b0e6fd9441055eb1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.498939 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92397ac1a63a46e591e699e76627d5db" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.498926 26913 raft_consensus.cc:359] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.499627 26913 raft_consensus.cc:385] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.499876 26913 raft_consensus.cc:740] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.500820 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.501039 26913 consensus_queue.cc:260] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.502597 26659 raft_consensus.cc:2468] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:39.503031 26595 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.505031 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.506281 29777 leader_election.cc:290] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.508422 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a343f55509fc4555836efe7503996740 [id=569aa44462c74840b9cd56304974e74e]
I20260928 20:03:39.509379 29893 raft_consensus.cc:2804] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:39.509908 26739 leader_election.cc:304] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:39.509873 29893 raft_consensus.cc:493] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:39.511240 29843 raft_consensus.cc:2749] T 727fac90955d49caac8f1fa1567336b5 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.511538 29893 raft_consensus.cc:3060] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:39.514216 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:39.519412 26912 tablet_bootstrap.cc:492] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:39.520098 26912 ts_tablet_manager.cc:1449] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.426s user 0.022s sys 0.012s
I20260928 20:03:39.526645 26913 ts_tablet_manager.cc:1480] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.058s user 0.004s sys 0.002s
W20260928 20:03:39.526722 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 97296us
I20260928 20:03:39.531533 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:39.534981 29896 consensus_queue.cc:1048] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:39.535732 26916 tablet_bootstrap.cc:492] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:39.536213 26916 ts_tablet_manager.cc:1449] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.095s user 0.005s sys 0.008s
I20260928 20:03:39.542420 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_92b4d9ef87464f9b9b5582e6d529ac49 [id=57fa893f8f0f41fdb40c0150e9270d37]
W20260928 20:03:39.543737 26595 leader_election.cc:343] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 23d262c7a15b434d8caea0a818323dd1
I20260928 20:03:39.548270 29777 raft_consensus.cc:493] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:39.548907 29777 raft_consensus.cc:515] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.550890 29777 leader_election.cc:290] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.551906 26916 raft_consensus.cc:359] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.552184 26595 leader_election.cc:304] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.552652 26916 raft_consensus.cc:385] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.552958 26916 raft_consensus.cc:740] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.553673 26916 consensus_queue.cc:260] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.554680 26595 leader_election.cc:304] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.556304 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:39.551831 26913 tablet_bootstrap.cc:492] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:39.556445 29896 raft_consensus.cc:2749] T 23d262c7a15b434d8caea0a818323dd1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.568004 29834 raft_consensus.cc:2804] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:39.568359 29834 raft_consensus.cc:493] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.568701 29834 raft_consensus.cc:3060] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.584769 29890 raft_consensus.cc:515] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:39.588829 29900 raft_consensus.cc:493] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.589123 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f7b05e756f4a4db5031ff1e14c6ff6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.589286 29900 raft_consensus.cc:515] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.591368 29900 leader_election.cc:290] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.592684 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:39.593448 26499 raft_consensus.cc:2393] T 9491e639008c4678814d2f72beb04c3c P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:39.598994 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.607198 29843 consensus_queue.cc:1048] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.612149 26154 catalog_manager.cc:5938] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:39.619370 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8691e84d63084dd38d8988f4311c83c6 [id=5bcb1e3b9dec45df8affc72f783620c1]
I20260928 20:03:39.620782 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b535172c333e41bba212d17bbb3a0a13 [id=5c5d5de98b4047919b9ded842e422341]
I20260928 20:03:39.621333 26912 raft_consensus.cc:359] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.622094 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd]
I20260928 20:03:39.623624 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd]
I20260928 20:03:39.636989 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_75a90a6806eb4588bfc09ac96125f4df [id=6029f28219a24f429bf99d14baa35339]
I20260928 20:03:39.637183 29777 raft_consensus.cc:493] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.637789 29777 raft_consensus.cc:515] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.623476 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:39.625953 26793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.639938 26797 raft_consensus.cc:3060] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:39.636322 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:39.637988 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:39.642119 29777 leader_election.cc:290] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.649737 26912 raft_consensus.cc:385] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.650269 26912 raft_consensus.cc:740] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.590929 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06f7b05e756f4a4db5031ff1e14c6ff6" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.593918 29834 raft_consensus.cc:515] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:39.605768 26595 leader_election.cc:343] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 0a2d13d16d9946c6b09f9197c165033c
I20260928 20:03:39.657085 26595 leader_election.cc:304] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:39.658082 29895 raft_consensus.cc:2749] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:39.658757 29834 leader_election.cc:290] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:39.659459 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 53725.8us
I20260928 20:03:39.667992 26797 raft_consensus.cc:2468] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:39.614851 26913 tablet_bootstrap.cc:654] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.669332 29890 leader_election.cc:290] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.674922 26595 leader_election.cc:304] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:39.677399 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c3346e3db1400c98623724cdf54901" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:39.677968 26503 raft_consensus.cc:3060] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:39.637311 26916 ts_tablet_manager.cc:1480] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.101s user 0.006s sys 0.000s
I20260928 20:03:39.678810 29895 raft_consensus.cc:2804] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:39.679198 29895 raft_consensus.cc:493] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:39.679556 29895 raft_consensus.cc:3060] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.681077 26916 tablet_bootstrap.cc:492] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:39.680962 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.682473 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.684777 29382 raft_consensus.cc:2243] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:39.695708 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_636f6d3fbd7f43a68d2d233b97ee65b9 [id=62a432d0a82e48efb93877e3c46cb37b]
I20260928 20:03:39.697821 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]
I20260928 20:03:39.701665 26503 raft_consensus.cc:2468] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:39.705960 26913 tablet_bootstrap.cc:492] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:39.706648 26913 ts_tablet_manager.cc:1449] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.155s user 0.005s sys 0.008s
I20260928 20:03:39.651144 26912 consensus_queue.cc:260] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.633152 29893 raft_consensus.cc:515] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.649379 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:39.711678 26653 raft_consensus.cc:3060] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.713529 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0133314d6de46cea61a9260df79bdea" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.714082 29382 raft_consensus.cc:2272] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:03:39.716174 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 51678.7us
I20260928 20:03:39.716287 26803 raft_consensus.cc:3060] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.716248 29382 ts_tablet_manager.cc:1962] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:39.719588 26791 raft_consensus.cc:1240] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Rejecting Update request from peer 92fd8074a7df4bba87a73c0d84ed00c8 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:39.719925 29885 raft_consensus.cc:493] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.720346 26653 raft_consensus.cc:2468] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:39.720700 29885 raft_consensus.cc:515] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.723414 29893 leader_election.cc:290] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.724496 29885 leader_election.cc:290] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:39.726331 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:39.726529 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:39.727247 26515 raft_consensus.cc:2393] T 45dd4297f4aa400aa3be253bc3168390 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:39.731791 26912 ts_tablet_manager.cc:1480] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.210s user 0.006s sys 0.002s
I20260928 20:03:39.732841 26912 tablet_bootstrap.cc:492] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:39.763451 29777 raft_consensus.cc:493] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:39.766403 29777 raft_consensus.cc:515] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:39.766883 29764 raft_consensus.cc:493] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:39.767234 29897 raft_consensus.cc:493] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:39.767534 29764 raft_consensus.cc:515] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.767722 29897 raft_consensus.cc:515] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.765765 29816 raft_consensus.cc:493] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.770639 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_66b4fb7dfd10446d99fa01b7f3b019ec [id=639bd5507dc14745860aadffb4b7c94e]
I20260928 20:03:39.772563 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c628c1a16db34a3fbc9c818e95ad5f7a [id=65d9b7804d5e4d008d31a84cccc3458f]
I20260928 20:03:39.763217 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:39.774686 29778 consensus_queue.cc:1048] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.775314 29897 leader_election.cc:290] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.776180 29816 raft_consensus.cc:515] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.776767 29764 leader_election.cc:290] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.778703 29816 leader_election.cc:290] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.768548 29777 leader_election.cc:290] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.784844 26916 tablet_bootstrap.cc:654] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.799037 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:39.810731 26913 raft_consensus.cc:359] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.813542 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:39.822237 26913 raft_consensus.cc:385] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:39.822643 26913 raft_consensus.cc:740] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:39.826797 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a]
I20260928 20:03:39.828119 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_6655d0a31a0f40f495acbad72c9ccfc9 [id=69cb6b4dc2ac4e47b92be86a394c9929]
I20260928 20:03:39.829454 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_1d02af85ddb6417dbeadc9ac8a1f0d6f [id=6ded8787f37141558c95545a1da78a73]
I20260928 20:03:39.816983 26912 tablet_bootstrap.cc:654] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:39.852458 26913 consensus_queue.cc:260] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.858675 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491e639008c4678814d2f72beb04c3c" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:39.850571 29895 raft_consensus.cc:515] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:39.864219 29895 leader_election.cc:290] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:39.864773 29382 ts_tablet_manager.cc:1975] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:39.870368 29382 log.cc:1199] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/62114712f2c040e6b1ae831911d68896
I20260928 20:03:39.872028 29382 ts_tablet_manager.cc:1996] T 62114712f2c040e6b1ae831911d68896 P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
W20260928 20:03:39.876850 26594 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.888391 29891 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:39.889170 29891 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.892189 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd4297f4aa400aa3be253bc3168390" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:39.904282 26594 leader_election.cc:343] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:39.906318 26594 leader_election.cc:343] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:39.907090 26594 leader_election.cc:304] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:39.907903 29892 raft_consensus.cc:2804] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:39.908365 29892 raft_consensus.cc:697] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:39.909403 29892 consensus_queue.cc:237] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.915648 29891 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:39.920007 26594 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:39.921011 29900 consensus_queue.cc:1048] T 48d1af02ecb8456c8354ede7872b1ffb P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.923305 29900 consensus_queue.cc:1048] T 6f3566ccc08d42d3a01d567430d1bc4b P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.927186 29893 consensus_queue.cc:1059] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.928069 29832 raft_consensus.cc:3055] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:39.928369 29832 raft_consensus.cc:740] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:39.929068 29832 consensus_queue.cc:260] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.931938 26913 ts_tablet_manager.cc:1480] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.225s user 0.006s sys 0.000s
I20260928 20:03:39.938263 29900 consensus_queue.cc:1048] T f7017fddff974abda74574e39fd4e37c P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:39.939947 26739 leader_election.cc:304] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:39.947319 29705 raft_consensus.cc:2749] T 9491e639008c4678814d2f72beb04c3c P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.945870 29832 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:39.951787 26739 leader_election.cc:304] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:39.953182 29705 raft_consensus.cc:3060] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:39.960214 29705 raft_consensus.cc:2749] T 45dd4297f4aa400aa3be253bc3168390 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:39.961784 29834 consensus_queue.cc:1048] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:39.975189 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 17) took 11859 ms. Trace:
I20260928 20:03:39.975653 29382 rpcz_store.cc:276] 0928 20:03:28.115608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.117966 (+ 2358us) service_pool.cc:224] Handling call
0928 20:03:39.208195 (+11090229us) ts_tablet_manager.cc:1197] Deleting tablet 62114712f2c040e6b1ae831911d68896
0928 20:03:39.208255 (+ 60us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:39.754328 (+546073us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:39.864650 (+110322us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:39.975121 (+110471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":502547,"tablet-delete.queue_time_us":11088934}
I20260928 20:03:39.977341 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet 62114712f2c040e6b1ae831911d68896 (table default.Table_06b8763e3d1242f796a3861e889b693a [id=ed830714739446fe8b2c5688e0b4f30b]) successfully deleted
I20260928 20:03:39.984964 29792 raft_consensus.cc:493] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:39.985911 29792 raft_consensus.cc:515] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:39.989275 29792 leader_election.cc:290] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:40.000160 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:39.977507 26594 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375
W20260928 20:03:40.011976 26594 leader_election.cc:343] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.016564 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_4ab8d432c8da4b06acd99f3329549a73 [id=6f52e21fc32e4be58ef89782db2ebd56]
I20260928 20:03:39.982821 26916 tablet_bootstrap.cc:492] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:40.023546 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ef9cc6acab5e4f7fb897ce42e97a96c0 [id=6fc28fd5258c423ab0cf022d50525caf]
I20260928 20:03:40.029290 29382 tablet_replica.cc:333] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:40.032045 26916 ts_tablet_manager.cc:1449] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.353s user 0.011s sys 0.002s
I20260928 20:03:40.031504 26913 tablet_bootstrap.cc:492] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:40.034868 26912 tablet_bootstrap.cc:492] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:40.035384 26912 ts_tablet_manager.cc:1449] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.303s user 0.026s sys 0.010s
I20260928 20:03:40.048152 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a]
I20260928 20:03:40.046777 26912 raft_consensus.cc:359] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.049326 26912 raft_consensus.cc:385] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.049790 26912 raft_consensus.cc:740] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.051007 26912 consensus_queue.cc:260] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.053237 26912 ts_tablet_manager.cc:1480] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260928 20:03:40.056700 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]
I20260928 20:03:40.046459 26916 raft_consensus.cc:359] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.061331 26912 tablet_bootstrap.cc:492] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:40.063730 26916 raft_consensus.cc:385] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.066825 26916 raft_consensus.cc:740] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.069111 26912 tablet_bootstrap.cc:654] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:40.070745 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2]
I20260928 20:03:40.068529 26916 consensus_queue.cc:260] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.080796 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:40.083489 26916 ts_tablet_manager.cc:1480] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.045s user 0.005s sys 0.000s
I20260928 20:03:40.085367 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_850721f396e049e48b48b6a6636ff076 [id=75699f46194e46278a2fa055683b658f]
W20260928 20:03:40.139314 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 98022.7us
I20260928 20:03:40.139961 29885 raft_consensus.cc:493] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.140406 29885 raft_consensus.cc:515] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.143805 29885 leader_election.cc:290] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:40.132669 29922 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:40.150811 29922 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:40.153246 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
W20260928 20:03:40.156613 26594 leader_election.cc:343] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.157430 29922 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:40.158280 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 635 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
W20260928 20:03:40.176717 26594 leader_election.cc:343] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:40.177443 26594 leader_election.cc:343] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 3657e36a6d2844c28852db1a4f2ed191
I20260928 20:03:40.181191 26913 tablet_bootstrap.cc:654] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:40.214442 26594 leader_election.cc:343] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.219631 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:40.220388 26798 raft_consensus.cc:2393] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:40.305728 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_66f34d73b85d4af58844cc7ea97a7866 [id=7915573b0b384fb693d6bdafe1bb095e]
I20260928 20:03:40.307211 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8a6a3f3fccfe4781a4236ec23cd327ce [id=7d6a9cc7fd204b79ab989485e487bfa0]
I20260928 20:03:40.296362 26913 tablet_bootstrap.cc:492] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:40.332751 26913 ts_tablet_manager.cc:1449] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.301s user 0.012s sys 0.002s
I20260928 20:03:40.344048 26912 tablet_bootstrap.cc:492] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:40.344447 26912 ts_tablet_manager.cc:1449] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.283s user 0.057s sys 0.055s
I20260928 20:03:40.346810 26912 raft_consensus.cc:359] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.347466 26912 raft_consensus.cc:385] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.347730 26912 raft_consensus.cc:740] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.348372 26912 consensus_queue.cc:260] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.354508 26912 ts_tablet_manager.cc:1480] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260928 20:03:40.355401 26912 tablet_bootstrap.cc:492] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:40.361079 26912 tablet_bootstrap.cc:654] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:40.348632 26913 raft_consensus.cc:359] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.363570 26913 raft_consensus.cc:385] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.370214 26913 raft_consensus.cc:740] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.383724 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_87c2af829d1743e89bc173be981dcbc7 [id=7edfca25231e43ef87f78fcc7816d969]
I20260928 20:03:40.406144 29382 raft_consensus.cc:2243] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:03:40.407240 29382 raft_consensus.cc:2272] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:40.409767 29382 ts_tablet_manager.cc:1962] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:40.422501 26913 consensus_queue.cc:260] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.385542 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_21a9c8b591bd46a595f6762efcdb8a58 [id=7eeccc44c73f46b88801b8107c5b1cc9]
W20260928 20:03:40.468192 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 67492.6us
W20260928 20:03:40.470423 26594 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
W20260928 20:03:40.479146 26450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s user 0.007s sys 0.000s
W20260928 20:03:40.480243 26450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s user 0.007s sys 0.000s
I20260928 20:03:40.480667 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_41f900344d434a3aa235b7a49f202b4f [id=8242c87c5c8148d58cb3ba7b8a1cdcbc]
I20260928 20:03:40.482088 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_d41c7a2638544b2b90e5398f97ad686b [id=84e0df88dcfd4d2d90bcd01c2849069b]
W20260928 20:03:40.486392 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 717162us
W20260928 20:03:40.488171 26450 leader_election.cc:343] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:40.489895 26450 leader_election.cc:343] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:40.492033 26450 leader_election.cc:343] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.495077 29890 raft_consensus.cc:493] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.495553 29890 raft_consensus.cc:515] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.508972 29890 leader_election.cc:290] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:40.523039 26912 tablet_bootstrap.cc:492] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:40.528877 26912 ts_tablet_manager.cc:1449] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.174s user 0.024s sys 0.034s
I20260928 20:03:40.532346 26912 raft_consensus.cc:359] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.483474 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_505b4c5717db4fc4941b68e6271305a6 [id=85411afbf7894f15aa20dfcecafc0a17]
W20260928 20:03:40.560807 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 89774.4us
I20260928 20:03:40.563858 29938 raft_consensus.cc:493] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.564857 29938 raft_consensus.cc:515] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.568060 29938 leader_election.cc:290] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.570554 26913 ts_tablet_manager.cc:1480] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.237s user 0.005s sys 0.000s
I20260928 20:03:40.572002 26913 tablet_bootstrap.cc:492] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:40.587617 26912 raft_consensus.cc:385] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.588068 26912 raft_consensus.cc:740] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.588877 26912 consensus_queue.cc:260] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.567745 29935 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:40.568686 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44476us
I20260928 20:03:40.572299 29937 raft_consensus.cc:493] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.596693 26916 tablet_bootstrap.cc:492] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
W20260928 20:03:40.605857 26594 consensus_peers.cc:597] T 62114712f2c040e6b1ae831911d68896 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62114712f2c040e6b1ae831911d68896. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:40.607510 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8]
I20260928 20:03:40.609130 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_7cf3f31c382c41328b3bc3b015ec4320 [id=880148005f7949888ad9308950ae5b32]
I20260928 20:03:40.611281 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c17f6d0dcd96486ca59966415e8978de [id=8b3fd73182f14c10b4a847d1ae537630]
I20260928 20:03:40.622175 29895 raft_consensus.cc:493] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:40.622747 29895 raft_consensus.cc:515] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.626881 29895 leader_election.cc:290] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:40.640410 26912 ts_tablet_manager.cc:1480] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.110s user 0.007s sys 0.000s
I20260928 20:03:40.643334 26912 tablet_bootstrap.cc:492] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:40.676498 29912 raft_consensus.cc:493] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260928 20:03:40.653203 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 71540.5us
I20260928 20:03:40.678051 26450 leader_election.cc:304] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:40.700387 29897 raft_consensus.cc:493] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.677330 29912 raft_consensus.cc:515] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.702622 29936 raft_consensus.cc:493] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.703083 29938 raft_consensus.cc:493] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.707358 29764 raft_consensus.cc:493] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:40.707963 29764 raft_consensus.cc:515] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:40.710685 26450 leader_election.cc:343] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.712136 29778 consensus_queue.cc:1048] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:40.728186 29939 raft_consensus.cc:2804] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:40.728753 29939 raft_consensus.cc:493] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:40.728447 29930 consensus_queue.cc:1048] T 0dc1eea43de1459aa49e7072cf8b89ca P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260928 20:03:40.729110 29939 raft_consensus.cc:3060] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:40.729138 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe680423497941578a5dfff2507e3334" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:40.733340 26514 raft_consensus.cc:2393] T fe680423497941578a5dfff2507e3334 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:40.716091 29764 leader_election.cc:290] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.759075 29938 raft_consensus.cc:515] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:40.765787 26912 tablet_bootstrap.cc:654] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:40.727325 29897 raft_consensus.cc:515] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.770988 29912 leader_election.cc:290] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.786152 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_43a3511ec731472cb9111882b4c3a9a0 [id=8ba59aca002240cd8e1141423f0e6e68]
I20260928 20:03:40.779353 29938 leader_election.cc:290] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.780572 29897 leader_election.cc:290] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.787532 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3d54d1555a914679a1a011feaa634329 [id=8bce5ded64774186a5e753c7037b977f]
I20260928 20:03:40.788115 26916 tablet_bootstrap.cc:654] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:40.788818 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_0cc6e9ab6483451aadcf7beddfa7058a [id=8c9cbf00a11841bca0bd04b6e73dfdbc]
I20260928 20:03:40.696105 29935 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.796314 29935 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.742620 29936 raft_consensus.cc:515] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:40.799253 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 111112us
I20260928 20:03:40.802512 29936 leader_election.cc:290] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.678347 29937 raft_consensus.cc:515] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:40.799211 26450 leader_election.cc:343] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.814503 26450 leader_election.cc:304] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:40.815519 29936 raft_consensus.cc:2804] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:40.816052 29936 raft_consensus.cc:697] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:40.816876 26916 tablet_bootstrap.cc:492] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:40.817386 26916 ts_tablet_manager.cc:1449] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.221s user 0.010s sys 0.004s
I20260928 20:03:40.817142 29936 consensus_queue.cc:237] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:40.835947 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 191109us
I20260928 20:03:40.870858 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e]
I20260928 20:03:40.873677 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_22b94739706d4bcabfd2fe1c283c4ab9 [id=8e2065efd25245bfb73bf8fdcb9458af]
W20260928 20:03:40.882423 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 45682.6us
W20260928 20:03:40.887754 26594 consensus_peers.cc:597] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:03:40.890441 26912 tablet_bootstrap.cc:492] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:40.890899 26912 ts_tablet_manager.cc:1449] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.250s user 0.011s sys 0.001s
I20260928 20:03:40.893167 26912 raft_consensus.cc:359] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.893858 26912 raft_consensus.cc:385] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.907207 29382 ts_tablet_manager.cc:1975] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260928 20:03:40.914450 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301]
I20260928 20:03:40.916040 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b6d3e2c8a9994b19b860b97f44a72785 [id=8f0c2c2f5bb74283976e75d6bcca7ba5]
I20260928 20:03:40.917544 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_13971cf4060b47aea813d1ea311e8347 [id=911769c45f044f3b8772d685b79d2e30]
I20260928 20:03:40.919595 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3bbea633f65b40279f5e069f2cf18cd3 [id=93f93c4333824319bec279868d0f3cfe]
I20260928 20:03:40.921624 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]
I20260928 20:03:40.928705 29651 raft_consensus.cc:493] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:40.929273 29651 raft_consensus.cc:515] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.931237 29651 leader_election.cc:290] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:40.939496 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 47695.6us
I20260928 20:03:40.942076 26913 tablet_bootstrap.cc:700] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent opening tablet: real 0.101s user 0.004s sys 0.000s
W20260928 20:03:40.949849 26450 consensus_peers.cc:597] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:40.950480 26450 leader_election.cc:343] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.950825 26450 leader_election.cc:304] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:40.951885 26450 leader_election.cc:343] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:40.953145 26913 tablet_bootstrap.cc:654] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:40.957089 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_65e7aa358d65483d80d93aab4fbce62a [id=968c4c02a8aa4807b160bc13339e2022]
I20260928 20:03:40.958391 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_d7d359f62a71495f99580370aacdbff7 [id=986f7e8be10e4f70930a513613b3731f]
I20260928 20:03:40.785836 29939 raft_consensus.cc:515] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.963660 29939 leader_election.cc:290] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.903657 26912 raft_consensus.cc:740] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.970484 29382 log.cc:1199] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Deleting WAL directory at /tmp/dist-test-taskjF8q7O/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790625728041430-26119-0/minicluster-data/ts-2/wal/wals/d8d27cbf353246fbb7fe09f385194d8a
I20260928 20:03:40.971539 29937 leader_election.cc:290] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:40.970674 26912 consensus_queue.cc:260] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.973110 26912 ts_tablet_manager.cc:1480] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.082s user 0.007s sys 0.000s
I20260928 20:03:40.973973 29382 ts_tablet_manager.cc:1996] T d8d27cbf353246fbb7fe09f385194d8a P b2d286f4404146278f5e0785ed9fcee4: Deleting consensus metadata
I20260928 20:03:40.988587 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b414add5e6554e31905d7f0162e3abb4 [id=9f809908d5c3416c895ea4d839c956ac]
I20260928 20:03:40.974032 26912 tablet_bootstrap.cc:492] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:40.991068 29938 raft_consensus.cc:2749] T 92397ac1a63a46e591e699e76627d5db P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:40.992957 26916 raft_consensus.cc:359] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.993759 26916 raft_consensus.cc:385] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:40.994071 26916 raft_consensus.cc:740] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:40.994719 26916 consensus_queue.cc:260] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:40.996022 26912 tablet_bootstrap.cc:654] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:40.997205 26916 ts_tablet_manager.cc:1480] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.179s user 0.008s sys 0.000s
W20260928 20:03:40.914721 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 285621us
I20260928 20:03:40.986790 26804 raft_consensus.cc:3060] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:40.999943 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 47279.1us
W20260928 20:03:41.001294 26450 leader_election.cc:343] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.002174 26450 leader_election.cc:304] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:41.002972 29935 raft_consensus.cc:2749] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:40.986915 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:40.987337 26794 raft_consensus.cc:3060] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:41.005411 26450 leader_election.cc:343] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.005745 26450 leader_election.cc:304] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:41.006387 29935 raft_consensus.cc:2749] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:41.008617 26450 consensus_peers.cc:597] T 61bd0122845044fd993d166824f3b9cc P 9b44798af33f4733ba9cde0a1b541f54 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:41.009246 26450 consensus_peers.cc:597] T dc5b576c03794c9287959b5f94f42420 P 9b44798af33f4733ba9cde0a1b541f54 -> Peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Couldn't send request to peer b2d286f4404146278f5e0785ed9fcee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260928 20:03:41.009733 26450 leader_election.cc:343] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.010046 26450 leader_election.cc:304] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:41.012171 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]
I20260928 20:03:41.014256 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41]
I20260928 20:03:41.014384 26916 tablet_bootstrap.cc:492] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:41.015547 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]
I20260928 20:03:41.016690 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_e9366f63d75e44b7b35246b02b57e643 [id=a6241269939c4539979d41f860203228]
I20260928 20:03:41.021538 26916 tablet_bootstrap.cc:654] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.043782 26912 tablet_bootstrap.cc:492] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:41.044214 26912 ts_tablet_manager.cc:1449] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.000s
I20260928 20:03:41.048086 26912 raft_consensus.cc:359] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.054435 26912 raft_consensus.cc:385] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.054757 26912 raft_consensus.cc:740] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.055370 26912 consensus_queue.cc:260] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.059427 26913 tablet_bootstrap.cc:492] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:41.060956 29382 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51492 (request call id 16) took 12945 ms. Trace:
I20260928 20:03:41.061364 29382 rpcz_store.cc:276] 0928 20:03:28.115310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.117895 (+ 2585us) service_pool.cc:224] Handling call
0928 20:03:40.022918 (+11905023us) ts_tablet_manager.cc:1197] Deleting tablet d8d27cbf353246fbb7fe09f385194d8a
0928 20:03:40.029160 (+ 6242us) ts_tablet_manager.cc:1117] Acquired tablet manager lock
0928 20:03:40.426822 (+397662us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:40.907020 (+480198us) tablet_metadata.cc:665] Metadata flushed
0928 20:03:41.060884 (+153864us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372719,"tablet-delete.queue_time_us":11901585}
I20260928 20:03:41.062937 26147 catalog_manager.cc:5063] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): tablet d8d27cbf353246fbb7fe09f385194d8a (table default.Table_5b3bc03525cd48b7b3c9e4323c0206dd [id=e9cf8c7bf50d427c832e7a7d884f6190]) successfully deleted
I20260928 20:03:41.067076 29935 raft_consensus.cc:2749] T 06f7b05e756f4a4db5031ff1e14c6ff6 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:41.068676 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 58968.4us
I20260928 20:03:41.068910 26912 ts_tablet_manager.cc:1480] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260928 20:03:41.072836 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_1d04da9e1ce749aaafdc63f86a11535e [id=aa9d03a4e0a840659761ea54cbb4519f]
W20260928 20:03:41.072836 26450 leader_election.cc:343] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.075114 26913 ts_tablet_manager.cc:1449] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.503s user 0.015s sys 0.000s
I20260928 20:03:41.075059 26450 leader_election.cc:304] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:41.070071 26912 tablet_bootstrap.cc:492] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:41.078372 29935 raft_consensus.cc:493] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.078975 29935 raft_consensus.cc:515] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.080533 26913 raft_consensus.cc:359] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.081159 29935 leader_election.cc:290] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.088375 26913 raft_consensus.cc:385] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.089210 26913 raft_consensus.cc:740] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.090734 26913 consensus_queue.cc:260] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.094774 26913 ts_tablet_manager.cc:1480] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260928 20:03:41.095269 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_00cb1b06e60548f9af6ede2d5ded2429 [id=ac9430174dcd4c03af6e216a86dc8497]
I20260928 20:03:41.096583 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2]
I20260928 20:03:41.097860 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]
I20260928 20:03:41.076205 26740 leader_election.cc:304] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:41.098989 29941 raft_consensus.cc:2749] T fe680423497941578a5dfff2507e3334 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:41.101157 26913 tablet_bootstrap.cc:492] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:41.115379 29792 raft_consensus.cc:493] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.115922 29935 raft_consensus.cc:2749] T a0133314d6de46cea61a9260df79bdea P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:41.115908 29792 raft_consensus.cc:515] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:41.117039 26450 leader_election.cc:343] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.117375 26450 leader_election.cc:304] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:41.117990 29935 raft_consensus.cc:2749] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:41.118762 29792 leader_election.cc:290] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.120088 26912 tablet_bootstrap.cc:654] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.122185 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_6705a1b4132644408979a6ed69958eba [id=b265254a22fd4381a4c8135dda1abcd7]
I20260928 20:03:41.124631 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_04d639a37e4b44ce9a3c670fc1bf41b8 [id=b4cbe8131b3a4452bf9d0305f6d89940]
I20260928 20:03:41.134671 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_286ac19bf2c94fccacea798394d419c8 [id=b5312b25c2f3437cba1d46c88efad660]
I20260928 20:03:41.137434 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_6053fca76433492abb383b4740be7bc2 [id=b6bd633236b84348885990b7049c0080]
I20260928 20:03:41.139799 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3]
I20260928 20:03:41.140981 26913 tablet_bootstrap.cc:654] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.150255 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.155028 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_101a375ee5e84e1aa7e611fc10883e70 [id=b8d510931aff47298bc0ae12b984ac8c]
I20260928 20:03:41.156659 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e]
I20260928 20:03:41.168077 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bf3dd9ed054197b4208324938d96b0" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.173254 29840 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.173746 29840 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.175812 29840 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.192364 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a367ac8973bb4ec4a752434bf59cd2a0 [id=bc50bdfe400c42fcbe7487dd842368ab]
I20260928 20:03:41.208572 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.208645 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.209344 26653 raft_consensus.cc:2393] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:41.209370 26512 raft_consensus.cc:2393] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
I20260928 20:03:41.212473 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.220268 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b82018a06c354d9291408f9811be2c33 [id=bcc46b95f2b14748ae012cc7dcf42b42]
I20260928 20:03:41.221635 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_d36ac45737c44b2da07aee540f3e9a13 [id=be5fa7ea994c4cd5a37001168b4ef9f4]
I20260928 20:03:41.223459 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_123669ff3966450d8a3dac4d2c6bd255 [id=bfcf8547a3264fc5868a8cd2635fa723]
I20260928 20:03:41.224529 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_39b8a2a0083445798ec0e58e3b2db431 [id=c0c669d5c2ab41b1817259de4326ccd0]
I20260928 20:03:41.227504 26916 tablet_bootstrap.cc:492] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:41.227931 26916 ts_tablet_manager.cc:1449] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.230s user 0.010s sys 0.000s
I20260928 20:03:41.228607 26912 tablet_bootstrap.cc:492] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:41.228972 26912 ts_tablet_manager.cc:1449] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.159s user 0.012s sys 0.004s
I20260928 20:03:41.229921 26804 raft_consensus.cc:1275] T d8c3346e3db1400c98623724cdf54901 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:41.231695 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.233084 26802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1a8c85b6bc4849b447b6fd048afb2f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.234094 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cc46819bf4480b5cef0f9b92e66b2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.236196 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfce3de1374f7a8c02c6898f6a741c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.231299 26912 raft_consensus.cc:359] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.237412 26912 raft_consensus.cc:385] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.237686 26912 raft_consensus.cc:740] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.237916 26797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a658eaaedb4432a4dc2e1f5df6cc58" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.238585 29942 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.238415 26912 consensus_queue.cc:260] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.238916 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868e5a3ebd2494ca20e1e08a146850e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.239213 29942 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.240473 26912 ts_tablet_manager.cc:1480] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260928 20:03:41.241231 29942 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.241658 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f21c71dc0e41aba85bb01c9fddc12d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.243386 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0694e341d64cdea99bb462beb1150b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.244204 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.245160 26514 raft_consensus.cc:2468] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:41.247088 26740 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.254528 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1a8c85b6bc4849b447b6fd048afb2f" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.254761 26798 raft_consensus.cc:1275] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Refusing update from remote peer 9b44798af33f4733ba9cde0a1b541f54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:41.258773 29885 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.258656 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d556a7736504aa2aa2fe8f868ecf489" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.258258 26912 tablet_bootstrap.cc:492] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:41.259377 29885 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:41.261431 29885 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:41.258648 29705 raft_consensus.cc:2804] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:41.262377 29705 raft_consensus.cc:493] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:41.262676 29705 raft_consensus.cc:3060] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:41.265640 26912 tablet_bootstrap.cc:654] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.266520 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d]
I20260928 20:03:41.267912 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ca5e97c6ddbd49cab3f60aafa5f24e7f [id=c43f875938fb4105b927b7aee9612a7c]
I20260928 20:03:41.271390 26913 tablet_bootstrap.cc:492] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:41.271904 26913 ts_tablet_manager.cc:1449] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.171s user 0.008s sys 0.006s
I20260928 20:03:41.273592 29705 raft_consensus.cc:515] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.278505 29705 leader_election.cc:290] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.284909 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cc46819bf4480b5cef0f9b92e66b2" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.288694 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:41.290608 26659 raft_consensus.cc:3060] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.296046 26913 raft_consensus.cc:359] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.297925 26913 raft_consensus.cc:385] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.298282 26913 raft_consensus.cc:740] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.305155 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.305866 26794 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 2.
I20260928 20:03:41.325636 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8536f4a4a0904806b71d4e7bf20c6bce" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.337602 26916 raft_consensus.cc:359] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.338573 26916 raft_consensus.cc:385] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.338878 26916 raft_consensus.cc:740] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.339576 26916 consensus_queue.cc:260] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.341114 29705 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:41.343935 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:41.341593 29705 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.348197 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5ef01e0dbd49398b27911a713626cd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:41.350256 27822 leader_election.cc:336] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923): Timed out: RequestConsensusVote RPC to 127.25.129.253:32923 timed out after 0.527s (SENT)
I20260928 20:03:41.350751 27822 leader_election.cc:304] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b347187d9be4ad08708acffdf4dda63; no voters: 5308dad1e3384995a990de7c4866f1b1, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:41.353072 26916 ts_tablet_manager.cc:1480] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.125s user 0.009s sys 0.000s
I20260928 20:03:41.346642 29816 raft_consensus.cc:493] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.356293 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3600b2fbb574106b5b13ab837754eb3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.359942 29816 raft_consensus.cc:515] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.366341 29816 leader_election.cc:290] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.366951 26916 tablet_bootstrap.cc:492] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:41.376078 26916 tablet_bootstrap.cc:654] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.346869 29705 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.314508 29932 raft_consensus.cc:493] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.378425 29932 raft_consensus.cc:515] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.379578 29816 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.380802 29932 leader_election.cc:290] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.316076 26646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfce3de1374f7a8c02c6898f6a741c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.380237 29816 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.319464 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a658eaaedb4432a4dc2e1f5df6cc58" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.320150 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f21c71dc0e41aba85bb01c9fddc12d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.320824 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d556a7736504aa2aa2fe8f868ecf489" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.321513 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.382957 29816 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.383448 26649 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:41.385710 26913 consensus_queue.cc:260] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.388305 26913 ts_tablet_manager.cc:1480] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.110s user 0.005s sys 0.000s
I20260928 20:03:41.392197 29816 raft_consensus.cc:493] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.392815 29816 raft_consensus.cc:515] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.394979 29816 leader_election.cc:290] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.398396 29816 raft_consensus.cc:493] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:41.398602 29935 raft_consensus.cc:493] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.399099 29935 raft_consensus.cc:515] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.399044 29816 raft_consensus.cc:515] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.400985 29935 leader_election.cc:290] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.402537 29816 leader_election.cc:290] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.405005 29935 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.405982 29935 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
W20260928 20:03:41.407528 27822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.253:32923, user_credentials={real_user=slave}} blocked reactor thread for 57309us
I20260928 20:03:41.408334 29935 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:41.414687 29705 raft_consensus.cc:493] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.415110 29705 raft_consensus.cc:515] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.394639 29968 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:41.421612 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.422672 26501 raft_consensus.cc:2468] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:41.426856 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.431563 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.395747 29792 raft_consensus.cc:493] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:41.432132 26503 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 4.
I20260928 20:03:41.432463 29792 raft_consensus.cc:515] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.433148 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.433660 26501 raft_consensus.cc:3060] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:41.434638 29792 leader_election.cc:290] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.396430 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5ef01e0dbd49398b27911a713626cd" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.397964 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3600b2fbb574106b5b13ab837754eb3" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.399389 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1a7a5ed5914712b8fb3ceb487e03ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:41.418781 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8536f4a4a0904806b71d4e7bf20c6bce" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.436367 26649 raft_consensus.cc:3060] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.436408 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.436983 26515 raft_consensus.cc:2468] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:41.441778 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.442350 26499 raft_consensus.cc:2468] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:41.444203 26649 raft_consensus.cc:2468] T af1a7a5ed5914712b8fb3ceb487e03ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 1.
I20260928 20:03:41.444303 26740 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.445562 29941 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260928 20:03:41.445914 29941 raft_consensus.cc:493] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:41.446242 29941 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 4 FOLLOWER]: Advancing to term 5
I20260928 20:03:41.450862 26913 tablet_bootstrap.cc:492] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:41.452821 26740 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.455806 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a50a2a794cf54b55a7cbb62ec4f8a4a8 [id=c4fd9da4958c44e19d97f5fb4d1ef9d6]
I20260928 20:03:41.457352 29941 raft_consensus.cc:515] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:41.459791 29941 leader_election.cc:290] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 5 election: Requested vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:41.460424 29885 raft_consensus.cc:2804] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:41.460814 29885 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:41.461138 29885 raft_consensus.cc:3060] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:41.466431 29840 raft_consensus.cc:493] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.466914 29840 raft_consensus.cc:515] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.468745 29840 leader_election.cc:290] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.473294 29885 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.474197 29705 leader_election.cc:290] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.474946 26740 leader_election.cc:304] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.475679 29840 raft_consensus.cc:2804] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:41.476836 29840 raft_consensus.cc:493] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:41.477197 29840 raft_consensus.cc:3060] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.487548 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2385dd76e6d44319d3cdd4303feaa6b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.488185 26516 raft_consensus.cc:3060] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.490551 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.491071 26499 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 4 FOLLOWER]: Advancing to term 5
I20260928 20:03:41.495100 26501 raft_consensus.cc:2468] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:41.495368 26916 tablet_bootstrap.cc:492] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:41.495754 26916 ts_tablet_manager.cc:1449] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.129s user 0.006s sys 0.006s
I20260928 20:03:41.509464 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.510335 26501 raft_consensus.cc:2468] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:41.513326 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:41.485423 29792 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.518849 26913 tablet_bootstrap.cc:654] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.518806 29792 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.520385 29885 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.515755 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:41.521567 29792 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.525200 29840 raft_consensus.cc:515] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.531446 26916 raft_consensus.cc:359] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.532179 26916 raft_consensus.cc:385] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.532531 26916 raft_consensus.cc:740] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
W20260928 20:03:41.534759 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 79489.2us
I20260928 20:03:41.537292 29932 consensus_queue.cc:1048] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:41.548195 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:41.547582 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:41.549789 29935 raft_consensus.cc:493] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.550318 29935 raft_consensus.cc:515] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.552188 29935 leader_election.cc:290] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.559828 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.563288 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:41.569084 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:41.457944 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_7e6367b41265466ab78f164d3ea3c7e5 [id=c7224d7548ee4a809b9e7625063d2f54]
I20260928 20:03:41.571568 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923]
I20260928 20:03:41.572387 29935 raft_consensus.cc:493] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.572880 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]
I20260928 20:03:41.577291 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:41.573077 29935 raft_consensus.cc:515] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.579952 29935 leader_election.cc:290] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.586753 26499 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 5.
I20260928 20:03:41.587412 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:41.588275 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:41.589490 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
W20260928 20:03:41.541134 26594 leader_election.cc:343] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.602211 26503 raft_consensus.cc:2468] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:41.542196 26740 leader_election.cc:304] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
W20260928 20:03:41.602762 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 61659.5us
W20260928 20:03:41.603010 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 60955.8us
I20260928 20:03:41.603710 26740 leader_election.cc:304] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.603973 29932 consensus_queue.cc:1048] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:41.567137 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 57419.9us
I20260928 20:03:41.568017 29705 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.605451 29705 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.624176 26913 tablet_bootstrap.cc:492] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:41.624771 26913 ts_tablet_manager.cc:1449] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.174s user 0.012s sys 0.008s
I20260928 20:03:41.627570 26913 raft_consensus.cc:359] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.629279 29976 raft_consensus.cc:2804] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:41.629340 29942 raft_consensus.cc:2804] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:41.629881 29942 raft_consensus.cc:493] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:41.629974 29976 raft_consensus.cc:697] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:41.631563 29942 raft_consensus.cc:3060] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.632246 29976 consensus_queue.cc:237] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.634152 29840 leader_election.cc:290] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.634833 26739 leader_election.cc:304] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:41.635352 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.635501 29840 raft_consensus.cc:3060] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.635910 26514 raft_consensus.cc:3060] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.631211 29705 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.638222 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_73bad59d2f45422d9e7f0409bdc4a2f4 [id=cbeeebe708654140b78d52a0bed4c6d0]
I20260928 20:03:41.640312 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]
I20260928 20:03:41.643126 26514 raft_consensus.cc:2468] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:41.646646 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11216db10dc54e9fa8a7466643f8e413" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.647336 26512 raft_consensus.cc:3060] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.653154 26913 raft_consensus.cc:385] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.655303 26913 raft_consensus.cc:740] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.656308 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
W20260928 20:03:41.628154 26594 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:03:41.617559 26516 raft_consensus.cc:2468] T c2385dd76e6d44319d3cdd4303feaa6b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:41.533347 26916 consensus_queue.cc:260] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.625128 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.659042 26501 raft_consensus.cc:3060] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.659601 26916 ts_tablet_manager.cc:1480] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.164s user 0.005s sys 0.002s
I20260928 20:03:41.660188 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3657e36a6d2844c28852db1a4f2ed191" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.660557 26916 tablet_bootstrap.cc:492] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:41.660923 26499 raft_consensus.cc:3060] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:41.662218 29935 raft_consensus.cc:493] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.662668 29935 raft_consensus.cc:515] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.664708 29935 leader_election.cc:290] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.662678 26913 consensus_queue.cc:260] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.679194 26913 ts_tablet_manager.cc:1480] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.054s user 0.006s sys 0.000s
I20260928 20:03:41.684975 29942 raft_consensus.cc:515] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.685686 29792 raft_consensus.cc:493] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:41.686453 29792 raft_consensus.cc:515] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.688491 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.690277 29792 leader_election.cc:290] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.690331 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a20c1c6464f228baae236015349c5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.690994 26514 raft_consensus.cc:3060] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.693967 26913 tablet_bootstrap.cc:492] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:41.695247 26912 tablet_bootstrap.cc:492] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:41.695726 26912 ts_tablet_manager.cc:1449] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.440s user 0.005s sys 0.008s
W20260928 20:03:41.696090 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 59548.9us
I20260928 20:03:41.705619 26501 raft_consensus.cc:2468] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:41.707248 29942 leader_election.cc:290] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.703900 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.708112 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3717aae560f428b9cb7cf732dc71497" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:41.705994 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.714938 26654 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 3.
I20260928 20:03:41.717453 26912 raft_consensus.cc:359] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.718120 26912 raft_consensus.cc:385] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.718390 26912 raft_consensus.cc:740] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.718928 26912 consensus_queue.cc:260] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:41.720261 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 83053.2us
I20260928 20:03:41.722538 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:41.731110 29895 consensus_queue.cc:1048] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:41.733979 29792 raft_consensus.cc:493] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.734611 29792 raft_consensus.cc:515] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.737224 29792 leader_election.cc:290] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.738788 26512 raft_consensus.cc:2468] T 11216db10dc54e9fa8a7466643f8e413 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:41.740967 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:41.754326 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_b4fcc54e10c647b5b8a4f5e523abbfdb [id=cead80ee7d2a408c9112b53b13e41fae]
I20260928 20:03:41.756665 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_e8c7c9bf121c488eb28e0006cf46469c [id=d258873b4bfc4dd188356430c116e0ae]
I20260928 20:03:41.757998 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8543155fabf44da1970cceef9f13d261 [id=d3d2473850b84badb95103c3973c6cd4]
I20260928 20:03:41.759351 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_4613895cb87549efa0173a0bc2de3828 [id=d3f0079cf16841ecb1f72fb8f91e79f9]
I20260928 20:03:41.760684 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]
I20260928 20:03:41.761650 29932 raft_consensus.cc:493] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:41.762349 29932 raft_consensus.cc:515] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.765523 29932 leader_election.cc:290] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.775460 26499 raft_consensus.cc:2468] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:41.777083 29840 raft_consensus.cc:2749] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:41.777534 29834 raft_consensus.cc:493] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:41.778147 29834 raft_consensus.cc:515] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.780812 29834 leader_election.cc:290] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:41.787421 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 66544.4us
I20260928 20:03:41.788793 26916 tablet_bootstrap.cc:654] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.788893 26740 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.789338 29935 raft_consensus.cc:493] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.789595 29978 raft_consensus.cc:2804] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 5 FOLLOWER]: Leader election won for term 5
I20260928 20:03:41.790030 29978 raft_consensus.cc:697] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [term 5 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:41.789779 29935 raft_consensus.cc:515] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.790793 29978 consensus_queue.cc:237] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:41.795652 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.795822 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:41.796319 26659 raft_consensus.cc:2393] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:41.796555 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:41.797343 26514 raft_consensus.cc:2468] T 9d2a20c1c6464f228baae236015349c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:41.798308 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:41.798629 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.799213 26659 raft_consensus.cc:2393] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:41.800722 26740 leader_election.cc:304] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.801395 29976 raft_consensus.cc:2804] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:41.801822 29976 raft_consensus.cc:697] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:41.803011 29935 leader_election.cc:290] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.803566 29816 raft_consensus.cc:493] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:41.804080 29816 raft_consensus.cc:515] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:41.804823 29976 consensus_queue.cc:237] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.808521 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.809136 26514 raft_consensus.cc:2468] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
W20260928 20:03:41.809271 26594 leader_election.cc:343] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:41.810995 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.811636 26514 raft_consensus.cc:2393] T 9b943773d8804b0db0fbed9978461690 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:41.817468 26913 tablet_bootstrap.cc:654] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:41.818642 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.819165 26515 raft_consensus.cc:3060] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.821786 29897 raft_consensus.cc:493] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:41.822288 29897 raft_consensus.cc:515] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:41.824062 29897 leader_election.cc:290] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.829341 26515 raft_consensus.cc:2468] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
W20260928 20:03:41.834499 26594 leader_election.cc:343] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:41.761925 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_53c689bd6dc0475da06ec57192aaa587 [id=d739d9bcee244c8db96567e6cbc0fdc4]
I20260928 20:03:41.844219 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]
I20260928 20:03:41.859501 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:41.861687 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:41.864130 26913 tablet_bootstrap.cc:492] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:41.864624 26913 ts_tablet_manager.cc:1449] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.171s user 0.011s sys 0.001s
I20260928 20:03:41.871302 26913 raft_consensus.cc:359] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.873409 29985 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:41.873874 29985 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.875844 29985 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.871961 26913 raft_consensus.cc:385] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.878763 26913 raft_consensus.cc:740] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.879716 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92]
I20260928 20:03:41.880347 26913 consensus_queue.cc:260] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.805905 29816 leader_election.cc:290] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277)
I20260928 20:03:41.857841 29897 raft_consensus.cc:493] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:41.881953 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]
I20260928 20:03:41.881762 29897 raft_consensus.cc:515] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.883316 26740 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.883983 29942 raft_consensus.cc:2804] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:41.884315 29942 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:41.884609 29942 raft_consensus.cc:3060] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.887308 29897 leader_election.cc:290] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.868651 26501 raft_consensus.cc:1240] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Rejecting Update request from peer 92fd8074a7df4bba87a73c0d84ed00c8 for earlier term 1. Current term is 2. Ops: []
I20260928 20:03:41.871730 29935 raft_consensus.cc:493] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
I20260928 20:03:41.888064 29935 raft_consensus.cc:515] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.890923 29935 leader_election.cc:290] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.891924 29895 raft_consensus.cc:493] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.892351 29895 raft_consensus.cc:515] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.895258 29895 leader_election.cc:290] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.896239 29942 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.899609 26153 catalog_manager.cc:5938] TS 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:41.903002 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.903824 26500 raft_consensus.cc:2393] T 8eb99b1b34b844b4b6bdbd52c646f087 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:41.908427 29834 raft_consensus.cc:493] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.909077 29834 raft_consensus.cc:515] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.911787 29834 leader_election.cc:290] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.920145 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:41.920668 26659 raft_consensus.cc:3060] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Advancing to term 5
I20260928 20:03:41.923805 26913 ts_tablet_manager.cc:1480] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.059s user 0.006s sys 0.000s
I20260928 20:03:41.923856 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_02fef5b38f4b4eb382f4fba80de72cc3 [id=e1a9ab96f14847059cea861f9b9c3492]
I20260928 20:03:41.925096 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_9ef30a62591542edab5ee1be742ee4b3 [id=e246baf2b71f4e35811937013e2ff074]
I20260928 20:03:41.927515 26659 raft_consensus.cc:2468] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 5.
I20260928 20:03:41.929134 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:41.929793 26654 raft_consensus.cc:2393] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:41.929709 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.930302 26659 raft_consensus.cc:2468] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:41.904388 26912 ts_tablet_manager.cc:1480] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.208s user 0.004s sys 0.003s
I20260928 20:03:41.898083 29942 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:41.910303 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.907231 26740 leader_election.cc:304] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:41.937906 26916 tablet_bootstrap.cc:492] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:41.938417 26916 ts_tablet_manager.cc:1449] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.278s user 0.014s sys 0.000s
I20260928 20:03:41.941491 29976 raft_consensus.cc:2804] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:41.941985 29976 raft_consensus.cc:697] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:41.942957 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:41.943572 26515 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:41.944024 29976 consensus_queue.cc:237] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.950922 29935 raft_consensus.cc:493] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:41.951436 29935 raft_consensus.cc:515] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.953060 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.953341 29935 leader_election.cc:290] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:41.953882 26801 raft_consensus.cc:2410] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 20:03:41.956028 26503 raft_consensus.cc:1275] T d8c3346e3db1400c98623724cdf54901 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260928 20:03:41.958456 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:41.959120 26514 raft_consensus.cc:3060] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:41.962921 26916 raft_consensus.cc:359] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.963651 26916 raft_consensus.cc:385] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:41.963933 26916 raft_consensus.cc:740] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:41.964010 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_0e324d2ffadb4e90871cc056c736bd27 [id=e260025cb2cd435bbb4389922d4a9426]
I20260928 20:03:41.964294 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:41.964843 26654 raft_consensus.cc:2468] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 0.
I20260928 20:03:41.964793 26916 consensus_queue.cc:260] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:41.965922 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b943773d8804b0db0fbed9978461690" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:41.966588 26659 raft_consensus.cc:2393] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:41.966688 26916 ts_tablet_manager.cc:1480] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.028s user 0.004s sys 0.001s
I20260928 20:03:41.966864 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279]
I20260928 20:03:41.967545 26916 tablet_bootstrap.cc:492] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:41.967979 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_d3b253774b324f229aed498d392a1514 [id=e370d4e71e194623b62982406b02dfec]
I20260928 20:03:41.969086 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18]
I20260928 20:03:41.977257 26798 raft_consensus.cc:1240] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Rejecting Update request from peer 92fd8074a7df4bba87a73c0d84ed00c8 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260928 20:03:41.977739 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:41.993992 26913 tablet_bootstrap.cc:492] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:41.996984 26912 tablet_bootstrap.cc:492] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:42.000864 26913 tablet_bootstrap.cc:654] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.004865 26514 raft_consensus.cc:2468] T d1535def17b14663b42b76f3bc27001a P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:42.016832 26740 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:42.017665 29978 raft_consensus.cc:2804] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:42.018021 29978 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:42.018378 29978 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:42.031522 26912 tablet_bootstrap.cc:654] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.036019 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:42.047765 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.048887 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.054483 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.055071 26913 tablet_bootstrap.cc:492] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:42.055186 26498 raft_consensus.cc:2468] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:42.055496 26913 ts_tablet_manager.cc:1449] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.006s
I20260928 20:03:42.066325 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_2a6a2e75f86f4344ba5d2e495190619b [id=e5a58b48db114aa29aca24eec47130d9]
I20260928 20:03:42.067879 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_07b83969683b44e6a8cfc75d770cd0be [id=e7207699bc354c2fa79e9c58574cddd1]
W20260928 20:03:42.070858 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 48443.1us
I20260928 20:03:42.071513 26512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.072052 26512 raft_consensus.cc:2468] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:42.057868 26913 raft_consensus.cc:359] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.073447 26740 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:42.073662 26913 raft_consensus.cc:385] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.073921 26913 raft_consensus.cc:740] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.074295 29983 raft_consensus.cc:2804] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:42.074769 29983 raft_consensus.cc:697] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [term 1 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:42.074796 26913 consensus_queue.cc:260] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.075611 29983 consensus_queue.cc:237] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.080277 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.081112 26500 raft_consensus.cc:2410] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 20:03:42.082332 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.082947 26514 raft_consensus.cc:2468] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:42.083436 26913 ts_tablet_manager.cc:1480] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260928 20:03:42.074973 29935 raft_consensus.cc:493] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.084173 29935 raft_consensus.cc:515] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.086217 29935 leader_election.cc:290] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.087000 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.091223 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.091380 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ddf1201784a93ada93e629befa030" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.091602 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c39c6915964116ac14ea2781c7a52b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.090817 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376f270145e44b3acb4b8b2437cba33" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.076994 26916 tablet_bootstrap.cc:654] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.099851 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_ba5e44badca344a2b91e22382cdb8ac1 [id=ec32368ba1694873892ec3f1a5140105]
I20260928 20:03:42.102360 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_8fdfcb3717154d7a8da1009ef6e6b13d [id=eecba72bbe4b47d5908cb12d57e2eece]
I20260928 20:03:42.118985 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7053ca61ed6e4f6dbf1f5adb54728792" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.121033 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.120878 29978 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.121973 26795 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 2.
I20260928 20:03:42.127889 29895 raft_consensus.cc:493] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.128536 29895 raft_consensus.cc:515] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.131507 29895 leader_election.cc:290] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.137629 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.140316 26595 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.141674 29895 raft_consensus.cc:2804] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:42.142145 29895 raft_consensus.cc:493] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:42.142565 29895 raft_consensus.cc:3060] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:42.167555 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_35cb07bc024a4ebc8e1fcb5199e62dc5 [id=eee23e85c2fc4db288997e5ce89850ec]
I20260928 20:03:42.171116 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_a6f405608c6542a6818f887b3abc1129 [id=ef08155a9e7b478a94ef141960781541]
I20260928 20:03:42.172410 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_0c6396df18a447838b8edbf495c2f3dd [id=f004ce733e90484faa39955bca33a4fb]
I20260928 20:03:42.173476 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.185364 29895 raft_consensus.cc:515] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.206338 26912 tablet_bootstrap.cc:492] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:42.211113 29935 raft_consensus.cc:493] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.211673 29935 raft_consensus.cc:515] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.212061 29978 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.246867 29935 leader_election.cc:290] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.255463 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200]
I20260928 20:03:42.255584 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.260231 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:42.229727 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f376f270145e44b3acb4b8b2437cba33" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.262367 26912 ts_tablet_manager.cc:1449] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.266s user 0.014s sys 0.000s
I20260928 20:03:42.229998 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.262986 26657 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 2.
I20260928 20:03:42.230634 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158ddf1201784a93ada93e629befa030" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.231312 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7053ca61ed6e4f6dbf1f5adb54728792" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.231974 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b276f21d85c4bb4bdd777f8f9a43960" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.232070 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9f9f2f9b96435e983f1ee2679563ff" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.264318 29895 leader_election.cc:290] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.232985 26655 raft_consensus.cc:1275] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer 9b44798af33f4733ba9cde0a1b541f54: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 20:03:42.264830 26658 raft_consensus.cc:2393] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 5: Already voted for candidate b2d286f4404146278f5e0785ed9fcee4 in this term.
I20260928 20:03:42.264961 26655 pending_rounds.cc:85] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting all ops after (but not including) 0
I20260928 20:03:42.265183 26655 pending_rounds.cc:107] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 20:03:42.252806 29834 consensus_queue.cc:1048] T cf1ac58577c345ee817e45b340601185 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:42.253203 26595 leader_election.cc:343] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f478cce587a548e1aab620721c3bb1c1
I20260928 20:03:42.265476 26655 raft_consensus.cc:2889] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 20:03:42.265897 26595 leader_election.cc:304] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.268249 29792 raft_consensus.cc:2749] T f478cce587a548e1aab620721c3bb1c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.270349 29932 consensus_queue.cc:1048] T fe680423497941578a5dfff2507e3334 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.275259 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]
I20260928 20:03:42.276433 26515 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:42.276620 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd]
I20260928 20:03:42.278122 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_58732efb3f0e459c8af18aac5919b612 [id=f3479b39c6f7407fbd7b818cddb09f7a]
I20260928 20:03:42.281235 29986 raft_consensus.cc:493] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.281744 29986 raft_consensus.cc:515] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.283365 29935 raft_consensus.cc:493] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.284042 29986 leader_election.cc:290] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.283877 29935 raft_consensus.cc:515] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.288532 26913 tablet_bootstrap.cc:492] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:42.289511 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb99b1b34b844b4b6bdbd52c646f087" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:42.290079 26658 raft_consensus.cc:3060] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:42.290396 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.290923 26655 raft_consensus.cc:2468] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:42.291410 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c865d2d368847dd9de688bdd65e88b9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.293754 29932 raft_consensus.cc:493] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.294188 29932 raft_consensus.cc:515] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.296336 29932 leader_election.cc:290] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.299136 26913 tablet_bootstrap.cc:654] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.297165 26658 raft_consensus.cc:2468] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:42.310866 26740 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:42.311697 29978 raft_consensus.cc:2804] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:42.312568 29978 raft_consensus.cc:697] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Leader. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
W20260928 20:03:42.313331 26595 leader_election.cc:343] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 91b11022fc774d18b92e0c694f834375
I20260928 20:03:42.313781 26595 leader_election.cc:304] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.313601 29978 consensus_queue.cc:237] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.314714 29932 raft_consensus.cc:2749] T 91b11022fc774d18b92e0c694f834375 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.307031 26916 tablet_bootstrap.cc:492] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:42.286665 29897 raft_consensus.cc:493] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.316177 29897 raft_consensus.cc:515] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.316206 26916 ts_tablet_manager.cc:1449] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.349s user 0.004s sys 0.010s
I20260928 20:03:42.317996 29897 leader_election.cc:290] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.285800 29935 leader_election.cc:290] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.319886 26912 raft_consensus.cc:359] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.320562 26912 raft_consensus.cc:385] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.320827 26912 raft_consensus.cc:740] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.320504 26916 raft_consensus.cc:359] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.321331 26916 raft_consensus.cc:385] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.321570 26916 raft_consensus.cc:740] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.321555 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet aec2497f4eac4408a37eb2a40122a672 (table default.Table_3cd004ec7f3c4ada89b8477ac2847ddd [id=023649e64be246a989059f38b897055e]). Expected version 1 got 0
I20260928 20:03:42.321394 26912 consensus_queue.cc:260] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.322274 26916 consensus_queue.cc:260] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.323680 26916 ts_tablet_manager.cc:1480] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260928 20:03:42.327757 29897 raft_consensus.cc:493] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.327838 26595 leader_election.cc:304] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.328229 29897 raft_consensus.cc:515] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.328819 29932 raft_consensus.cc:2804] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:42.329543 29932 raft_consensus.cc:697] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.330096 29897 leader_election.cc:290] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.331332 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6]). Expected version 1 got 0
I20260928 20:03:42.330454 29932 consensus_queue.cc:237] T 9b943773d8804b0db0fbed9978461690 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:42.334510 26594 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:42.338217 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 311f004a7acc4d43b4b88564b57efa74 (table default.Table_4ccceaec1fcb44bc83bc6823e8fb60db [id=f1329ba1066a431083c953a490bb544d]). Expected version 1 got 0
I20260928 20:03:42.341742 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b42615f62284e359cdc1f4c9cc715c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.343516 26595 leader_election.cc:304] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.344338 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_cdb14377bf684d90ba23733f91f3a0d6 [id=f70247fb59cd4a758fd2760ce97c6c91]
I20260928 20:03:42.344365 29792 raft_consensus.cc:2804] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:42.345794 29792 raft_consensus.cc:697] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.346802 29792 consensus_queue.cc:237] T c2385dd76e6d44319d3cdd4303feaa6b P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.345183 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc]). Expected version 3 got 0
I20260928 20:03:42.355195 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 87024e1a4f184c669ff78efc918a9eef (table default.Table_c3352b560595410bbc6649fd418a6cc9 [id=cccad7b111c844f3a7e5a1ae62c06adf]). Expected version 2 got 0
I20260928 20:03:42.358983 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 647a383938f947108890ae2042e3edc3 (table default.Table_ae224fd5a9304c66a73de6f9b07d6fef [id=1e0af613169c4eb7b1bc6dbca175a3c6]). Expected version 2 got 0
I20260928 20:03:42.360062 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.365021 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d]). Expected version 1 got 0
I20260928 20:03:42.366488 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf8cc998fb4039897ca93158c2202a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.370427 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.370720 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 8cbffea517e2438d90ca234b9f72f733 (table default.Table_8da8f7658ee04ba6ab55c0854954b591 [id=d89268285ef14f5dbd9e5d503ecba72f]). Expected version 2 got 0
I20260928 20:03:42.371289 26658 raft_consensus.cc:2393] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:42.372543 29834 consensus_queue.cc:1048] T 9491e639008c4678814d2f72beb04c3c P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.374910 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:42.375643 26657 raft_consensus.cc:2393] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:42.378186 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b42615f62284e359cdc1f4c9cc715c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.378929 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf]
I20260928 20:03:42.379072 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf8cc998fb4039897ca93158c2202a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.380162 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_e2c97e1d3b2546f68c665d8cfaa60c67 [id=fa2dd6639ada4b49b975794d6ff359a4]
I20260928 20:03:42.380898 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c865d2d368847dd9de688bdd65e88b9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.381434 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_3df208002e624823846e63d97d7d9038 [id=fbd517599006491b92bd6e5869c4212d]
I20260928 20:03:42.382613 28488 catalog_manager.cc:692] Loaded metadata for table default.Table_db4ea683c5a44f919cbc94271cd36567 [id=fc063b01e61e4f5987f5a014fc218959]
I20260928 20:03:42.382942 26595 leader_election.cc:304] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.385807 29792 raft_consensus.cc:2749] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:42.395712 26594 leader_election.cc:343] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:42.396927 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 7e09ad691ec3444d938a04a5c572b0cb (table default.Table_9bd62df93b6941469bc0076ad8615256 [id=a08b15bce53c4223a8f7731b98bf02e0]). Expected version 1 got 0
I20260928 20:03:42.405926 26595 leader_election.cc:304] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.421303 26152 catalog_manager.cc:5838] T b3ee867b0443431ba816ee5309888080 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:42.422338 29834 raft_consensus.cc:2804] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:42.422802 29834 raft_consensus.cc:697] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.423563 29834 consensus_queue.cc:237] T 7d694b56de2a4954a367c2efa80aa276 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.424574 26913 tablet_bootstrap.cc:492] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:42.425050 26913 ts_tablet_manager.cc:1449] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.137s user 0.026s sys 0.012s
W20260928 20:03:42.428398 26594 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
W20260928 20:03:42.429298 26594 leader_election.cc:343] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:42.429730 26912 ts_tablet_manager.cc:1480] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.167s user 0.005s sys 0.000s
W20260928 20:03:42.429843 26594 leader_election.cc:343] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: d13562e920244194969520df564a949d
I20260928 20:03:42.430215 29932 consensus_queue.cc:1059] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.431062 29932 consensus_queue.cc:1243] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Peer b2d286f4404146278f5e0785ed9fcee4 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260928 20:03:42.431609 29932 raft_consensus.cc:3055] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260928 20:03:42.432034 29932 raft_consensus.cc:740] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.432487 26595 leader_election.cc:304] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.432845 29932 consensus_queue.cc:260] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.434409 29932 raft_consensus.cc:3060] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:42.441036 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.432621 26913 raft_consensus.cc:359] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.442528 26913 raft_consensus.cc:385] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.442927 26913 raft_consensus.cc:740] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.444620 29895 raft_consensus.cc:2804] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:42.446370 29895 raft_consensus.cc:697] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.447602 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0]). Expected version 1 got 0
I20260928 20:03:42.447566 29895 consensus_queue.cc:237] T 11216db10dc54e9fa8a7466643f8e413 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:42.444552 26913 consensus_queue.cc:260] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.457628 26913 ts_tablet_manager.cc:1480] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260928 20:03:42.458755 26913 tablet_bootstrap.cc:492] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:42.459643 29935 raft_consensus.cc:493] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.460253 29935 raft_consensus.cc:515] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.451586 26152 catalog_manager.cc:5838] T eb02b1f6bf4e43a08a3331438bf8e362 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:42.462332 29935 leader_election.cc:290] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.464200 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet eb02b1f6bf4e43a08a3331438bf8e362 (table default.Table_45a011677059457aad4891d7756d6e76 [id=adee36b5ad4b4575a43039f4666dbb10]). Expected version 1 got 0
I20260928 20:03:42.465284 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea]). Expected version 1 got 0
I20260928 20:03:42.468174 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed3cd78c90c42f6a99a92bae2cd5491" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.468485 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.472815 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf]). Expected version 1 got 0
I20260928 20:03:42.474828 26152 catalog_manager.cc:5838] T 74f9252dd72c46b3acf84be7feb6a4f1 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:42.476722 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b]). Expected version 1 got 0
I20260928 20:03:42.490247 26913 tablet_bootstrap.cc:654] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.491595 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.477497 26152 catalog_manager.cc:5838] T c49aa062e7674a47ac68fdadf68980b8 P 92fd8074a7df4bba87a73c0d84ed00c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194). New cstate: current_term: 1 leader_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } health_report { overall_health: UNKNOWN } } }
I20260928 20:03:42.495376 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d]). Expected version 1 got 0
I20260928 20:03:42.478551 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7c544b3449427dab981465e2e08a38" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.499812 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e1d6dcd913394d4ca2e4b9f5be5ea069 (table default.Table_741f8f3a7aec43c3af7decc959ca0938 [id=d470ed945a154ff081f5e46e0377f77c]). Expected version 1 got 0
I20260928 20:03:42.504163 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet 9db52eb6b080457583b0a59291995843 (table default.Table_a0353fc8b2fd4450b0a95898683a518d [id=a348fb5e772743aa9185aa2406fb492a]). Expected version 2 got 0
I20260928 20:03:42.508356 26152 catalog_manager.cc:5938] TS 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277) does not have the latest schema for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca]). Expected version 1 got 0
I20260928 20:03:42.510710 26595 leader_election.cc:304] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.512527 26595 leader_election.cc:304] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.520385 26159 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_448e0060fd3d49018e59b4875da55674 [id=474b74c08e6348da8e5de4405064735f] alter complete (version 5)
I20260928 20:03:42.527010 26161 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_e078e9ee7df74c4da5e5073aac7da2f0 [id=a26768bb726f40b4b02df89d76316f41] alter complete (version 1)
I20260928 20:03:42.529914 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.531778 26912 tablet_bootstrap.cc:492] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:42.513124 30010 raft_consensus.cc:2804] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:03:42.514194 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40942986095446f8a1b13da12315e804" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.543893 30010 raft_consensus.cc:697] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.544734 30010 consensus_queue.cc:237] T 3657e36a6d2844c28852db1a4f2ed191 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.546466 29985 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.546949 29985 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.548897 29985 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.550357 29792 raft_consensus.cc:2804] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:42.550869 29792 raft_consensus.cc:697] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 LEADER]: Becoming Leader. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Running, Role: LEADER
I20260928 20:03:42.551605 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.551833 29792 consensus_queue.cc:237] T 9d2a20c1c6464f228baae236015349c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
W20260928 20:03:42.557276 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 44826.9us
I20260928 20:03:42.562650 26916 tablet_bootstrap.cc:492] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:42.562973 26514 raft_consensus.cc:1275] T a3717aae560f428b9cb7cf732dc71497 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260928 20:03:42.529433 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 98808.9us
I20260928 20:03:42.536502 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bd721cb5b34b9288fad286290db847" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.515350 26913 tablet_bootstrap.cc:492] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:42.573357 26913 ts_tablet_manager.cc:1449] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.115s user 0.014s sys 0.001s
W20260928 20:03:42.574244 26594 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3
I20260928 20:03:42.576203 29978 consensus_queue.cc:1048] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:42.574182 26595 leader_election.cc:343] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 292eef7bab904a7ea5ef6dbdaba1d37d
W20260928 20:03:42.577430 26594 leader_election.cc:343] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:42.578961 26594 leader_election.cc:343] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:42.590415 26595 leader_election.cc:304] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.596448 26912 tablet_bootstrap.cc:654] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.599967 30008 raft_consensus.cc:2749] T 292eef7bab904a7ea5ef6dbdaba1d37d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.602918 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.602030 26913 raft_consensus.cc:359] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.615680 26916 tablet_bootstrap.cc:654] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.617805 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec056d6f6b0461da1f0a4525b711c8c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:42.611739 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.619640 29935 raft_consensus.cc:493] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.620293 29935 raft_consensus.cc:515] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.619724 29897 raft_consensus.cc:493] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.622198 26913 raft_consensus.cc:385] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.622503 26913 raft_consensus.cc:740] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.622323 29897 raft_consensus.cc:515] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.624207 29897 leader_election.cc:290] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.624703 29897 raft_consensus.cc:493] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.625149 29897 raft_consensus.cc:515] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.626796 29935 leader_election.cc:290] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.628367 29897 leader_election.cc:290] T cf1ac58577c345ee817e45b340601185 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.629829 26913 consensus_queue.cc:260] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.631825 26913 ts_tablet_manager.cc:1480] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.058s user 0.005s sys 0.001s
I20260928 20:03:42.632652 26913 tablet_bootstrap.cc:492] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:42.648676 29976 raft_consensus.cc:493] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.649230 29976 raft_consensus.cc:515] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.650591 30005 raft_consensus.cc:493] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:42.651099 30005 raft_consensus.cc:515] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.651552 29976 leader_election.cc:290] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.652859 29935 raft_consensus.cc:493] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.653230 30005 leader_election.cc:290] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.653630 29935 raft_consensus.cc:515] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.655671 29935 leader_election.cc:290] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.656682 29935 raft_consensus.cc:493] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.657274 29935 raft_consensus.cc:515] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.657593 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec056d6f6b0461da1f0a4525b711c8c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:42.659461 29935 leader_election.cc:290] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:42.662261 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 56045us
I20260928 20:03:42.661154 26913 tablet_bootstrap.cc:654] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
W20260928 20:03:42.670260 26595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 69487.3us
I20260928 20:03:42.671705 30007 consensus_queue.cc:1048] T d1b2dd9c6b864bb68925bf0687fb67d7 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.673353 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:42.638664 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 44299.7us
I20260928 20:03:42.697013 26912 tablet_bootstrap.cc:492] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:42.699242 26912 ts_tablet_manager.cc:1449] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.168s user 0.011s sys 0.000s
I20260928 20:03:42.703095 30022 raft_consensus.cc:493] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.703651 30022 raft_consensus.cc:515] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.706597 30022 leader_election.cc:290] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.721028 26913 tablet_bootstrap.cc:492] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:42.721421 26913 ts_tablet_manager.cc:1449] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.089s user 0.007s sys 0.004s
I20260928 20:03:42.722059 30010 consensus_queue.cc:1048] T 45dd4297f4aa400aa3be253bc3168390 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.723950 26913 raft_consensus.cc:359] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.724742 26913 raft_consensus.cc:385] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.725001 26913 raft_consensus.cc:740] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.744782 26595 leader_election.cc:304] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.746901 30010 raft_consensus.cc:2749] T 8eb99b1b34b844b4b6bdbd52c646f087 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:42.756966 30011 consensus_queue.cc:1048] T d8c3346e3db1400c98623724cdf54901 P 92fd8074a7df4bba87a73c0d84ed00c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:42.758451 26595 leader_election.cc:343] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 12a86cd5167c43a4beb51cd3138cdef8
I20260928 20:03:42.761298 26595 leader_election.cc:304] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.765246 30010 raft_consensus.cc:2749] T 12a86cd5167c43a4beb51cd3138cdef8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:42.766371 26595 leader_election.cc:343] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 4e6ff2fe1d054eeebeebc6b3b5b5e4c1
I20260928 20:03:42.770324 26595 leader_election.cc:304] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.771030 30010 raft_consensus.cc:2749] T 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.772157 26595 leader_election.cc:304] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.776779 30010 raft_consensus.cc:2804] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:42.777171 30010 raft_consensus.cc:493] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:42.777541 30010 raft_consensus.cc:3060] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:42.784322 30010 raft_consensus.cc:515] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.789113 26515 raft_consensus.cc:1275] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 5 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260928 20:03:42.796629 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 143662us
I20260928 20:03:42.799837 29976 consensus_queue.cc:1048] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 20:03:42.802522 30010 leader_election.cc:290] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.804298 29976 consensus_queue.cc:1048] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.805512 26912 raft_consensus.cc:359] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.806435 26912 raft_consensus.cc:385] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.806751 26912 raft_consensus.cc:740] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.725720 26913 consensus_queue.cc:260] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.786091 26595 leader_election.cc:304] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:42.815337 26595 leader_election.cc:343] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: d13562e920244194969520df564a949d
I20260928 20:03:42.815726 26595 leader_election.cc:304] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.816334 30007 raft_consensus.cc:2749] T d13562e920244194969520df564a949d P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:42.816677 26595 leader_election.cc:343] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: f55c1732e13e4e2ab4f5c5d80d0fa4f6
I20260928 20:03:42.817049 26595 leader_election.cc:304] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.817638 30007 raft_consensus.cc:2749] T f55c1732e13e4e2ab4f5c5d80d0fa4f6 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.818097 26595 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.823922 30011 raft_consensus.cc:2749] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260928 20:03:42.824828 26595 leader_election.cc:343] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 78d5de4a82bd41c1a8b2af2ba7417c46
I20260928 20:03:42.825183 26595 leader_election.cc:304] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.825685 29976 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.825794 30011 raft_consensus.cc:2749] T 78d5de4a82bd41c1a8b2af2ba7417c46 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.826297 29976 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.826764 26595 leader_election.cc:304] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.827375 30011 raft_consensus.cc:2804] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:42.827692 30011 raft_consensus.cc:493] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:42.828006 30011 raft_consensus.cc:3060] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:42.828811 29976 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:42.834527 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 97777.6us
I20260928 20:03:42.835471 30011 raft_consensus.cc:515] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.819847 26913 ts_tablet_manager.cc:1480] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.098s user 0.007s sys 0.000s
I20260928 20:03:42.815498 30010 raft_consensus.cc:2804] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:42.838744 30010 raft_consensus.cc:493] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:42.839169 30010 raft_consensus.cc:3060] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:42.839294 26913 tablet_bootstrap.cc:492] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:42.851248 30010 raft_consensus.cc:515] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.853595 30010 leader_election.cc:290] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:42.854719 26595 leader_election.cc:343] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323): Not found: Tablet not found: 626a876a51d04095b5dd54726bb995f3
I20260928 20:03:42.855156 26595 leader_election.cc:304] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.855826 30010 raft_consensus.cc:2749] T 626a876a51d04095b5dd54726bb995f3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.856379 26595 leader_election.cc:304] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:42.857062 30007 raft_consensus.cc:2749] T 0dc1eea43de1459aa49e7072cf8b89ca P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:42.856819 26912 consensus_queue.cc:260] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.864952 26155 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f] alter complete (version 1)
I20260928 20:03:42.870491 26161 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_13971cf4060b47aea813d1ea311e8347 [id=911769c45f044f3b8772d685b79d2e30] alter complete (version 3)
I20260928 20:03:42.877588 26913 tablet_bootstrap.cc:654] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:42.890718 26739 leader_election.cc:304] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:42.895133 30011 leader_election.cc:290] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Requested vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.924674 26912 ts_tablet_manager.cc:1480] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.225s user 0.006s sys 0.000s
I20260928 20:03:42.930335 29976 raft_consensus.cc:2749] T 9b943773d8804b0db0fbed9978461690 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260928 20:03:42.944931 30007 raft_consensus.cc:493] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.945432 30007 raft_consensus.cc:515] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.947563 30007 leader_election.cc:290] T 2d02292105e6430c9231f26b62befe34 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.949679 29932 raft_consensus.cc:493] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.950147 29932 raft_consensus.cc:515] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.952085 29932 leader_election.cc:290] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:42.975564 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 178038us
W20260928 20:03:42.976234 26450 leader_election.cc:343] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:42.976649 29792 raft_consensus.cc:493] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
W20260928 20:03:42.976835 26450 leader_election.cc:343] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:42.977423 26450 leader_election.cc:343] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:42.977108 29792 raft_consensus.cc:515] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.978663 30010 raft_consensus.cc:493] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:42.979046 29792 leader_election.cc:290] T fa49943f465f47778ac985cb5f4e6c0f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.979725 30010 raft_consensus.cc:515] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.981747 30010 leader_election.cc:290] T d8d27cbf353246fbb7fe09f385194d8a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:42.983582 26500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:42.986754 29897 consensus_queue.cc:1048] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:42.988031 26913 tablet_bootstrap.cc:492] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:42.988457 26913 ts_tablet_manager.cc:1449] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.149s user 0.005s sys 0.005s
I20260928 20:03:42.979650 30022 raft_consensus.cc:493] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:42.988835 30022 raft_consensus.cc:515] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.990622 30022 leader_election.cc:290] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:42.996569 26916 tablet_bootstrap.cc:492] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:42.996995 26916 ts_tablet_manager.cc:1449] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.435s user 0.009s sys 0.009s
I20260928 20:03:42.996793 26913 raft_consensus.cc:359] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:42.997505 26913 raft_consensus.cc:385] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:42.997776 26913 raft_consensus.cc:740] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:42.998551 26913 consensus_queue.cc:260] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.007836 28488 tablet_loader.cc:96] loaded metadata for tablet 01e47444ae914b07a7e3e64711423635 (table default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200])
I20260928 20:03:43.017505 26916 raft_consensus.cc:359] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.020300 26916 raft_consensus.cc:385] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:43.018930 26503 raft_consensus.cc:1275] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 20:03:43.021456 26916 raft_consensus.cc:740] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:43.023296 26916 consensus_queue.cc:260] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.024494 29978 consensus_queue.cc:1048] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 20:03:43.039625 26916 ts_tablet_manager.cc:1480] T 2034cd490bd14992aa2572f31d2ff63b P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.042s user 0.003s sys 0.002s
I20260928 20:03:43.051954 29978 consensus_queue.cc:1048] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:43.009837 28488 tablet_loader.cc:96] loaded metadata for tablet 029a15ae85ff48d897493156fdd41d3b (table default.Table_00bbdd0087ac436396fddc9c73673ae2 [id=c34bfbfc9c244b1eb9a7d399ee1b1a5d])
I20260928 20:03:43.059502 28488 tablet_loader.cc:96] loaded metadata for tablet 03bd721cb5b34b9288fad286290db847 (table default.Table_c6c5485157f74500b90a91d0746c56c8 [id=05cd39c9e51048d4a3b1bf73fe3a7f29])
W20260928 20:03:43.044606 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 66620.8us
W20260928 20:03:43.069193 26450 leader_election.cc:343] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.070410 26450 leader_election.cc:343] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.094244 28488 tablet_loader.cc:96] loaded metadata for tablet 03d9d379b2e647d1a020406acc54bc75 (table default.Table_3a1fe1bee5784c8d936a31fa0096fba5 [id=87bf48e613d0414a84c54b826d03f2f8])
I20260928 20:03:43.098690 29897 raft_consensus.cc:493] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.099334 29897 raft_consensus.cc:515] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.101912 29897 leader_election.cc:290] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:43.103291 26450 leader_election.cc:343] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.103947 26450 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:43.108517 30038 consensus_queue.cc:1048] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:43.109257 29897 raft_consensus.cc:2804] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:03:43.109671 29897 raft_consensus.cc:493] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:43.110073 29897 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:43.129042 28488 tablet_loader.cc:96] loaded metadata for tablet 046ed3ac8b6b46afbc1e1bde4b2365ef (table default.Table_12db5cb4890d4a1aa01c4c814765353b [id=43358fe86db543f2a98a1cd7cf4a450f])
I20260928 20:03:43.148228 29897 raft_consensus.cc:515] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.165633 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:43.186524 28488 tablet_loader.cc:96] loaded metadata for tablet 04a3511e5f1b42e4b48342a50f013fd0 (table default.Table_575791770cc143c88f796244c47743b1 [id=8cbba9c0c77e41049e7fdc976988236e])
I20260928 20:03:43.188100 28488 tablet_loader.cc:96] loaded metadata for tablet 06e4d7f4ee1a4e77aaf5190a550c56a8 (table default.Table_15a05c7f96404a8484bdae6486a0e200 [id=0638881ba45a4723982d3126ef623e3c])
I20260928 20:03:43.189855 28488 tablet_loader.cc:96] loaded metadata for tablet 06f7b05e756f4a4db5031ff1e14c6ff6 (table default.Table_415d1f100c494194b1cdf75679f205c1 [id=addeb54902cd404ea49e39c999bdfca2])
I20260928 20:03:43.191601 26913 ts_tablet_manager.cc:1480] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.203s user 0.008s sys 0.000s
I20260928 20:03:43.216441 26913 tablet_bootstrap.cc:492] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:43.218339 30005 raft_consensus.cc:493] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.225505 30005 raft_consensus.cc:515] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.227402 30005 leader_election.cc:290] T 04a3511e5f1b42e4b48342a50f013fd0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.228569 26913 tablet_bootstrap.cc:654] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.228636 26161 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_f0822cba073a4ff5a7062f55af0df8e1 [id=25d5fa0c93cd4ccb8df95b79e830743a] alter complete (version 2)
I20260928 20:03:43.233982 26912 tablet_bootstrap.cc:492] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:43.240511 26912 tablet_bootstrap.cc:654] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.171216 26500 raft_consensus.cc:1275] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260928 20:03:43.174253 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 70380.6us
I20260928 20:03:43.178694 26916 tablet_bootstrap.cc:492] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:43.179905 30038 raft_consensus.cc:493] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.250736 30038 raft_consensus.cc:515] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.252017 30010 raft_consensus.cc:493] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:43.252894 30038 leader_election.cc:290] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:43.252602 30010 raft_consensus.cc:515] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.254649 29897 leader_election.cc:290] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:43.257393 26916 tablet_bootstrap.cc:654] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.258941 30010 leader_election.cc:290] T b667a45712c1449384e1a288f55fd062 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.270666 29976 consensus_queue.cc:1048] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260928 20:03:43.257951 26450 leader_election.cc:343] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.286170 26450 leader_election.cc:343] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.286988 26450 leader_election.cc:343] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.287631 26450 leader_election.cc:343] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.290913 26450 leader_election.cc:343] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.293586 30010 raft_consensus.cc:493] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.294127 30010 raft_consensus.cc:515] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.296612 30010 leader_election.cc:290] T 7053ca61ed6e4f6dbf1f5adb54728792 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:43.299787 26450 leader_election.cc:343] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.300578 26450 leader_election.cc:343] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.301398 26450 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4; no voters:
I20260928 20:03:43.302438 30010 raft_consensus.cc:493] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.303125 30010 raft_consensus.cc:515] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.306885 28488 tablet_loader.cc:96] loaded metadata for tablet 09bd74bc45d14e789567df6019f6d99b (table default.Table_c09e6bb3097d44b893bed32fd069330c [id=3dab28923da541d880df28b2119b4de3])
I20260928 20:03:43.309756 28488 tablet_loader.cc:96] loaded metadata for tablet 0abf33cd0d114c25a729bd0eb8ae1278 (table default.Table_cc62772283e74f1f82b9c82db3fdd7e6 [id=de3c28dce8ca434ea9e3ee884af5cd92])
I20260928 20:03:43.323228 30010 leader_election.cc:290] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:43.335922 26594 leader_election.cc:343] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.337210 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:43.339146 26654 raft_consensus.cc:2393] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 2: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:43.339594 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc1eea43de1459aa49e7072cf8b89ca" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:43.340452 26913 tablet_bootstrap.cc:492] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:43.340937 26913 ts_tablet_manager.cc:1449] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.125s user 0.004s sys 0.011s
I20260928 20:03:43.342154 30007 raft_consensus.cc:493] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:43.342666 30007 raft_consensus.cc:515] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.344817 30007 leader_election.cc:290] T 3eb8477c5cb74205b4b55eb38d7f9542 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.346009 26153 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_5ba4c601ff274fa3a64efd31ccbc6074 [id=f017a4846b1a4583ba89acf078c09200] alter complete (version 1)
I20260928 20:03:43.352598 26913 raft_consensus.cc:359] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.353246 26913 raft_consensus.cc:385] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:43.353513 26913 raft_consensus.cc:740] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
W20260928 20:03:43.355523 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 54177.9us
I20260928 20:03:43.358397 26913 consensus_queue.cc:260] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.361411 26913 ts_tablet_manager.cc:1480] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260928 20:03:43.362399 26913 tablet_bootstrap.cc:492] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:43.374243 26912 tablet_bootstrap.cc:492] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:43.374934 26912 ts_tablet_manager.cc:1449] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.141s user 0.008s sys 0.003s
I20260928 20:03:43.377403 26912 raft_consensus.cc:359] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.382406 26154 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_90656b85fa2b48e5a18e4cfe1cfcfa3c [id=55d0d2bfce9844fab53d8e8033613353] alter complete (version 2)
I20260928 20:03:43.388882 28488 tablet_loader.cc:96] loaded metadata for tablet 0b42615f62284e359cdc1f4c9cc715c5 (table default.Table_f22655fc8af44cc09c6b5a28890481cd [id=4992ddf5487740f5804265da15ba89b0])
W20260928 20:03:43.407333 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 50812.9us
I20260928 20:03:43.412600 26916 tablet_bootstrap.cc:492] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:43.413086 26916 ts_tablet_manager.cc:1449] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.235s user 0.008s sys 0.003s
I20260928 20:03:43.378078 26912 raft_consensus.cc:385] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:43.425660 26912 raft_consensus.cc:740] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:43.442499 28488 tablet_loader.cc:96] loaded metadata for tablet 0dc1eea43de1459aa49e7072cf8b89ca (table default.Table_41eb33d0c44a48a28f171db5335aea9c [id=66b50341578047e983dc27bd7c609f8a])
I20260928 20:03:43.426473 26912 consensus_queue.cc:260] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:43.468039 26450 leader_election.cc:343] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.468796 26450 leader_election.cc:343] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.469604 26450 leader_election.cc:343] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.477044 26450 leader_election.cc:343] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.484411 26912 ts_tablet_manager.cc:1480] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.109s user 0.003s sys 0.003s
I20260928 20:03:43.489166 28488 tablet_loader.cc:96] loaded metadata for tablet 0fd962ebd7d9413e866b0cfee2cd7134 (table default.Table_c8183923a3404bd68e48ca401b6f5a52 [id=07ce19d2d0944a08b740c4e88ecdcadb])
W20260928 20:03:43.502290 26450 leader_election.cc:343] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:43.502939 26450 leader_election.cc:343] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.504519 26450 leader_election.cc:304] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.496622 30038 raft_consensus.cc:2804] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:03:43.504769 29897 consensus_queue.cc:1048] T 46c39c6915964116ac14ea2781c7a52b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260928 20:03:43.518801 30038 raft_consensus.cc:493] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:43.519227 30038 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:43.525835 26450 leader_election.cc:304] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.527092 30025 raft_consensus.cc:2749] T 47bf3dd9ed054197b4208324938d96b0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:43.528904 26450 leader_election.cc:304] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.529474 29897 raft_consensus.cc:2749] T e868e5a3ebd2494ca20e1e08a146850e P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:43.530432 30039 raft_consensus.cc:2749] T 3b0694e341d64cdea99bb462beb1150b P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260928 20:03:43.531457 26450 leader_election.cc:343] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.531912 26450 leader_election.cc:304] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.532580 29897 raft_consensus.cc:2749] T 7b1a8c85b6bc4849b447b6fd048afb2f P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.553782 30025 raft_consensus.cc:493] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.554338 30025 raft_consensus.cc:515] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.556303 30025 leader_election.cc:290] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:43.559352 26450 leader_election.cc:343] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.498400 28488 tablet_loader.cc:96] loaded metadata for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc])
I20260928 20:03:43.563763 26153 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_99563ab39a854e5d9d4d2968f07bfe84 [id=0c98275433a24292b35617002df2cf6b] alter complete (version 3)
I20260928 20:03:43.567924 26450 leader_election.cc:304] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.573447 30025 raft_consensus.cc:2749] T 693cc46819bf4480b5cef0f9b92e66b2 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.587319 26916 raft_consensus.cc:359] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.587977 26916 raft_consensus.cc:385] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:43.588243 26916 raft_consensus.cc:740] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:43.589615 28488 tablet_loader.cc:96] loaded metadata for tablet 158ddf1201784a93ada93e629befa030 (table default.Table_a902e3fae2f041f2bbf4a0b16b4984d7 [id=c8f2b1af89cb41e288ff20cdd90d2923])
W20260928 20:03:43.592687 26450 leader_election.cc:343] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.593189 26450 leader_election.cc:304] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.485318 26912 tablet_bootstrap.cc:492] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:43.591627 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.594089 26804 raft_consensus.cc:3060] T d1b2dd9c6b864bb68925bf0687fb67d7 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:43.591073 26798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
W20260928 20:03:43.611382 26450 leader_election.cc:343] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.611944 30025 raft_consensus.cc:2749] T 95dfce3de1374f7a8c02c6898f6a741c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.587347 30038 raft_consensus.cc:515] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.615398 26514 raft_consensus.cc:1240] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [term 3 FOLLOWER]: Rejecting Update request from peer b2d286f4404146278f5e0785ed9fcee4 for earlier term 2. Current term is 3. Ops: []
I20260928 20:03:43.616389 30038 leader_election.cc:290] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:43.620301 29985 consensus_queue.cc:1059] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260928 20:03:43.623699 29983 raft_consensus.cc:3055] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260928 20:03:43.624050 29983 raft_consensus.cc:740] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Running, Role: LEADER
I20260928 20:03:43.631549 28488 tablet_loader.cc:96] loaded metadata for tablet 16796100116a4fe4a64893f49fb1cad4 (table default.Table_746822f22dac49c1b0b2562338e8dcb5 [id=953ae93d35534f35966832d4a4ab3fd6])
I20260928 20:03:43.632972 28488 tablet_loader.cc:96] loaded metadata for tablet 19331ec575fa42d79c0dc18123d26d71 (table default.Table_4654d78a319d429a8b9760da96f39a66 [id=3a9df4b02f0d43b388a0c7573f61b015])
I20260928 20:03:43.638383 26450 leader_election.cc:304] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:43.639711 26450 leader_election.cc:343] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.640314 30053 raft_consensus.cc:2749] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.640098 26916 consensus_queue.cc:260] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.641711 26916 ts_tablet_manager.cc:1480] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.228s user 0.005s sys 0.002s
I20260928 20:03:43.644982 26566 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:43.647953 26916 tablet_bootstrap.cc:492] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:43.640149 26450 leader_election.cc:304] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.649909 30039 raft_consensus.cc:2749] T e1f21c71dc0e41aba85bb01c9fddc12d P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:43.680068 26450 leader_election.cc:343] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.691116 30058 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.692133 30058 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
W20260928 20:03:43.694301 26740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.193:33323, user_credentials={real_user=slave}} blocked reactor thread for 57094.8us
I20260928 20:03:43.624811 29983 consensus_queue.cc:260] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.714157 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:43.729880 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:43.733309 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:43.686358 26450 leader_election.cc:304] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.737149 30039 raft_consensus.cc:2749] T 8d556a7736504aa2aa2fe8f868ecf489 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:43.737262 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 57238.2us
I20260928 20:03:43.738494 30039 consensus_queue.cc:1048] T 292fce41d80d47db93f95e2d4ee784ec P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:43.739768 26450 leader_election.cc:343] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.740134 26450 leader_election.cc:304] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
W20260928 20:03:43.741007 26450 leader_election.cc:343] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.741353 26450 leader_election.cc:304] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.741701 30053 raft_consensus.cc:2749] T 2a5ef01e0dbd49398b27911a713626cd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.686024 26916 tablet_bootstrap.cc:654] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.742328 30053 raft_consensus.cc:2749] T c3600b2fbb574106b5b13ab837754eb3 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.751751 26648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:43.752691 27922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5308dad1e3384995a990de7c4866f1b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 621 } } ignore_live_leader: false dest_uuid: "0b347187d9be4ad08708acffdf4dda63" is_pre_election: true
I20260928 20:03:43.752826 26654 raft_consensus.cc:1275] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260928 20:03:43.752763 26648 raft_consensus.cc:2468] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 2.
I20260928 20:03:43.753269 26654 pending_rounds.cc:85] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting all ops after (but not including) 0
I20260928 20:03:43.753545 26654 pending_rounds.cc:107] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260928 20:03:43.750948 26651 raft_consensus.cc:1275] T 61b2ba7635fd4a22ac367d3fdc4dd847 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 20:03:43.750948 26650 raft_consensus.cc:1275] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260928 20:03:43.754918 26649 raft_consensus.cc:1275] T ab9f9f2f9b96435e983f1ee2679563ff P 92fd8074a7df4bba87a73c0d84ed00c8 [term 5 FOLLOWER]: Refusing update from remote peer b2d286f4404146278f5e0785ed9fcee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260928 20:03:43.754829 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:43.753944 26654 raft_consensus.cc:2889] T a3717aae560f428b9cb7cf732dc71497 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260928 20:03:43.755659 26658 raft_consensus.cc:2468] T 292fce41d80d47db93f95e2d4ee784ec P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d286f4404146278f5e0785ed9fcee4 in term 1.
I20260928 20:03:43.760601 26221 leader_election.cc:304] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5308dad1e3384995a990de7c4866f1b1; no voters: 0b347187d9be4ad08708acffdf4dda63, fd517ada41af42d8b8d85ba1e657e003
I20260928 20:03:43.763583 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:43.764472 26659 raft_consensus.cc:2393] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
W20260928 20:03:43.772724 26450 leader_election.cc:343] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.773218 26450 leader_election.cc:304] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.787854 28488 tablet_loader.cc:96] loaded metadata for tablet 1d016129c3a140518cf310089360c7b7 (table default.Table_f5ee7c6935014820b8c56e2f899c3df2 [id=f2e53865ac994efc9d825b840c68e2fd])
I20260928 20:03:43.791160 30058 leader_election.cc:290] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 0b347187d9be4ad08708acffdf4dda63 (127.25.129.252:44461)
I20260928 20:03:43.791841 30058 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5308dad1e3384995a990de7c4866f1b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260928 20:03:43.801034 30038 raft_consensus.cc:2749] T 8536f4a4a0904806b71d4e7bf20c6bce P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.794319 26794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.795045 26803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.802492 26450 leader_election.cc:304] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.796551 26912 tablet_bootstrap.cc:654] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.807193 30038 raft_consensus.cc:2804] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:03:43.807783 30038 raft_consensus.cc:697] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [term 1 LEADER]: Becoming Leader. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Running, Role: LEADER
I20260928 20:03:43.808815 30038 consensus_queue.cc:237] T af1a7a5ed5914712b8fb3ceb487e03ff P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:43.819751 26450 leader_election.cc:343] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.820254 26450 leader_election.cc:304] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.825729 29834 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.830551 29792 raft_consensus.cc:493] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.830387 29834 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.831130 29792 raft_consensus.cc:515] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.832818 29792 leader_election.cc:290] T b13a571f3bd34209b0e6fd9441055eb1 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.832846 29834 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.835363 28488 tablet_loader.cc:96] loaded metadata for tablet 1d945be7bea449ba8c5541b60eb18334 (table default.Table_a42bcfe0f31f4f2aa7097da9c4c28a27 [id=cbaed4ca90cf431095e7fceb7456d95d])
I20260928 20:03:43.836238 26916 tablet_bootstrap.cc:492] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:43.839449 30025 raft_consensus.cc:2749] T f376f270145e44b3acb4b8b2437cba33 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.793045 29983 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:43.833158 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:43.840595 29985 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.852725 29985 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.855039 29985 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.836711 26916 ts_tablet_manager.cc:1449] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.189s user 0.008s sys 0.004s
I20260928 20:03:43.859659 26916 raft_consensus.cc:359] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.881124 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
W20260928 20:03:43.857123 26450 leader_election.cc:343] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.881898 26450 leader_election.cc:304] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.882692 30025 raft_consensus.cc:2749] T 158ddf1201784a93ada93e629befa030 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260928 20:03:43.886255 26450 leader_election.cc:343] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.886781 26450 leader_election.cc:304] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.881489 26916 raft_consensus.cc:385] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:43.888248 26916 raft_consensus.cc:740] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:43.888902 30025 raft_consensus.cc:2749] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.891677 29834 raft_consensus.cc:493] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:43.892421 29834 raft_consensus.cc:515] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.894249 26450 leader_election.cc:304] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.894881 29834 leader_election.cc:290] T 0a2d13d16d9946c6b09f9197c165033c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:43.888618 26913 tablet_bootstrap.cc:654] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.898126 30025 raft_consensus.cc:2749] T 5b276f21d85c4bb4bdd777f8f9a43960 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:43.907580 28488 tablet_loader.cc:96] loaded metadata for tablet 2034cd490bd14992aa2572f31d2ff63b (table default.Table_fedfb8c741fe405c9e165b3d9fe8488d [id=bae6830a9571494c9bf745909111f72e])
I20260928 20:03:43.908663 26156 catalog_manager.cc:6391] T 00000000000000000000000000000000 P fd517ada41af42d8b8d85ba1e657e003: default.Table_ba5e44badca344a2b91e22382cdb8ac1 [id=ec32368ba1694873892ec3f1a5140105] alter complete (version 2)
I20260928 20:03:43.913959 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.914546 26792 raft_consensus.cc:2468] T 04a3511e5f1b42e4b48342a50f013fd0 P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:43.893558 26916 consensus_queue.cc:260] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.916532 26916 ts_tablet_manager.cc:1480] T d046e04498494659a96139f051e7bbc9 P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.059s user 0.005s sys 0.000s
I20260928 20:03:43.917397 26916 tablet_bootstrap.cc:492] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:43.915109 26450 leader_election.cc:304] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.932714 30025 raft_consensus.cc:2749] T ab9f9f2f9b96435e983f1ee2679563ff P 9b44798af33f4733ba9cde0a1b541f54 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260928 20:03:43.933401 30025 consensus_queue.cc:1048] T 6e1791bc36c1449ebac8d1cef490be0a P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:43.935527 26450 leader_election.cc:304] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.940765 30025 raft_consensus.cc:2804] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:43.941111 30025 raft_consensus.cc:493] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:43.941439 30025 raft_consensus.cc:3060] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:43.949738 30025 raft_consensus.cc:515] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:43.951140 28488 tablet_loader.cc:96] loaded metadata for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf])
I20260928 20:03:43.954556 30025 leader_election.cc:290] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:43.968842 30062 raft_consensus.cc:493] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:43.970345 29895 raft_consensus.cc:493] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:43.971778 29895 raft_consensus.cc:515] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } }
I20260928 20:03:43.974687 29895 leader_election.cc:290] T 674eef4920f94d4f88aa5dc3a0b362d3 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
W20260928 20:03:43.979460 26450 leader_election.cc:343] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.979858 26450 leader_election.cc:304] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.980163 28488 tablet_loader.cc:96] loaded metadata for tablet 21cb34c5e33544c9875e7babf4830164 (table default.Table_84ebe3d10b2a47e1b20e07785732df98 [id=5ecb9e8630774dda8cb3cb4b7a83e2bd])
W20260928 20:03:43.980863 26450 leader_election.cc:343] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.981227 26450 leader_election.cc:304] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.981914 30038 raft_consensus.cc:2749] T 0b42615f62284e359cdc1f4c9cc715c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.982725 30038 raft_consensus.cc:2749] T 42cf8cc998fb4039897ca93158c2202a P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.988162 30025 consensus_queue.cc:1048] T d5b804dcff3d494cad06ba072a082c1b P 9b44798af33f4733ba9cde0a1b541f54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:03:43.989115 26450 leader_election.cc:343] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:43.990492 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7053ca61ed6e4f6dbf1f5adb54728792" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.990787 26450 leader_election.cc:304] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.992530 26916 tablet_bootstrap.cc:654] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:43.992839 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79967f9c7bf44678b9681449992776c5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.994968 30025 raft_consensus.cc:2749] T 7c865d2d368847dd9de688bdd65e88b9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:43.996027 26450 leader_election.cc:304] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.996747 30025 raft_consensus.cc:2749] T 3ed3cd78c90c42f6a99a92bae2cd5491 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:43.997876 26450 leader_election.cc:304] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:43.998764 30025 raft_consensus.cc:2749] T 3e7c544b3449427dab981465e2e08a38 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:43.998713 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1791bc36c1449ebac8d1cef490be0a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.999270 26795 raft_consensus.cc:2468] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 2.
I20260928 20:03:43.999991 26450 leader_election.cc:304] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:44.000735 30025 raft_consensus.cc:2749] T 40942986095446f8a1b13da12315e804 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:44.002494 26450 leader_election.cc:304] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:44.003156 30025 raft_consensus.cc:2749] T 03bd721cb5b34b9288fad286290db847 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260928 20:03:44.003252 26912 tablet_bootstrap.cc:492] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:44.003661 26912 ts_tablet_manager.cc:1449] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.519s user 0.010s sys 0.005s
W20260928 20:03:44.004244 26450 leader_election.cc:343] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:44.004770 26450 leader_election.cc:304] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:44.005388 30025 raft_consensus.cc:2749] T 210183ea66e349d0b8ef63c0964ca0c8 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:44.006268 26912 raft_consensus.cc:359] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.007010 26912 raft_consensus.cc:385] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:44.007318 26912 raft_consensus.cc:740] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.008101 26912 consensus_queue.cc:260] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.010460 26913 tablet_bootstrap.cc:492] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:44.011185 26913 ts_tablet_manager.cc:1449] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.649s user 0.006s sys 0.012s
W20260928 20:03:44.012912 26450 leader_election.cc:343] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:44.013314 26450 leader_election.cc:304] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b44798af33f4733ba9cde0a1b541f54; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:44.016881 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13a571f3bd34209b0e6fd9441055eb1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:43.969651 30062 raft_consensus.cc:515] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.019948 29895 raft_consensus.cc:493] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:44.020506 30062 leader_election.cc:290] T d5b804dcff3d494cad06ba072a082c1b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.020606 29895 raft_consensus.cc:515] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:44.024159 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.024478 29895 leader_election.cc:290] T d479a8eabc624569968515684e8acb0c P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:44.038347 30025 raft_consensus.cc:2749] T eec056d6f6b0461da1f0a4525b711c8c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:44.041198 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9d379b2e647d1a020406acc54bc75" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.041194 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d9d379b2e647d1a020406acc54bc75" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.041338 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31777af7102483fbcaab35a47d27852" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.042397 28488 tablet_loader.cc:96] loaded metadata for tablet 22e032f645304dbc88a895fae4bbd777 (table default.Table_baeaa1e844ee48898eccf65d0c3441e5 [id=e3d41b9cc97b481d9970c5d8d411ad18])
I20260928 20:03:44.043061 26595 leader_election.cc:304] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:44.043943 29895 raft_consensus.cc:2749] T 46c39c6915964116ac14ea2781c7a52b P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:03:44.044556 28488 tablet_loader.cc:96] loaded metadata for tablet 23e030d67e3a476abf25301e888fecc0 (table default.Table_a73a2c4a6d294cb987df6ae48260e81f [id=e2a7cdc56505468f8f6fbefaeefa8279])
I20260928 20:03:44.009972 26912 ts_tablet_manager.cc:1480] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260928 20:03:44.051210 26912 tablet_bootstrap.cc:492] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:44.053068 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807f3ef3db0f4319801baf86a331b98d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.056869 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807f3ef3db0f4319801baf86a331b98d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.058988 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e032f645304dbc88a895fae4bbd777" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.060946 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31777af7102483fbcaab35a47d27852" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.065649 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e032f645304dbc88a895fae4bbd777" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.071085 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.072455 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b825af9d04df38aebbb056f174ef7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.077172 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79967f9c7bf44678b9681449992776c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.067190 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bce47a5ab1a44989abe1761cab0c714" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.080474 26799 raft_consensus.cc:3060] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:44.087807 26913 raft_consensus.cc:359] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.088687 26913 raft_consensus.cc:385] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:44.089037 26913 raft_consensus.cc:740] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.091060 29895 raft_consensus.cc:493] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.093274 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf943cffdd440caa2978769faed7f2c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.095772 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a15ae85ff48d897493156fdd41d3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.098129 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaae231bea404219875c82340c09df2b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.103852 26916 tablet_bootstrap.cc:492] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:44.104568 26916 ts_tablet_manager.cc:1449] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.187s user 0.016s sys 0.002s
I20260928 20:03:44.107748 26916 raft_consensus.cc:359] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.108419 26916 raft_consensus.cc:385] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:44.108693 26916 raft_consensus.cc:740] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.109336 26916 consensus_queue.cc:260] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.111217 26916 ts_tablet_manager.cc:1480] T 9b6d3f0467684127af0fcaa3ddac3fdd P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260928 20:03:44.115442 30025 raft_consensus.cc:493] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.115913 30025 raft_consensus.cc:515] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.117722 30025 leader_election.cc:290] T 6048c2fc40cf48229c4822e6b68f9376 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:44.118719 30025 raft_consensus.cc:493] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.119096 30025 raft_consensus.cc:515] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.120788 30025 leader_election.cc:290] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:44.121835 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ac58577c345ee817e45b340601185" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.121979 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bce47a5ab1a44989abe1761cab0c714" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.123057 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b825af9d04df38aebbb056f174ef7" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.122923 29895 raft_consensus.cc:515] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.124179 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447b96436b34949a35f93b93732a820" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.124981 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79967f9c7bf44678b9681449992776c5" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.130554 26655 raft_consensus.cc:2468] T 79967f9c7bf44678b9681449992776c5 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 0.
I20260928 20:03:44.128021 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf943cffdd440caa2978769faed7f2c" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.140496 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447b96436b34949a35f93b93732a820" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.143541 26913 consensus_queue.cc:260] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.045778 28488 tablet_loader.cc:96] loaded metadata for tablet 25512bb19e3c4f78bb917378b10021e5 (table default.Table_09a9a6797bd34617aff7f0c93964e903 [id=157532da2514485cb531c59b261e43e0])
I20260928 20:03:44.147468 28488 tablet_loader.cc:96] loaded metadata for tablet 25595d85d1ad4ac7a80db4c55cd9c86f (table default.Table_2b9a194ac4714f1092a26ae9acfbe4a4 [id=5dd17091052d469d93789c8fd81515cd])
I20260928 20:03:44.149113 28488 tablet_loader.cc:96] loaded metadata for tablet 26797990cec14e87a4a30a3bbd2ff7c2 (table default.Table_219a0fee5c63431b9c6f80e4c01e0f05 [id=0da345aa29f640b983fe140edc5f154b])
I20260928 20:03:44.131246 29895 leader_election.cc:290] T 210183ea66e349d0b8ef63c0964ca0c8 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.152792 26792 raft_consensus.cc:3060] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:44.162137 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de40520ccd9b4a52a45c4085afd45b2d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.165709 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:44.166240 26804 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:44.167369 30038 raft_consensus.cc:493] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.167773 30038 raft_consensus.cc:515] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
W20260928 20:03:44.168419 26192 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7d60 after lost signal to thread 26129
W20260928 20:03:44.169094 26192 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8500 after lost signal to thread 26195
I20260928 20:03:44.170002 30038 leader_election.cc:290] T eac9b3e02fb541cab6d0d3c46743ff9e P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:44.171870 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a15ae85ff48d897493156fdd41d3b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.170593 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ccda8ef5d47ceb19b9b5ab6ad8c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.173067 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaae231bea404219875c82340c09df2b" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.174558 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19331ec575fa42d79c0dc18123d26d71" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:44.175151 26655 raft_consensus.cc:3060] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Advancing to term 3
I20260928 20:03:44.175522 26706 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
I20260928 20:03:44.171428 30038 raft_consensus.cc:493] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.177160 30038 raft_consensus.cc:515] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.179191 30038 leader_election.cc:290] T 44f337138bc84030a3edf1ec1248d456 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:44.186012 26737 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260928 20:03:44.193176 28488 tablet_loader.cc:96] loaded metadata for tablet 28c285483dd7460db934a160c5706d3d (table default.Table_f712a5a9fc0941c98d6a49bbecc89b54 [id=000233e0a59e4a449705a6f51fa93026])
I20260928 20:03:44.196130 26804 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
I20260928 20:03:44.180027 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.206419 26501 raft_consensus.cc:2468] T dba8a3870878487991e518ee46b36cca P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:44.181161 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1535def17b14663b42b76f3bc27001a" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:44.188280 26916 tablet_bootstrap.cc:492] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54: Bootstrap starting.
I20260928 20:03:44.214015 26916 tablet_bootstrap.cc:654] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:44.218087 26514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b2ba7635fd4a22ac367d3fdc4dd847" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.219987 26804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ac199f639c454cbc920012040f52c9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.232230 26912 tablet_bootstrap.cc:654] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:44.233897 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:44.249696 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.251592 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.253548 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de40520ccd9b4a52a45c4085afd45b2d" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.254272 30063 raft_consensus.cc:493] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:44.254741 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ccda8ef5d47ceb19b9b5ab6ad8c9a" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.254997 30063 raft_consensus.cc:515] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.255515 26913 ts_tablet_manager.cc:1480] T d2a658eaaedb4432a4dc2e1f5df6cc58 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.244s user 0.004s sys 0.006s
I20260928 20:03:44.257596 30063 leader_election.cc:290] T dc5b576c03794c9287959b5f94f42420 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.257915 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ac199f639c454cbc920012040f52c9" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.279567 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585030449f204e5782c3200758324ebc" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
W20260928 20:03:44.279882 26594 leader_election.cc:343] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Not found: Tablet not found: e5e8ff2ad1f745f88df6e471ed935f2f
I20260928 20:03:44.280195 26656 raft_consensus.cc:3060] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:44.283289 26655 raft_consensus.cc:2468] T 19331ec575fa42d79c0dc18123d26d71 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
I20260928 20:03:44.297258 30063 raft_consensus.cc:493] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:44.298200 30063 raft_consensus.cc:515] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.300910 30063 leader_election.cc:290] T 71272e843df3472ab06c4bd0be21d884 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.304840 26913 tablet_bootstrap.cc:492] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:44.309276 28488 tablet_loader.cc:96] loaded metadata for tablet 292fce41d80d47db93f95e2d4ee784ec (table default.Table_c0d08dc9a1fc43a7962c248deaa0b135 [id=4a965375dbb748ecbcb44f75035cbbb7])
I20260928 20:03:44.311035 26801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4"
I20260928 20:03:44.311494 28488 tablet_loader.cc:96] loaded metadata for tablet 29c54767c86649b599ef539765d2b2dd (table default.Table_ae0aaeea99ba48d2b04d9d08370b3285 [id=8e6dd7561593405fa1cb532f9a33e301])
I20260928 20:03:44.312786 28488 tablet_loader.cc:96] loaded metadata for tablet 29dd1355039e4bca952f13a9d174813e (table default.Table_f83033031d614d5a8a0749c87bec6898 [id=b86a97587c68400cb957c4e012acb7e3])
I20260928 20:03:44.336850 26799 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
I20260928 20:03:44.341822 30038 raft_consensus.cc:493] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.342823 30038 raft_consensus.cc:515] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.345067 30038 leader_election.cc:290] T a8909dfef9034dcc8e899fac6ae5d8f1 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
W20260928 20:03:44.347453 26161 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d3c3cffa96f043629e4bbfcf282d86bd consensus state has no leader
I20260928 20:03:44.350278 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c39c6915964116ac14ea2781c7a52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:45194
W20260928 20:03:44.350585 26161 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 11216db10dc54e9fa8a7466643f8e413 (table default.Table_2b1e7ffc2027409baf928d1f991d97b3 [id=0fefcb948cb44c7e8ea026076b0bfccc], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 11216db10dc54e9fa8a7466643f8e413 consensus state has no leader
I20260928 20:03:44.352248 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet de40520ccd9b4a52a45c4085afd45b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.358321 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.363564 26916 tablet_bootstrap.cc:492] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54: No bootstrap required, opened a new log
I20260928 20:03:44.364151 26916 ts_tablet_manager.cc:1449] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54: Time spent bootstrapping tablet: real 0.176s user 0.011s sys 0.001s
I20260928 20:03:44.380776 26656 raft_consensus.cc:2468] T 585030449f204e5782c3200758324ebc P 92fd8074a7df4bba87a73c0d84ed00c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b44798af33f4733ba9cde0a1b541f54 in term 3.
W20260928 20:03:44.383064 26145 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d3c3cffa96f043629e4bbfcf282d86bd (table default.Table_3467c5fa4d484abd960f94bf69f2c91a [id=de8ca1bb519941c19146335d14ba155d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d3c3cffa96f043629e4bbfcf282d86bd consensus state has no leader
I20260928 20:03:44.407621 26499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:44.407691 26516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1dc729477b8405d85c2c4a9c20a3efd" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
I20260928 20:03:44.408313 26516 raft_consensus.cc:3060] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:44.408481 26499 raft_consensus.cc:2393] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fd8074a7df4bba87a73c0d84ed00c8 in current term 1: Already voted for candidate 9b44798af33f4733ba9cde0a1b541f54 in this term.
W20260928 20:03:44.409305 26159 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet e1f21c71dc0e41aba85bb01c9fddc12d (table default.Table_be6662ebcd184f55b04530bf6cab44a6 [id=638372cdd2524730881f90fe443bd1ca], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e1f21c71dc0e41aba85bb01c9fddc12d consensus state has no leader
I20260928 20:03:44.425861 30098 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd517ada41af42d8b8d85ba1e657e003)
I20260928 20:03:44.426388 30098 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd517ada41af42d8b8d85ba1e657e003" member_type: VOTER last_known_addr { host: "127.25.129.254" port: 42899 } } peers { permanent_uuid: "5308dad1e3384995a990de7c4866f1b1" member_type: VOTER last_known_addr { host: "127.25.129.253" port: 32923 } } peers { permanent_uuid: "0b347187d9be4ad08708acffdf4dda63" member_type: VOTER last_known_addr { host: "127.25.129.252" port: 44461 } }
I20260928 20:03:44.430399 26166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b347187d9be4ad08708acffdf4dda63" candidate_term: 6 candidate_status { last_received { term: 5 index: 643 } } ignore_live_leader: false dest_uuid: "fd517ada41af42d8b8d85ba1e657e003" is_pre_election: true
I20260928 20:03:44.430884 30098 leader_election.cc:290] T 00000000000000000000000000000000 P 0b347187d9be4ad08708acffdf4dda63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd517ada41af42d8b8d85ba1e657e003 (127.25.129.254:42899), 5308dad1e3384995a990de7c4866f1b1 (127.25.129.253:32923)
I20260928 20:03:44.459416 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d02292105e6430c9231f26b62befe34" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.459990 26515 raft_consensus.cc:2468] T 2d02292105e6430c9231f26b62befe34 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:44.461884 30025 raft_consensus.cc:493] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.463871 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet b97ad3f841f54aa38bbb312c50db384e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:45194
W20260928 20:03:44.462278 26594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 180276us
I20260928 20:03:44.378940 30071 raft_consensus.cc:493] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:44.476325 30071 raft_consensus.cc:515] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.478564 30071 leader_election.cc:290] T 1dde3191a52b4254944ae1f8556e1632 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.392951 26912 tablet_bootstrap.cc:492] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:44.428099 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a31001f85b44bfcb35a29675f177b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.429337 26776 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.430667 26784 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.483258 26912 ts_tablet_manager.cc:1449] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.432s user 0.014s sys 0.000s
I20260928 20:03:44.433241 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.456082 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.457736 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.475744 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.464051 30025 raft_consensus.cc:515] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.493144 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.493454 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dde3191a52b4254944ae1f8556e1632" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.496275 26912 raft_consensus.cc:359] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.500301 26912 raft_consensus.cc:385] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:03:44.502840 26153 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f7017fddff974abda74574e39fd4e37c consensus state has no leader
W20260928 20:03:44.509312 26158 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet d2a658eaaedb4432a4dc2e1f5df6cc58 (table default.Table_4401852945304b65a0de8b1871be8684 [id=0266a3b47dac49d1b20b241e9cf91d1b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d2a658eaaedb4432a4dc2e1f5df6cc58 consensus state has no leader
I20260928 20:03:44.515491 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet e868e5a3ebd2494ca20e1e08a146850e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.517256 26912 raft_consensus.cc:740] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.517170 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a3511e5f1b42e4b48342a50f013fd0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.517746 26515 raft_consensus.cc:2468] T 04a3511e5f1b42e4b48342a50f013fd0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
W20260928 20:03:44.503363 26155 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet f7017fddff974abda74574e39fd4e37c (table default.Table_a40c2456c9084a4c8d24b485658b34dc [id=47c4c20178a8433dac9f644c8de48ac0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f7017fddff974abda74574e39fd4e37c consensus state has no leader
I20260928 20:03:44.516788 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.499682 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet fe680423497941578a5dfff2507e3334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.519160 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:51492
W20260928 20:03:44.520433 26155 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 210183ea66e349d0b8ef63c0964ca0c8 (table default.Table_36317d3e67f24e728b2f876d0acb6283 [id=7163beea98f0410a90915a1b66902dcf], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 210183ea66e349d0b8ef63c0964ca0c8 consensus state has no leader
I20260928 20:03:44.520777 26912 consensus_queue.cc:260] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.529261 28488 tablet_loader.cc:96] loaded metadata for tablet 2a5ef01e0dbd49398b27911a713626cd (table default.Table_bbca2cbf8d8a484eb1be9079bdc39d16 [id=0536459fb29241c08eaf6911fed23d02])
W20260928 20:03:44.526935 26158 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet dba8a3870878487991e518ee46b36cca (table default.Table_b4b057f5b20d4768a71c623605e9ad5b [id=3680556763df4b1ca38f01f41d14edea], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet dba8a3870878487991e518ee46b36cca consensus state has no leader
I20260928 20:03:44.532541 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet de40520ccd9b4a52a45c4085afd45b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.548671 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.549433 26780 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.550217 26781 tablet_service.cc:1558] Processing DeleteTablet for tablet ed48087b59c744f9a928c8d529b69211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:59 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.551043 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b11022fc774d18b92e0c694f834375 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.551832 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c39c6915964116ac14ea2781c7a52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.558338 30105 tablet_replica.cc:333] T bd3fa371924149fb814c8458488aea61 P b2d286f4404146278f5e0785ed9fcee4: stopping tablet replica
I20260928 20:03:44.558990 26912 ts_tablet_manager.cc:1480] T af1a7a5ed5914712b8fb3ceb487e03ff P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.075s user 0.005s sys 0.000s
I20260928 20:03:44.571623 26912 tablet_bootstrap.cc:492] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:44.574139 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet fa49943f465f47778ac985cb5f4e6c0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.563134 26739 leader_election.cc:304] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:44.578364 30071 raft_consensus.cc:2749] T 0dc1eea43de1459aa49e7072cf8b89ca P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:44.581758 26916 raft_consensus.cc:359] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.582684 26916 raft_consensus.cc:385] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:44.583004 26916 raft_consensus.cc:740] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b44798af33f4733ba9cde0a1b541f54, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.583777 26916 consensus_queue.cc:260] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.477876 26498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e030d67e3a476abf25301e888fecc0" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
W20260928 20:03:44.599628 26594 leader_election.cc:343] T 23e030d67e3a476abf25301e888fecc0 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.600986 26594 leader_election.cc:343] T b1dc729477b8405d85c2c4a9c20a3efd P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:44.596292 26649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad5978f7624bcdb63ca9e71d29b2e4" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8"
I20260928 20:03:44.613282 26649 raft_consensus.cc:2393] T 72ad5978f7624bcdb63ca9e71d29b2e4 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b44798af33f4733ba9cde0a1b541f54 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:44.615717 26491 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.616192 26913 tablet_bootstrap.cc:654] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:44.626730 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet e5e8ff2ad1f745f88df6e471ed935f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbffea517e2438d90ca234b9f72f733) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.639593 26485 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.639809 26482 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.639602 26487 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.640831 26477 tablet_service.cc:1558] Processing DeleteTablet for tablet 2239c466fa8e471e820173c67bc04cad with delete_type TABLET_DATA_DELETED (replaced by tablet b3ee867b0443431ba816ee5309888080) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.641620 26488 tablet_service.cc:1558] Processing DeleteTablet for tablet fe680423497941578a5dfff2507e3334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:45194
I20260928 20:03:44.642180 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce6188a8420478ab3565fbc9fb7e5e9" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.642760 26508 raft_consensus.cc:2468] T 4ce6188a8420478ab3565fbc9fb7e5e9 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:44.593142 26498 raft_consensus.cc:3060] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:03:44.647884 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet 23d262c7a15b434d8caea0a818323dd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.651161 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 03509d3602b345f69f059ae11c461920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.663369 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7053ca61ed6e4f6dbf1f5adb54728792" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.664188 26506 raft_consensus.cc:2468] T 7053ca61ed6e4f6dbf1f5adb54728792 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:44.675750 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a31001f85b44bfcb35a29675f177b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.675850 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 7775ad91c86840c49a902b059a0ff74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.678655 26516 raft_consensus.cc:2468] T b1dc729477b8405d85c2c4a9c20a3efd P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:44.685321 30087 tablet_replica.cc:333] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54: stopping tablet replica
I20260928 20:03:44.693090 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d7ab92a37c4f9b865fa9fe49d46916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.693421 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 0aad5c72e4c64b9e91082860477c78fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.697722 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet de40520ccd9b4a52a45c4085afd45b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.700098 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet f478cce587a548e1aab620721c3bb1c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 11216db10dc54e9fa8a7466643f8e413) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.701767 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3fa371924149fb814c8458488aea61 with delete_type TABLET_DATA_DELETED (replaced by tablet 0abf33cd0d114c25a729bd0eb8ae1278) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.707966 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 91b11022fc774d18b92e0c694f834375 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.708756 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet fe680423497941578a5dfff2507e3334 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.709699 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 62114712f2c040e6b1ae831911d68896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.710027 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d5de4a82bd41c1a8b2af2ba7417c46 with delete_type TABLET_DATA_DELETED (replaced by tablet 7e09ad691ec3444d938a04a5c572b0cb) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.710582 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet fa49943f465f47778ac985cb5f4e6c0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.711309 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet b667a45712c1449384e1a288f55fd062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:51 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.718321 26498 raft_consensus.cc:2468] T 23e030d67e3a476abf25301e888fecc0 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 1.
I20260928 20:03:44.719117 30059 consensus_queue.cc:1048] T 8eb99b1b34b844b4b6bdbd52c646f087 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260928 20:03:44.720786 30072 raft_consensus.cc:493] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:03:44.721364 30072 raft_consensus.cc:515] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.723531 30072 leader_election.cc:290] T 7d694b56de2a4954a367c2efa80aa276 P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.728024 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" is_pre_election: true
I20260928 20:03:44.729467 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c39c6915964116ac14ea2781c7a52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.722138 26495 tablet_service.cc:1558] Processing DeleteTablet for tablet 762cb728cc574a36a68fbe9033544b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:45194
W20260928 20:03:44.738332 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 141282us
I20260928 20:03:44.739217 26739 leader_election.cc:304] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:44.740121 30059 raft_consensus.cc:2804] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:03:44.740535 30059 raft_consensus.cc:493] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:44.740962 30059 raft_consensus.cc:3060] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:03:44.750283 28488 tablet_loader.cc:96] loaded metadata for tablet 2d02292105e6430c9231f26b62befe34 (table default.Table_13e7d4498d47478a98380826507fb5db [id=70b82415fbff445eafc0e1bc567e459a])
I20260928 20:03:44.752784 28488 tablet_loader.cc:96] loaded metadata for tablet 2d1c8e5a49db49f39e90c3737c33e8fc (table default.Table_07eb5136ed464c0b96fe89e451b99913 [id=f9cec72a647c4029be0cf94483c8c2cf])
I20260928 20:03:44.754141 28488 tablet_loader.cc:96] loaded metadata for tablet 2d90ce97d3db4bff8b2eea71c530c351 (table default.Table_99563ab39a854e5d9d4d2968f07bfe84 [id=0c98275433a24292b35617002df2cf6b])
I20260928 20:03:44.755254 30071 consensus_queue.cc:1048] T 61b2ba7635fd4a22ac367d3fdc4dd847 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:44.755816 30072 consensus_queue.cc:1048] T ab9f9f2f9b96435e983f1ee2679563ff P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260928 20:03:44.757174 28488 tablet_loader.cc:96] loaded metadata for tablet 309f8fcc50e545178888846ac90afcf2 (table default.Table_986d7757289e4ee0811e7ca166ab20bf [id=753169294cee4eca985d3b24b6c7b5c2])
I20260928 20:03:44.757544 26739 leader_election.cc:304] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, b2d286f4404146278f5e0785ed9fcee4; no voters: 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:44.759042 26916 ts_tablet_manager.cc:1480] T 9536760eb5114f23acac2918a0cd28bd P 9b44798af33f4733ba9cde0a1b541f54: Time spent starting tablet: real 0.395s user 0.007s sys 0.002s
I20260928 20:03:44.759820 26515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79967f9c7bf44678b9681449992776c5" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.760331 26515 raft_consensus.cc:2468] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
W20260928 20:03:44.764444 26158 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 387) took 14262 ms (client timeout 1000 ms). Trace:
I20260928 20:03:44.778405 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d694b56de2a4954a367c2efa80aa276" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.781615 26508 raft_consensus.cc:2393] T 7d694b56de2a4954a367c2efa80aa276 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2d286f4404146278f5e0785ed9fcee4 in current term 1: Already voted for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in this term.
I20260928 20:03:44.785893 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.786553 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.787148 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.787864 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.788807 26777 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.789064 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 762cb728cc574a36a68fbe9033544b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.789392 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet e868e5a3ebd2494ca20e1e08a146850e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.791152 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.792378 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.793538 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 2239c466fa8e471e820173c67bc04cad with delete_type TABLET_DATA_DELETED (replaced by tablet b3ee867b0443431ba816ee5309888080) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.794818 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.795979 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.797029 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b13a571f3bd34209b0e6fd9441055eb1" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.797621 30072 raft_consensus.cc:2804] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:03:44.797598 26497 raft_consensus.cc:2468] T b13a571f3bd34209b0e6fd9441055eb1 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fd8074a7df4bba87a73c0d84ed00c8 in term 0.
I20260928 20:03:44.797953 30072 raft_consensus.cc:493] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b44798af33f4733ba9cde0a1b541f54)
I20260928 20:03:44.798336 30072 raft_consensus.cc:3060] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:03:44.798547 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674eef4920f94d4f88aa5dc3a0b362d3" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.799597 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d479a8eabc624569968515684e8acb0c" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.801312 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.802839 26799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6048c2fc40cf48229c4822e6b68f9376" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.803630 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba8a3870878487991e518ee46b36cca" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.805121 26801 raft_consensus.cc:3060] T dc5b576c03794c9287959b5f94f42420 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:44.765772 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 388) took 11979 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.818362 26155 rpcz_store.cc:269] 0928 20:03:32.767469 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:32.767640 (+ 171us) service_pool.cc:224] Handling call
0928 20:03:44.746286 (+11978646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:42.605239 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:42.605816 (+ 577us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:42.605851 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:03:42.605876 (+ 25us) tablet.cc:662] Decoding operations
0928 20:03:42.606210 (+ 334us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:42.606268 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:42.606303 (+ 35us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:42.606537 (+ 234us) tablet.cc:701] Row locks acquired
0928 20:03:42.606555 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:03:42.606683 (+ 128us) write_op.cc:270] Start()
0928 20:03:42.606785 (+ 102us) write_op.cc:276] Timestamp: P: 1790625822606610 usec, L: 0
0928 20:03:42.606811 (+ 26us) op_driver.cc:348] REPLICATION: starting
0928 20:03:42.607477 (+ 666us) log.cc:844] Serialized 356 byte log entry
0928 20:03:42.836946 (+229469us) op_driver.cc:464] REPLICATION: finished
0928 20:03:42.862919 (+ 25973us) write_op.cc:301] APPLY: starting
0928 20:03:42.862986 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:42.863104 (+ 118us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:42.863222 (+ 118us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:42.863493 (+ 271us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:42.863658 (+ 165us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:42.863714 (+ 56us) write_op.cc:312] APPLY: finished
0928 20:03:42.863986 (+ 272us) log.cc:844] Serialized 23 byte log entry
0928 20:03:42.864152 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:42.864206 (+ 54us) write_op.cc:454] Released schema lock
0928 20:03:42.864245 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":761433,"reported_tablets":184,"child_traces":[["op",{"apply.queue_time_us":25718,"apply.run_cpu_time_us":1559,"apply.run_wall_time_us":1560,"num_ops":1,"prepare.queue_time_us":43184,"prepare.run_cpu_time_us":39702,"prepare.run_wall_time_us":183647,"raft.queue_time_us":90,"raft.run_cpu_time_us":864,"raft.run_wall_time_us":864,"replication_time_us":230007,"spinlock_wait_cycles":92160,"thread_start_us":246214,"threads_started":3,"wal-append.queue_time_us":171837}]]}
W20260928 20:03:44.826303 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 340) took 9675 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.826735 26155 rpcz_store.cc:269] 0928 20:03:35.151122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.826073 (+9674951us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.826230 (+ 157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.827703 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 390) took 8553 ms (client timeout 1000 ms). Trace:
I20260928 20:03:44.831485 26912 tablet_bootstrap.cc:654] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4: Neither blocks nor log segments found. Creating new log.
I20260928 20:03:44.842864 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f337138bc84030a3edf1ec1248d456" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
I20260928 20:03:44.844592 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac9b3e02fb541cab6d0d3c46743ff9e" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:44.847146 26155 rpcz_store.cc:269] 0928 20:03:36.274347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.827529 (+8553182us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.827650 (+ 121us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.785187 26161 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 386) took 17171 ms (client timeout 1000 ms). Trace:
I20260928 20:03:44.848706 30072 raft_consensus.cc:515] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.851902 26851 heartbeater.cc:499] Master 127.25.129.254:42899 was elected leader, sending a full tablet report...
W20260928 20:03:44.803285 26154 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 339) took 11923 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.853650 26154 rpcz_store.cc:269] 0928 20:03:32.880192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:32.880501 (+ 309us) service_pool.cc:224] Handling call
0928 20:03:44.803209 (+11922708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:43.280303 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:43.280785 (+ 482us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:43.280814 (+ 29us) write_op.cc:435] Acquired schema lock
0928 20:03:43.280825 (+ 11us) tablet.cc:662] Decoding operations
0928 20:03:43.281196 (+ 371us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:43.281237 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:43.281263 (+ 26us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:43.281428 (+ 165us) tablet.cc:701] Row locks acquired
0928 20:03:43.281445 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:03:43.281561 (+ 116us) write_op.cc:270] Start()
0928 20:03:43.281654 (+ 93us) write_op.cc:276] Timestamp: P: 1790625823281482 usec, L: 0
0928 20:03:43.281673 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:03:43.282240 (+ 567us) log.cc:844] Serialized 356 byte log entry
0928 20:03:43.380318 (+ 98078us) op_driver.cc:464] REPLICATION: finished
0928 20:03:43.380673 (+ 355us) write_op.cc:301] APPLY: starting
0928 20:03:43.380735 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:43.380845 (+ 110us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:43.380953 (+ 108us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:43.381206 (+ 253us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:43.381349 (+ 143us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:43.381395 (+ 46us) write_op.cc:312] APPLY: finished
0928 20:03:43.381600 (+ 205us) log.cc:844] Serialized 23 byte log entry
0928 20:03:43.381761 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:43.381819 (+ 58us) write_op.cc:454] Released schema lock
0928 20:03:43.381849 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0928 20:03:43.382080 (+ 231us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:43.383540 (+ 1460us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":413498,"reported_tablets":196,"child_traces":[["op",{"apply.queue_time_us":199,"apply.run_cpu_time_us":1366,"apply.run_wall_time_us":1365,"num_ops":1,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":2171,"prepare.run_wall_time_us":2172,"replication_time_us":98543}]]}
I20260928 20:03:44.856010 26795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8909dfef9034dcc8e899fac6ae5d8f1" candidate_uuid: "9b44798af33f4733ba9cde0a1b541f54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d286f4404146278f5e0785ed9fcee4" is_pre_election: true
W20260928 20:03:44.860971 26739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 103496us
I20260928 20:03:44.861881 30071 consensus_queue.cc:1048] T a3717aae560f428b9cb7cf732dc71497 P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260928 20:03:44.867906 26450 leader_election.cc:343] T 03d9d379b2e647d1a020406acc54bc75 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.868746 26450 leader_election.cc:343] T b31777af7102483fbcaab35a47d27852 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.869406 26450 leader_election.cc:343] T 807f3ef3db0f4319801baf86a331b98d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.870067 26450 leader_election.cc:343] T 22e032f645304dbc88a895fae4bbd777 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.870883 26450 leader_election.cc:343] T 9bce47a5ab1a44989abe1761cab0c714 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.871407 26450 leader_election.cc:343] T 9a6b825af9d04df38aebbb056f174ef7 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.872030 26450 leader_election.cc:343] T 6447b96436b34949a35f93b93732a820 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:44.872437 30116 tablet_replica.cc:333] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: stopping tablet replica
I20260928 20:03:44.872617 26450 leader_election.cc:304] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:44.875883 30071 consensus_queue.cc:1048] T d1535def17b14663b42b76f3bc27001a P b2d286f4404146278f5e0785ed9fcee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:03:44.880223 26775 tablet_service.cc:1558] Processing DeleteTablet for tablet b97ad3f841f54aa38bbb312c50db384e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.881982 26774 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:51492
I20260928 20:03:44.883845 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet 292eef7bab904a7ea5ef6dbdaba1d37d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.884931 26913 tablet_bootstrap.cc:492] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8: No bootstrap required, opened a new log
I20260928 20:03:44.885373 26913 ts_tablet_manager.cc:1449] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent bootstrapping tablet: real 0.581s user 0.004s sys 0.014s
W20260928 20:03:44.887600 26450 leader_election.cc:343] T 3cf943cffdd440caa2978769faed7f2c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.888232 26450 leader_election.cc:343] T 029a15ae85ff48d897493156fdd41d3b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.888832 26450 leader_election.cc:343] T aaae231bea404219875c82340c09df2b P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.889338 26450 leader_election.cc:343] T de40520ccd9b4a52a45c4085afd45b2d P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.890022 26450 leader_election.cc:343] T 952ccda8ef5d47ceb19b9b5ab6ad8c9a P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
W20260928 20:03:44.890690 26450 leader_election.cc:343] T d4ac199f639c454cbc920012040f52c9 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260928 20:03:44.895183 30116 raft_consensus.cc:2243] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:03:44.895838 30116 raft_consensus.cc:2272] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:03:44.895977 30059 raft_consensus.cc:515] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.900077 26739 leader_election.cc:304] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2d286f4404146278f5e0785ed9fcee4; no voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54
I20260928 20:03:44.901080 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ac6aaf0a2434c1fb74dd313fd4b7116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.902208 30071 raft_consensus.cc:2749] T d5b804dcff3d494cad06ba072a082c1b P b2d286f4404146278f5e0785ed9fcee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 20:03:44.902242 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet b97ad3f841f54aa38bbb312c50db384e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:53 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.903097 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 4056bc0590264672bd7c4f6d97050dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:52 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.904014 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6ff2fe1d054eeebeebc6b3b5b5e4c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:58 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.904459 30072 leader_election.cc:290] T 292fce41d80d47db93f95e2d4ee784ec P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 2 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.909463 26637 tablet_service.cc:1558] Processing DeleteTablet for tablet ed48087b59c744f9a928c8d529b69211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:59 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.911724 26912 tablet_bootstrap.cc:492] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4: No bootstrap required, opened a new log
I20260928 20:03:44.912258 26912 ts_tablet_manager.cc:1449] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4: Time spent bootstrapping tablet: real 0.341s user 0.010s sys 0.001s
I20260928 20:03:44.914541 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 3657e36a6d2844c28852db1a4f2ed191 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:57 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.912094 30116 ts_tablet_manager.cc:1962] T e5e8ff2ad1f745f88df6e471ed935f2f P 92fd8074a7df4bba87a73c0d84ed00c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:03:44.917042 30063 raft_consensus.cc:493] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:44.917619 30063 raft_consensus.cc:515] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.918846 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet d8d27cbf353246fbb7fe09f385194d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:48 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.919632 30063 leader_election.cc:290] T e3e86ccb8c334a54b42913bd5f405942 P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:44.919919 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2d13d16d9946c6b09f9197c165033c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:40 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.920239 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet 762cb728cc574a36a68fbe9033544b04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:55 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.924041 26913 raft_consensus.cc:359] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.925665 26913 raft_consensus.cc:385] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:03:44.926030 26913 raft_consensus.cc:740] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fd8074a7df4bba87a73c0d84ed00c8, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.926734 26913 consensus_queue.cc:260] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } }
I20260928 20:03:44.940253 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b804dcff3d494cad06ba072a082c1b" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.940765 26639 tablet_service.cc:1558] Processing DeleteTablet for tablet 030f48d0d716450aaa4248d9fb1397ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.940883 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 2239c466fa8e471e820173c67bc04cad with delete_type TABLET_DATA_DELETED (replaced by tablet b3ee867b0443431ba816ee5309888080) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.927738 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet f55c1732e13e4e2ab4f5c5d80d0fa4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.938746 26634 tablet_service.cc:1558] Processing DeleteTablet for tablet e868e5a3ebd2494ca20e1e08a146850e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:56 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.939091 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 12a86cd5167c43a4beb51cd3138cdef8 with delete_type TABLET_DATA_DELETED (replaced by tablet 30ef26307b9a459f8634d59b1ca373ef) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.942293 26631 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dde3191a52b4254944ae1f8556e1632 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:49 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.942863 26624 tablet_service.cc:1558] Processing DeleteTablet for tablet 626a876a51d04095b5dd54726bb995f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.944880 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71272e843df3472ab06c4bd0be21d884" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.836743 30118 raft_consensus.cc:493] T 5ac6aaf0a2434c1fb74dd313fd4b7116 P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
W20260928 20:03:44.771507 26153 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 389) took 10634 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.947449 26154 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 341) took 7487 ms (client timeout 1000 ms). Trace:
I20260928 20:03:44.945824 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5b576c03794c9287959b5f94f42420" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.951814 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292fce41d80d47db93f95e2d4ee784ec" candidate_uuid: "b2d286f4404146278f5e0785ed9fcee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54"
W20260928 20:03:44.828104 26158 rpcz_store.cc:269] 0928 20:03:30.501739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:30.501997 (+ 258us) service_pool.cc:224] Handling call
0928 20:03:44.742216 (+14240219us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b2400002048. stack: 00007fe59c081373 00007fe59c081270 00007fe59bc24574 0000000000516a24 00000000005169b9 00007fe59bf37881 00007fe59c07bba1 00007fe59c07ba52 00007fe5a4fcc1c9 00007fe59caffc60 00007fe59cb0cdef 00007fe5a5094b64 00007fe5a2c34fb4 00007fe5a2c34f42 00007fe5a2c34e71 00007fe5a2c34dec
0928 20:03:44.764327 (+ 22111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:34.817120 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:34.817597 (+ 477us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:34.817628 (+ 31us) write_op.cc:435] Acquired schema lock
0928 20:03:34.817648 (+ 20us) tablet.cc:662] Decoding operations
0928 20:03:34.818018 (+ 370us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:34.818077 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:34.834165 (+ 16088us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:03:34.834565 (+ 400us) tablet.cc:701] Row locks acquired
0928 20:03:34.834582 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:03:34.834748 (+ 166us) write_op.cc:270] Start()
0928 20:03:34.834857 (+ 109us) write_op.cc:276] Timestamp: P: 1790625814834661 usec, L: 0
0928 20:03:34.834876 (+ 19us) op_driver.cc:348] REPLICATION: starting
0928 20:03:34.835546 (+ 670us) log.cc:844] Serialized 919 byte log entry
0928 20:03:34.949451 (+113905us) op_driver.cc:464] REPLICATION: finished
0928 20:03:34.978398 (+ 28947us) write_op.cc:301] APPLY: starting
0928 20:03:34.978468 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:34.978607 (+ 139us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:34.978742 (+ 135us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:34.979234 (+ 492us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:34.979412 (+ 178us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:03:34.979459 (+ 47us) write_op.cc:312] APPLY: finished
0928 20:03:34.979679 (+ 220us) log.cc:844] Serialized 29 byte log entry
0928 20:03:34.980443 (+ 764us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:34.980515 (+ 72us) write_op.cc:454] Released schema lock
0928 20:03:34.980548 (+ 33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":845504,"reported_tablets":184,"spinlock_wait_cycles":3432320,"child_traces":[["op",{"apply.queue_time_us":28730,"apply.run_cpu_time_us":1696,"apply.run_wall_time_us":2392,"num_ops":2,"prepare.queue_time_us":46863,"prepare.run_cpu_time_us":2790,"prepare.run_wall_time_us":18793,"raft.queue_time_us":113,"raft.run_cpu_time_us":707,"raft.run_wall_time_us":707,"replication_time_us":114454,"spinlock_wait_cycles":23808,"thread_start_us":84920,"threads_started":2}]]}
W20260928 20:03:44.960274 26158 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 391) took 6556 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.960577 26158 rpcz_store.cc:269] 0928 20:03:38.403466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.960108 (+6556642us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.960223 (+ 115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.961297 26158 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 357) took 6457 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.961573 26158 rpcz_store.cc:269] 0928 20:03:38.503449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.961155 (+6457706us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.961250 (+ 95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.784807 26160 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 353) took 14540 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.809667 26159 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 337) took 15842 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.856843 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 356) took 8292 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.964238 26155 rpcz_store.cc:269] 0928 20:03:36.564751 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.856697 (+8291946us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.856794 (+ 97us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 20:03:44.964836 26505 raft_consensus.cc:1275] T 3657e36a6d2844c28852db1a4f2ed191 P 9b44798af33f4733ba9cde0a1b541f54 [term 2 FOLLOWER]: Refusing update from remote peer 92fd8074a7df4bba87a73c0d84ed00c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260928 20:03:44.967707 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 343) took 4716 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.968029 26155 rpcz_store.cc:269] 0928 20:03:40.251625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.964816 (+4713191us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.967638 (+ 2822us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.968801 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 392) took 4529 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.969085 26155 rpcz_store.cc:269] 0928 20:03:40.439802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.968659 (+4528857us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.968753 (+ 94us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 20:03:44.968880 26912 raft_consensus.cc:359] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:44.969610 26912 raft_consensus.cc:385] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260928 20:03:44.969713 26155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 358) took 4000 ms (client timeout 1000 ms). Trace:
I20260928 20:03:44.970155 30114 raft_consensus.cc:2804] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:03:44.970650 30114 raft_consensus.cc:493] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:03:44.971057 30114 raft_consensus.cc:3060] T 79967f9c7bf44678b9681449992776c5 P 9b44798af33f4733ba9cde0a1b541f54 [term 0 FOLLOWER]: Advancing to term 1
W20260928 20:03:44.962237 26159 rpcz_store.cc:269] 0928 20:03:28.967218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:28.967376 (+ 158us) service_pool.cc:224] Handling call
0928 20:03:33.710796 (+4743420us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:33.710820 (+ 24us) write_op.cc:454] Released schema lock
0928 20:03:44.809542 (+11098722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:33.591806 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:33.592312 (+ 506us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:33.592340 (+ 28us) write_op.cc:435] Acquired schema lock
0928 20:03:33.592356 (+ 16us) tablet.cc:662] Decoding operations
0928 20:03:33.592717 (+ 361us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:33.592774 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:33.592811 (+ 37us) tablet.cc:685] Acquiring locks for 2 operations
0928 20:03:33.593098 (+ 287us) tablet.cc:701] Row locks acquired
0928 20:03:33.593109 (+ 11us) write_op.cc:260] PREPARE: finished
0928 20:03:33.593239 (+ 130us) write_op.cc:270] Start()
0928 20:03:33.593335 (+ 96us) write_op.cc:276] Timestamp: P: 1790625813593190 usec, L: 0
0928 20:03:33.593350 (+ 15us) op_driver.cc:348] REPLICATION: starting
0928 20:03:33.593985 (+ 635us) log.cc:844] Serialized 919 byte log entry
0928 20:03:33.649264 (+ 55279us) op_driver.cc:464] REPLICATION: finished
0928 20:03:33.662879 (+ 13615us) write_op.cc:301] APPLY: starting
0928 20:03:33.662935 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:33.663041 (+ 106us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:33.664968 (+ 1927us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:33.665419 (+ 451us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:33.665574 (+ 155us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0928 20:03:33.665619 (+ 45us) write_op.cc:312] APPLY: finished
0928 20:03:33.665825 (+ 206us) log.cc:844] Serialized 29 byte log entry
0928 20:03:33.670033 (+ 4208us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:33.670138 (+ 105us) write_op.cc:454] Released schema lock
0928 20:03:33.670172 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0928 20:03:33.685820 (+ 15648us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:33.685851 (+ 31us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 20:03:33.689676 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:33.690270 (+ 594us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:33.690313 (+ 43us) write_op.cc:435] Acquired schema lock
0928 20:03:33.690338 (+ 25us) tablet.cc:662] Decoding operations
0928 20:03:33.690731 (+ 393us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:33.690797 (+ 66us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:33.690836 (+ 39us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:33.691062 (+ 226us) tablet.cc:701] Row locks acquired
0928 20:03:33.691081 (+ 19us) write_op.cc:260] PREPARE: finished
0928 20:03:33.691266 (+ 185us) write_op.cc:270] Start()
0928 20:03:33.691408 (+ 142us) write_op.cc:276] Timestamp: P: 1790625813691196 usec, L: 0
0928 20:03:33.691434 (+ 26us) op_driver.cc:348] REPLICATION: starting
0928 20:03:33.691971 (+ 537us) log.cc:844] Serialized 356 byte log entry
0928 20:03:33.703352 (+ 11381us) op_driver.cc:464] REPLICATION: finished
0928 20:03:33.706258 (+ 2906us) write_op.cc:301] APPLY: starting
0928 20:03:33.706313 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:33.706399 (+ 86us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:33.708662 (+ 2263us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:33.708857 (+ 195us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:33.709138 (+ 281us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:33.709187 (+ 49us) write_op.cc:312] APPLY: finished
0928 20:03:33.709396 (+ 209us) log.cc:844] Serialized 23 byte log entry
0928 20:03:33.710131 (+ 735us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:33.710198 (+ 67us) write_op.cc:454] Released schema lock
0928 20:03:33.710229 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1182642,"reported_tablets":201,"child_traces":[["op",{"apply.queue_time_us":13406,"apply.run_cpu_time_us":1738,"apply.run_wall_time_us":22884,"num_ops":2,"prepare.queue_time_us":6616,"prepare.run_cpu_time_us":2566,"prepare.run_wall_time_us":18247,"raft.queue_time_us":98,"raft.run_cpu_time_us":788,"raft.run_wall_time_us":788,"replication_time_us":55799,"thread_start_us":29492,"threads_started":2}],["op",{"apply.queue_time_us":2767,"apply.run_cpu_time_us":1268,"apply.run_wall_time_us":4143,"num_ops":1,"prepare.queue_time_us":1145,"prepare.run_cpu_time_us":2579,"prepare.run_wall_time_us":2594,"raft.queue_time_us":1120,"raft.run_cpu_time_us":699,"raft.run_wall_time_us":699,"replication_time_us":11824}]]}
W20260928 20:03:44.972287 26159 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 344) took 2814 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.972599 26159 rpcz_store.cc:269] 0928 20:03:42.158051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.972123 (+2814072us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.972228 (+ 105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.973251 26159 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.193:34037 (request call id 393) took 2338 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.973531 26159 rpcz_store.cc:269] 0928 20:03:42.635014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.973118 (+2338104us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.973201 (+ 83us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.962203 26160 rpcz_store.cc:269] 0928 20:03:30.244403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:30.244513 (+ 110us) service_pool.cc:224] Handling call
0928 20:03:44.784620 (+14540107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:34.077678 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:34.078167 (+ 489us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:34.078194 (+ 27us) write_op.cc:435] Acquired schema lock
0928 20:03:34.078211 (+ 17us) tablet.cc:662] Decoding operations
0928 20:03:34.078783 (+ 572us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:34.078830 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:34.078855 (+ 25us) tablet.cc:685] Acquiring locks for 5 operations
0928 20:03:34.079339 (+ 484us) tablet.cc:701] Row locks acquired
0928 20:03:34.079356 (+ 17us) write_op.cc:260] PREPARE: finished
0928 20:03:34.079483 (+ 127us) write_op.cc:270] Start()
0928 20:03:34.079569 (+ 86us) write_op.cc:276] Timestamp: P: 1790625814079432 usec, L: 0
0928 20:03:34.079587 (+ 18us) op_driver.cc:348] REPLICATION: starting
0928 20:03:34.080095 (+ 508us) log.cc:844] Serialized 2069 byte log entry
0928 20:03:34.090006 (+ 9911us) op_driver.cc:464] REPLICATION: finished
0928 20:03:34.090374 (+ 368us) write_op.cc:301] APPLY: starting
0928 20:03:34.090429 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:34.090580 (+ 151us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:34.090677 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:34.091230 (+ 553us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:34.091374 (+ 144us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0928 20:03:34.091416 (+ 42us) write_op.cc:312] APPLY: finished
0928 20:03:34.091615 (+ 199us) log.cc:844] Serialized 47 byte log entry
0928 20:03:34.091742 (+ 127us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:34.091822 (+ 80us) write_op.cc:454] Released schema lock
0928 20:03:34.091864 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0928 20:03:34.092077 (+ 213us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:34.092102 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":279078,"reported_tablets":205,"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":1671,"apply.run_wall_time_us":1671,"num_ops":5,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":2692,"prepare.run_wall_time_us":2693,"raft.queue_time_us":1468,"raft.run_cpu_time_us":725,"raft.run_wall_time_us":725,"replication_time_us":10329}]]}
W20260928 20:03:44.975385 26160 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 345) took 1196 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.975672 26160 rpcz_store.cc:269] 0928 20:03:43.778553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.975245 (+1196692us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.975330 (+ 85us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.976248 26158 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 342) took 5890 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.976538 26158 rpcz_store.cc:269] 0928 20:03:39.074993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.962091 (+5887098us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.965438 (+ 3347us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.969988 26155 rpcz_store.cc:269] 0928 20:03:40.969170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.969580 (+4000410us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.969658 (+ 78us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.977566 26159 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.194:51375 (request call id 359) took 2002 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.977857 26159 rpcz_store.cc:269] 0928 20:03:42.974815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.974056 (+1999241us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.977513 (+ 3457us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260928 20:03:44.979038 26154 rpcz_store.cc:269] 0928 20:03:37.459860 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:44.947271 (+7487411us) service_pool.cc:211] Skipping call since client already timed out
0928 20:03:44.947397 (+ 126us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260928 20:03:44.926615 26497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210183ea66e349d0b8ef63c0964ca0c8" candidate_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b44798af33f4733ba9cde0a1b541f54" is_pre_election: true
I20260928 20:03:44.980608 26638 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8477c5cb74205b4b55eb38d7f9542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:02:44 UTC) from {username='slave'} at 127.0.0.1:33616
I20260928 20:03:44.984310 26633 tablet_service.cc:1558] Processing DeleteTablet for tablet d13562e920244194969520df564a949d with delete_type TABLET_DATA_DELETED (replaced by tablet 030f48d0d716450aaa4248d9fb1397ba) from {username='slave'} at 127.0.0.1:33616
W20260928 20:03:44.910043 26147 catalog_manager.cc:5043] TS b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553): delete failed for tablet 6a31001f85b44bfcb35a29675f177b9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a31001f85b44bfcb35a29675f177b9e already in progress: creating tablet
W20260928 20:03:44.985435 26147 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.129.195:45553, user_credentials={real_user=slave}} blocked reactor thread for 75454.3us
W20260928 20:03:44.836133 26157 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.25.129.195:43117 (request call id 338) took 14042 ms (client timeout 1000 ms). Trace:
W20260928 20:03:44.987528 26157 rpcz_store.cc:269] 0928 20:03:30.793790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:30.793975 (+ 185us) service_pool.cc:224] Handling call
0928 20:03:44.835942 (+14041967us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757289,"reported_tablets":199}
W20260928 20:03:44.947041 26153 rpcz_store.cc:269] 0928 20:03:34.137035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0928 20:03:34.137249 (+ 214us) service_pool.cc:224] Handling call
0928 20:03:44.750877 (+10613628us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b2400002048. stack: 00007fe59c081373 00007fe59c081270 00007fe59bc24574 0000000000516a24 00000000005169b9 00007fe59bf37881 00007fe59c07bba1 00007fe59c07ba52 00007fe5a4fcc1c9 00007fe59caffc60 00007fe59cb0cdef 00007fe5a5094b64 00007fe5a2c34fb4 00007fe5a2c34f42 00007fe5a2c34e71 00007fe5a2c34dec
0928 20:03:44.771419 (+ 20542us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0928 20:03:43.192762 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:43.193278 (+ 516us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:43.193308 (+ 30us) write_op.cc:435] Acquired schema lock
0928 20:03:43.193326 (+ 18us) tablet.cc:662] Decoding operations
0928 20:03:43.193658 (+ 332us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:43.193700 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:43.193730 (+ 30us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:43.193902 (+ 172us) tablet.cc:701] Row locks acquired
0928 20:03:43.193922 (+ 20us) write_op.cc:260] PREPARE: finished
0928 20:03:43.194055 (+ 133us) write_op.cc:270] Start()
0928 20:03:43.209503 (+ 15448us) write_op.cc:276] Timestamp: P: 1790625823193983 usec, L: 0
0928 20:03:43.209535 (+ 32us) op_driver.cc:348] REPLICATION: starting
0928 20:03:43.218318 (+ 8783us) log.cc:844] Serialized 356 byte log entry
0928 20:03:43.342736 (+124418us) op_driver.cc:464] REPLICATION: finished
0928 20:03:43.343100 (+ 364us) write_op.cc:301] APPLY: starting
0928 20:03:43.343162 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:43.343257 (+ 95us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:43.343364 (+ 107us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:43.343599 (+ 235us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:43.343733 (+ 134us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:43.343783 (+ 50us) write_op.cc:312] APPLY: finished
0928 20:03:43.343975 (+ 192us) log.cc:844] Serialized 23 byte log entry
0928 20:03:43.344140 (+ 165us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:43.344207 (+ 67us) write_op.cc:454] Released schema lock
0928 20:03:43.344336 (+ 129us) write_op.cc:341] FINISH: Updating metrics
0928 20:03:43.344650 (+ 314us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:43.344675 (+ 25us) write_op.cc:454] Released schema lock
Related trace 'op':
0928 20:03:43.512693 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0928 20:03:43.513224 (+ 531us) write_op.cc:432] Acquiring schema lock in shared mode
0928 20:03:43.513259 (+ 35us) write_op.cc:435] Acquired schema lock
0928 20:03:43.513274 (+ 15us) tablet.cc:662] Decoding operations
0928 20:03:43.513584 (+ 310us) write_op.cc:620] Acquiring the partition lock for write op
0928 20:03:43.513638 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0928 20:03:43.513666 (+ 28us) tablet.cc:685] Acquiring locks for 1 operations
0928 20:03:43.513843 (+ 177us) tablet.cc:701] Row locks acquired
0928 20:03:43.513861 (+ 18us) write_op.cc:260] PREPARE: finished
0928 20:03:43.513982 (+ 121us) write_op.cc:270] Start()
0928 20:03:43.514084 (+ 102us) write_op.cc:276] Timestamp: P: 1790625823513882 usec, L: 0
0928 20:03:43.514136 (+ 52us) op_driver.cc:348] REPLICATION: starting
0928 20:03:43.514666 (+ 530us) log.cc:844] Serialized 356 byte log entry
0928 20:03:43.560679 (+ 46013us) op_driver.cc:464] REPLICATION: finished
0928 20:03:43.561051 (+ 372us) write_op.cc:301] APPLY: starting
0928 20:03:43.561113 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0928 20:03:43.561202 (+ 89us) tablet.cc:1397] finished BulkCheckPresence
0928 20:03:43.561322 (+ 120us) tablet.cc:1399] starting ApplyRowOperation cycle
0928 20:03:43.561582 (+ 260us) tablet.cc:1410] finished ApplyRowOperation cycle
0928 20:03:43.561741 (+ 159us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0928 20:03:43.561781 (+ 40us) write_op.cc:312] APPLY: finished
0928 20:03:43.561958 (+ 177us) log.cc:844] Serialized 23 byte log entry
0928 20:03:43.562124 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:43.562222 (+ 98us) write_op.cc:454] Released schema lock
0928 20:03:43.562262 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0928 20:03:43.562494 (+ 232us) write_op.cc:489] Releasing partition, row and schema locks
0928 20:03:43.562518 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":315925,"reported_tablets":184,"spinlock_wait_cycles":268865408,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":1489,"apply.run_wall_time_us":1489,"num_ops":1,"prepare.queue_time_us":6009,"prepare.run_cpu_time_us":2544,"prepare.run_wall_time_us":25812,"replication_time_us":133067}],["op",{"apply.queue_time_us":205,"apply.run_cpu_time_us":1428,"apply.run_wall_time_us":1427,"num_ops":1,"prepare.queue_time_us":259,"prepare.run_cpu_time_us":2273,"prepare.run_wall_time_us":2273,"raft.queue_time_us":1168,"raft.run_cpu_time_us":658,"raft.run_wall_time_us":659,"replication_time_us":46436}]]}
I20260928 20:03:44.969872 26912 raft_consensus.cc:740] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d286f4404146278f5e0785ed9fcee4, State: Initialized, Role: FOLLOWER
I20260928 20:03:44.991603 26912 consensus_queue.cc:260] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92fd8074a7df4bba87a73c0d84ed00c8" member_type: VOTER last_known_addr { host: "127.25.129.194" port: 45277 } } peers { permanent_uuid: "9b44798af33f4733ba9cde0a1b541f54" member_type: VOTER last_known_addr { host: "127.25.129.193" port: 33323 } } peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "127.25.129.195" port: 45553 } }
I20260928 20:03:44.993247 26912 ts_tablet_manager.cc:1480] T 9d2a20c1c6464f228baae236015349c5 P b2d286f4404146278f5e0785ed9fcee4: Time spent starting tablet: real 0.081s user 0.005s sys 0.000s
I20260928 20:03:44.999434 30059 leader_election.cc:290] T 6e1791bc36c1449ebac8d1cef490be0a P b2d286f4404146278f5e0785ed9fcee4 [CANDIDATE]: Term 3 election: Requested vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), 9b44798af33f4733ba9cde0a1b541f54 (127.25.129.193:33323)
I20260928 20:03:45.004787 30025 leader_election.cc:290] T ec76c64607c9425fb5c837cb856c852c P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92fd8074a7df4bba87a73c0d84ed00c8 (127.25.129.194:45277), b2d286f4404146278f5e0785ed9fcee4 (127.25.129.195:45553)
I20260928 20:03:45.005437 30025 raft_consensus.cc:493] T 2239c466fa8e471e820173c67bc04cad P 9b44798af33f4733ba9cde0a1b541f54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92fd8074a7df4bba87a73c0d84ed00c8)
W20260928 20:03:45.022301 26450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.129.194:45277, user_credentials={real_user=slave}} blocked reactor thread for 131062us
I20260928 20:03:45.023099 26450 leader_election.cc:304] T 585030449f204e5782c3200758324ebc P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:45.023932 26450 leader_election.cc:304] T 19331ec575fa42d79c0dc18123d26d71 P 9b44798af33f4733ba9cde0a1b541f54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters:
I20260928 20:03:45.024202 26913 ts_tablet_manager.cc:1480] T 7c865d2d368847dd9de688bdd65e88b9 P 92fd8074a7df4bba87a73c0d84ed00c8: Time spent starting tablet: real 0.138s user 0.005s sys 0.000s
I20260928 20:03:45.025435 26913 tablet_bootstrap.cc:492] T 7b1a8c85b6bc4849b447b6fd048afb2f P 92fd8074a7df4bba87a73c0d84ed00c8: Bootstrap starting.
I20260928 20:03:45.027402 26595 leader_election.cc:304] T dba8a3870878487991e518ee46b36cca P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8, 9b44798af33f4733ba9cde0a1b541f54; no voters: b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:45.028631 26595 leader_election.cc:304] T d1535def17b14663b42b76f3bc27001a P 92fd8074a7df4bba87a73c0d84ed00c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fd8074a7df4bba87a73c0d84ed00c8; no voters: 9b44798af33f4733ba9cde0a1b541f54, b2d286f4404146278f5e0785ed9fcee4
I20260928 20:03:45.029791 26912 tablet_bootstrap.cc:492] T c2385dd76e6d44319d3cdd4303feaa6b P b2d286f4404146278f5e0785ed9fcee4: Bootstrap starting.
I20260928 20:03:45.033699 30064 raft_consensus.cc:493] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2d286f4404146278f5e0785ed9fcee4)
I20260928 20:03:45.036727 30064 raft_consensus.cc:515] T bba200d6ef33438187dd643fe3ded009 P 92fd8074a7df4bba87a73c0d84ed00c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2d286f4404146278f5e0785ed9fcee4" member_type: VOTER last_known_addr { host: "